-- Logs begin at Sat 2022-04-09 20:01:14 UTC, end at Sat 2022-04-09 22:21:33 UTC. -- Apr 09 20:43:25.464267 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 09 20:43:25.473199 ncdv-master-1 devstack@n-api.service[126146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 9 20:43:25 2022] *** Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: nodename: ncdv-master-1 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: machine: x86_64 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: clock source: unix Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: pcre jit disabled Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: detected number of CPU cores: 4 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: current working directory: / Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: detected binary path: /usr/bin/uwsgi-core Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: your processes number limit is 47680 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: your memory page size is 4096 bytes Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: detected max file descriptor number: 2048 Apr 09 20:43:25.475217 ncdv-master-1 devstack@n-api.service[126146]: lock engine: pthread robust mutexes Apr 09 20:43:25.476181 ncdv-master-1 devstack@n-api.service[126146]: thunder lock: enabled Apr 09 20:43:25.476181 ncdv-master-1 devstack@n-api.service[126146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 09 20:43:25.476181 ncdv-master-1 devstack@n-api.service[126146]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 09 20:43:25.524080 ncdv-master-1 devstack@n-api.service[126146]: Python main interpreter initialized at 0x55def44a59c0 Apr 09 20:43:25.524080 ncdv-master-1 devstack@n-api.service[126146]: python threads support enabled Apr 09 20:43:25.524080 ncdv-master-1 devstack@n-api.service[126146]: your server socket listen backlog is limited to 100 connections Apr 09 20:43:25.524080 ncdv-master-1 devstack@n-api.service[126146]: your mercy for graceful operations on workers is 90 seconds Apr 09 20:43:25.524414 ncdv-master-1 devstack@n-api.service[126146]: mapped 403077 bytes (393 KB) for 2 cores Apr 09 20:43:25.524499 ncdv-master-1 devstack@n-api.service[126146]: *** Operational MODE: preforking *** Apr 09 20:43:25.524717 ncdv-master-1 devstack@n-api.service[126146]: *** uWSGI is running in multiple interpreter mode *** Apr 09 20:43:25.524717 ncdv-master-1 devstack@n-api.service[126146]: spawned uWSGI master process (pid: 126146) Apr 09 20:43:25.524908 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 09 20:43:25.525483 ncdv-master-1 devstack@n-api.service[126146]: spawned uWSGI worker 1 (pid: 126147, cores: 1) Apr 09 20:43:25.525837 ncdv-master-1 devstack@n-api.service[126146]: spawned uWSGI worker 2 (pid: 126148, cores: 1) Apr 09 20:43:25.526003 ncdv-master-1 devstack@n-api.service[126146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 09 20:43:26.778086 ncdv-master-1 devstack@n-api.service[126147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 09 20:43:26.796194 ncdv-master-1 devstack@n-api.service[126148]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 09 20:43:27.627606 ncdv-master-1 devstack@n-api.service[126147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:43:27.627606 ncdv-master-1 devstack@n-api.service[126147]: from cryptography.utils import int_from_bytes Apr 09 20:43:27.627890 ncdv-master-1 devstack@n-api.service[126147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:43:27.627890 ncdv-master-1 devstack@n-api.service[126147]: from cryptography.utils import int_from_bytes Apr 09 20:43:27.628914 ncdv-master-1 devstack@n-api.service[126148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:43:27.628914 ncdv-master-1 devstack@n-api.service[126148]: from cryptography.utils import int_from_bytes Apr 09 20:43:27.629249 ncdv-master-1 devstack@n-api.service[126148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:43:27.629249 ncdv-master-1 devstack@n-api.service[126148]: from cryptography.utils import int_from_bytes Apr 09 20:43:30.133518 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:43:30.134104 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:43:30.134199 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:43:30.134521 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:43:30.134598 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:43:30.134663 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:43:30.134887 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:43:30.135027 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:43:30.135276 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.135430 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:43:30.135561 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:43:30.135672 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.135882 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.135979 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136235 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136382 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136566 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136695 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136840 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.136937 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.137222 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.137351 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.137536 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.137664 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.137863 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138036 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138129 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138214 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138425 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138554 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138751 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.138898 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139067 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139196 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139356 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139461 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139664 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139771 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.139986 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140085 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140285 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140371 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140602 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140785 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.140928 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.141088 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.141287 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.141452 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.141616 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.142652 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.142782 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.142905 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143030 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143158 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143285 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143409 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143526 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143660 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143778 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.143902 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144010 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144136 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144254 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144378 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144512 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144631 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144746 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144861 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.144984 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145245 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145372 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145491 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145620 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145737 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.145862 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146002 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146128 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146313 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146451 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146640 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146843 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.146968 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147158 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147287 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147467 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147599 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147789 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.147922 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148117 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148240 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148427 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148552 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148752 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.148885 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149096 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149224 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149403 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149534 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149747 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.149889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150007 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150121 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150310 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150433 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150611 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150742 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.150917 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151052 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151168 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151275 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151477 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151612 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151739 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.151854 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152053 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152175 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152381 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152518 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152765 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.152889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153014 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153187 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153320 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153440 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153558 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153794 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.153919 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154100 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154248 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154396 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154520 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154715 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.154847 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155018 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155141 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155323 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155450 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155632 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155759 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.155937 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156060 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156401 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156533 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156660 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156786 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.156912 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157054 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157238 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157361 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157562 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157687 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157867 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.157990 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158191 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158315 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158493 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158622 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158831 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.158957 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159141 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159275 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159446 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159569 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159759 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.159901 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160082 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160216 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160395 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160525 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160696 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160818 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.160978 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161173 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161302 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161426 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161622 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161749 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.161926 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162061 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162180 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162298 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162467 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162592 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162766 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.162892 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163075 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163195 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163374 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163496 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163681 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163806 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.163983 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164106 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164288 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164421 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164600 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164731 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.164888 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165018 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165223 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165346 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165529 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165657 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165832 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.165955 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166133 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166256 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166439 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166569 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166740 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.166866 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167043 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167179 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167332 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167459 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167639 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167760 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.167942 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168074 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168246 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168373 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168552 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168688 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168855 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.168984 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169186 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169318 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169519 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169645 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169770 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.169887 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170085 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170263 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170394 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170511 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170676 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170813 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.170990 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171118 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171292 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171411 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171670 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171808 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.171927 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172044 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172225 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172343 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172531 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172661 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172831 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.172943 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173161 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173284 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173464 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173597 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173767 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.173888 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174074 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174201 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174371 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174494 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174673 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174839 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.174971 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175086 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175267 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175394 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175567 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175695 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175872 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.175990 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176175 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176304 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176479 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176599 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176783 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.176908 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177110 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177234 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177419 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177538 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177727 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.177860 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.178050 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:43:30.178182 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.178386 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.178507 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.178699 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.178831 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179035 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179157 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179351 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179470 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179673 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179801 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.179987 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180109 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180304 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180424 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180617 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180744 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.180927 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181094 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181265 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181397 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181579 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181722 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.181903 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182023 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182192 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182313 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182516 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182658 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182834 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.182953 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183151 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183282 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183475 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183635 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183784 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.183906 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184106 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184233 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184421 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184543 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184740 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.184859 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185065 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185191 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185401 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185529 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185716 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.185837 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186042 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186162 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186366 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186489 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186684 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186798 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.186998 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.187127 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.187312 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.187434 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.187885 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188009 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188136 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188264 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188382 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188508 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188627 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188744 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.188906 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189054 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189249 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189370 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189572 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189727 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.189871 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190007 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190184 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190305 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190495 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190616 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190813 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.190939 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191128 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191247 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191444 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191559 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191756 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.191867 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192068 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192189 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192358 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192481 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192669 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192799 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.192979 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193245 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193364 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193482 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193613 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193734 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.193892 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194021 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194207 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194341 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194512 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194638 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194823 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.194945 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195131 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195260 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195437 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195556 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195767 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.195889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196073 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196200 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196379 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196499 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196688 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196816 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.196997 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197152 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197323 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197442 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197633 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197761 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.197944 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198065 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198248 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198369 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198570 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198691 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.198880 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199003 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199184 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199311 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199499 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199618 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199801 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.199928 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200104 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200235 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200415 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200541 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200723 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.200845 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201083 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201296 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201417 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201543 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201670 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201813 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.201966 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202064 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202277 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202381 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202585 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202669 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202897 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.202981 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203236 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203331 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203553 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203642 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203876 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.203959 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204192 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204287 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204507 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204589 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204810 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.204893 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205154 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205243 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205460 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205541 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205764 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.205844 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206069 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206154 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206374 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206463 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206675 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206757 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.206977 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207062 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207278 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207361 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207579 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207662 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207884 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.207967 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208190 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208281 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208494 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208588 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208796 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.208886 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209127 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209225 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209434 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209525 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209741 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.209867 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210047 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210130 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210384 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210481 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210690 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.210779 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211019 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211101 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211342 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211439 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211654 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211738 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.211969 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212090 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212315 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212447 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212587 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212709 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.212896 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213017 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213228 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213343 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213545 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213668 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213854 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.213973 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214172 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214292 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214479 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214598 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214797 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.214916 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215106 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215251 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215425 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215546 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215731 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.215852 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216047 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216169 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216354 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216476 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216670 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.216805 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217002 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217175 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217327 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217449 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217641 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217773 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.217956 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218077 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218266 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218390 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218576 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218706 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.218936 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219059 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219249 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219390 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219561 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219691 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219871 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.219991 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220187 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220477 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220795 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.220913 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221118 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221253 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221438 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221560 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221742 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.221863 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222056 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222177 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222428 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222557 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222674 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222791 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.222993 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223115 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223304 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223444 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223626 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223753 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.223936 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224064 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224248 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224371 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224557 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224677 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.224861 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225000 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225195 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225317 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225508 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225630 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225818 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.225948 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226129 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226249 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226443 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226564 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226749 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.226879 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227059 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227178 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227365 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227499 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227671 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227805 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.227975 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228098 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228280 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228400 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228587 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228716 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.228902 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229028 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229248 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229370 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229563 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229683 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229863 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.229982 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230168 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230289 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230489 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230610 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230793 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.230912 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231098 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231224 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231402 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231526 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231706 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.231824 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232014 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232136 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232322 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232429 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232632 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232753 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.232929 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.233101 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.233589 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.233717 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.233903 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234025 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234221 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234374 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234558 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234682 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234871 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.234992 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235183 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235312 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235495 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235616 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235802 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.235923 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236116 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236236 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236423 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236542 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236734 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.236854 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237057 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237183 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237381 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237512 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237688 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237809 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.237999 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238122 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238308 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238427 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238609 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238729 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.238917 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239039 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239219 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239338 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239530 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239790 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.239914 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.240125 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.240402 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.240533 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.240739 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.240870 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241084 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241208 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241411 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241531 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241729 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.241857 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242049 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242170 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242379 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242499 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242704 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242839 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.242988 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243110 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243292 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243423 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243595 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243729 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.243905 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244036 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244214 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244343 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244518 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244640 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.244820 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245022 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245194 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245312 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245444 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245571 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245731 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.245868 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246037 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246158 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246338 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246458 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246641 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246762 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.246940 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247060 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247251 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247379 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247554 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247674 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247867 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.247995 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248175 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248306 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248476 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248606 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248778 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.248899 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249102 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249228 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249416 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249538 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249725 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.249845 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250106 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250243 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250417 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250545 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250756 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.250877 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251060 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251193 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251365 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251487 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251686 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251808 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.251992 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252122 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252296 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252420 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252597 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252719 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.252914 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253080 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253215 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253334 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253513 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253633 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253824 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.253946 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254127 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254246 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254434 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254555 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254742 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.254871 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255044 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255164 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255351 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255469 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255652 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255773 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.255961 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256083 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256263 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256382 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256563 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256686 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256862 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.256983 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257188 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257319 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257493 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257615 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257791 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.257911 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258096 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258231 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258397 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258517 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258706 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.258825 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259006 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259136 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259309 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259459 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259611 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259734 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.259914 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260042 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260220 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260341 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260517 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260637 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260828 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.260948 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261159 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261289 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261462 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261583 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261764 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.261887 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262069 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262189 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262370 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262488 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262671 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262791 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.262987 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263120 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263274 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263396 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263587 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263720 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.263888 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264011 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264199 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264329 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264501 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264622 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264803 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.264925 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265124 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265262 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265434 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265553 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265760 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.265882 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266062 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266194 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266362 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266484 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266663 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266785 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.266964 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267094 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267271 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267400 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267576 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267695 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.267879 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268009 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268182 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268305 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268483 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268604 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268788 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.268908 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269118 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269255 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269463 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269585 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269768 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.269889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270081 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270204 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270408 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270534 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270706 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.270835 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271019 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271140 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271332 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271461 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271634 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271755 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.271948 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272074 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272255 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272387 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272565 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272683 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272868 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.272988 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273241 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273441 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273560 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273791 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.273914 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274099 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274229 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274439 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274564 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274731 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.274884 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275052 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275185 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275359 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275489 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275667 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275788 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.275978 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276098 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276283 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276402 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276591 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276712 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.276900 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277024 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277230 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277351 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277541 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277663 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277851 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.277974 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278162 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278283 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278471 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278593 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278775 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.278897 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279083 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279211 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279391 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279519 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279692 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.279811 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280001 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280128 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280308 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280441 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280613 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280735 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.280921 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281094 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281267 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281414 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281609 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281736 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.281914 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282034 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282227 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282356 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282538 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282666 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.282944 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283063 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283279 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283408 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283560 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283682 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283869 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.283991 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284181 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284301 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284490 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284609 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284798 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.284928 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285137 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285259 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285449 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285569 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285833 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.285954 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286144 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286267 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286450 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286580 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286750 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.286880 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287061 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287186 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287368 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287487 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287673 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287802 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.287977 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288099 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288278 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288400 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288589 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288721 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.288891 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289011 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289234 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289366 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289538 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289668 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289860 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.289982 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.290224 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.290351 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.290582 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.290702 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.290892 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291019 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291222 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291348 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291542 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291664 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291861 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.291991 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292181 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292302 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292484 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292606 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292794 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.292943 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293152 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293275 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293469 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293603 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293733 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.293853 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294049 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294171 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294361 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294490 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294666 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294789 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.294987 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295110 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295293 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295423 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295608 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295736 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.295926 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296047 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296240 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296361 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296562 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296683 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.296958 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297133 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297303 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297435 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297628 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297750 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.297937 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298059 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298243 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298375 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298553 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298673 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298857 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.298981 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299161 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299285 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299467 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299588 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299775 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.299904 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300090 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300211 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300394 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300514 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300706 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.300832 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301015 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301167 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301340 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301471 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301648 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301768 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.301956 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302078 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302278 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302398 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302583 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302712 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.302902 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303022 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303219 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303339 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303534 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303670 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303842 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.303973 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304156 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304285 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304465 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304600 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304769 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.304892 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305097 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305232 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305407 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305537 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305717 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.305840 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306041 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306162 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306355 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306475 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306797 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.306985 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307111 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307316 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307440 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307626 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307745 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.307942 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308073 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308261 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308390 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308576 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308696 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.308879 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309008 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309212 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309336 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309522 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309644 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309826 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.309954 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310128 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310256 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310435 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310563 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310738 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.310940 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311071 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311190 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311313 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311439 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311620 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311754 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.311923 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312052 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312227 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312592 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312718 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.312898 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313018 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313263 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313387 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313647 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313778 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.313896 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314012 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314171 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314293 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314479 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314601 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314823 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.314943 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315131 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315251 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315452 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315580 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315771 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.315890 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316081 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316209 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316403 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316526 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316711 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.316837 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317025 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317177 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317367 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317489 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317684 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317803 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.317997 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318119 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318311 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318432 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318623 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318743 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.318935 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319069 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319248 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319368 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319559 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319680 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.319874 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.320024 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.320188 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.320391 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.320564 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.320717 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321014 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321193 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321475 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321668 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321790 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.321981 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322102 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322291 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322411 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322603 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322726 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.322915 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323045 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323226 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323342 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323538 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323668 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323865 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.323985 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324148 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324278 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324482 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324612 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324807 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.324929 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325140 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325263 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325461 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325595 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325776 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.325906 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326090 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326211 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326402 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326523 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326722 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.326852 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327041 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327174 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327429 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327562 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327681 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327798 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.327954 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328085 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328292 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328415 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328604 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328733 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.328919 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329094 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329253 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329374 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329566 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329690 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.329876 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330008 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330187 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330314 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330497 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330624 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330812 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.330933 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331129 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331258 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331444 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331563 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331755 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.331877 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332067 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332197 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332383 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332512 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332695 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.332901 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.333023 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.333240 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.333549 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.333680 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.333882 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334018 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334201 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334327 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334513 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334806 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.334941 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335061 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335192 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335318 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335438 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335564 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335726 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.335848 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336035 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336157 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336344 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336475 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336649 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336772 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.336958 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337106 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337289 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337423 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337607 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337732 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.337901 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338024 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338205 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338320 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338528 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338735 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.338859 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.339080 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.339360 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.339483 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.339706 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.339827 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340024 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340152 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340338 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340472 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340645 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340774 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.340968 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341125 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341298 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341419 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341604 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341736 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.341917 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342116 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342238 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342521 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342643 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342828 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.342963 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343132 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343252 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343441 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343555 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343764 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.343921 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344108 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344230 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344412 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344533 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344725 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.344869 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345073 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345199 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345359 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345480 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345666 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345791 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.345978 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346110 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346286 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346406 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346593 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346723 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.346899 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347023 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347203 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347332 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347509 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347642 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347826 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.347947 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348106 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348242 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348408 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348528 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348716 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.348837 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349024 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349250 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349376 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349504 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349653 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349773 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.349964 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350095 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350309 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350429 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350613 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350735 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.350929 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351060 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351235 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351554 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351676 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351865 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.351987 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352180 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352310 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352492 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352612 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352811 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.352941 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.353180 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.353379 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.353502 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.353722 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354029 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354152 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354362 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354484 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354688 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354817 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.354999 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355127 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355308 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355437 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355619 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355749 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.355925 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356046 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356234 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356355 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356546 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356859 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.356979 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.357198 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.357320 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.357509 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.357642 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.357871 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.358006 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.358124 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.358249 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.358739 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.358863 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359049 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359170 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359373 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359499 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359691 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.359815 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360001 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360128 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360312 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360434 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360622 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360745 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.360936 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361093 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361281 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361415 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361597 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361720 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.361914 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362035 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362228 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362359 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362538 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362659 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362846 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.362967 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363153 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363291 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363471 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363595 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363783 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.363910 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364102 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364224 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364408 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364529 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364733 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.364853 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365056 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365182 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365456 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365579 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365777 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.365900 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366087 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366210 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366407 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366532 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366722 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.366853 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367033 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367154 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367355 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367484 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367669 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367798 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.367996 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368124 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368299 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368429 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368631 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368754 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.368952 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369090 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369279 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369401 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369585 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369713 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.369892 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370015 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370203 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370332 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370513 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370677 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370820 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.370942 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371123 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371244 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371424 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371547 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371727 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.371846 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372029 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372148 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372334 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372460 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372636 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372756 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.372938 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373129 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373253 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373369 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373561 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373691 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.373871 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374007 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374172 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374292 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374474 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374635 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374755 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.374889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375108 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375234 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375413 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375531 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375716 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.375845 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376021 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376151 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376323 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376450 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376621 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376742 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.376922 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377063 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377252 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377386 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377558 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377679 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.377889 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378018 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378217 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378338 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378532 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378662 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378811 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.378933 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379121 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379251 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379439 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379568 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379749 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.379870 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380061 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380189 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380371 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380502 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380684 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380804 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.380996 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381183 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381330 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381461 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381644 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381766 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.381955 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382085 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382266 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382396 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382575 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382702 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.382888 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383020 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383201 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383322 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383504 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383668 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383836 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.383954 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384147 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384266 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384465 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384586 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384782 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.384906 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385113 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385251 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385436 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385566 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385746 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.385867 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386058 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386180 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386374 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386503 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386682 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386810 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.386992 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387114 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387304 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387433 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387617 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387740 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.387934 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388054 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388260 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388401 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388570 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388693 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.388893 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.389020 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.389322 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.389469 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.389653 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.389789 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390001 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390123 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390318 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390441 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390667 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.390840 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391010 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391139 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391288 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391411 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391531 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:43:30.391649 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.391901 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:43:30.392145 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:43:30.416408 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.416621 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_db.sqlalchemy.engines [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.477787 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.context [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=126148) load_cells /opt/stack/nova/nova/context.py:464}} Apr 09 20:43:30.482082 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.context [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=126147) load_cells /opt/stack/nova/nova/context.py:464}} Apr 09 20:43:30.482259 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_concurrency.lockutils [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:43:30.484076 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_concurrency.lockutils [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:43:30.484913 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_concurrency.lockutils [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:43:30.486770 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:43:30.486922 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_concurrency.lockutils [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:43:30.488354 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:43:30.489191 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:43:30.491132 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:43:30.497553 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.500652 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.503975 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_db.sqlalchemy.engines [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.506733 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_db.sqlalchemy.engines [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.658506 ncdv-master-1 devstack@n-api.service[126148]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:30.665480 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_db.sqlalchemy.engines [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:43:31.108864 ncdv-master-1 devstack@n-api.service[126148]: WARNING keystonemiddleware.auth_token [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:43:31.115611 ncdv-master-1 devstack@n-api.service[126148]: WARNING keystonemiddleware.auth_token [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:43:31.120626 ncdv-master-1 devstack@n-api.service[126147]: WARNING keystonemiddleware.auth_token [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:43:31.127237 ncdv-master-1 devstack@n-api.service[126147]: WARNING keystonemiddleware.auth_token [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:43:31.334922 ncdv-master-1 devstack@n-api.service[126148]: WARNING keystonemiddleware.auth_token [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:43:31.340137 ncdv-master-1 devstack@n-api.service[126148]: WARNING keystonemiddleware.auth_token [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:43:31.345193 ncdv-master-1 devstack@n-api.service[126147]: WARNING keystonemiddleware.auth_token [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:43:31.345601 ncdv-master-1 devstack@n-api.service[126148]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55def44a59c0 pid: 126148 (default app) Apr 09 20:43:31.347648 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:43:31.348836 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Apr 09 20:43:31.349297 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sat Apr 9 20:43:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:43:31.350643 ncdv-master-1 devstack@n-api.service[126147]: WARNING keystonemiddleware.auth_token [None req-4313c74b-e802-419e-b048-fb4ed6c55a30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:43:31.355869 ncdv-master-1 devstack@n-api.service[126147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55def44a59c0 pid: 126147 (default app) Apr 09 20:44:51.389762 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:44:51.391337 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Apr 09 20:44:51.391873 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:44:51.837238 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-9252b2b9-1f63-4f39-a8f3-0db142d5cf00 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:44:51.866925 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-9252b2b9-1f63-4f39-a8f3-0db142d5cf00 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468255 Apr 09 20:44:51.868002 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 20:44:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:44:54.271916 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:44:54.272920 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-a3c5a690-fb7d-4a5c-b1f5-d53399550f97 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Apr 09 20:44:54.273384 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:44:54.335144 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-1c708f86-d444-4f58-a928-35303734e780 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:54.352978 ncdv-master-1 devstack@n-api.service[126147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:44:54.352978 ncdv-master-1 devstack@n-api.service[126147]: warnings.warn(msg) Apr 09 20:44:54.384032 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-1c708f86-d444-4f58-a928-35303734e780 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104624 Apr 09 20:44:54.384786 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:44:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 20:44:54.598755 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-23f890c8-302b-4ff9-9b47-116ef756cf1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:54.601257 ncdv-master-1 devstack@n-api.service[126148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:44:54.601257 ncdv-master-1 devstack@n-api.service[126148]: warnings.warn(msg) Apr 09 20:44:54.649453 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-23f890c8-302b-4ff9-9b47-116ef756cf1f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.256666 Apr 09 20:44:54.665511 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Apr 9 20:44:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:44:57.031255 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-1c708f86-d444-4f58-a928-35303734e780 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:44:57.032380 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-1c708f86-d444-4f58-a928-35303734e780 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Apr 09 20:44:57.032762 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:44:57.138836 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-2b82ac4d-007c-407b-8ef4-f7d3b533ecec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:57.156812 ncdv-master-1 devstack@n-api.service[126148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:44:57.156812 ncdv-master-1 devstack@n-api.service[126148]: warnings.warn(msg) Apr 09 20:44:57.177469 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-2b82ac4d-007c-407b-8ef4-f7d3b533ecec admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138506 Apr 09 20:44:57.178251 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:44:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 20:44:57.189987 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-8f5a7099-d765-47d4-b028-6aae0d1c24ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:57.191551 ncdv-master-1 devstack@n-api.service[126147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:44:57.191551 ncdv-master-1 devstack@n-api.service[126147]: warnings.warn(msg) Apr 09 20:44:57.224794 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-8f5a7099-d765-47d4-b028-6aae0d1c24ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038500 Apr 09 20:44:57.225633 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Apr 9 20:44:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:44:59.731085 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-2b82ac4d-007c-407b-8ef4-f7d3b533ecec admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:44:59.732264 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-2b82ac4d-007c-407b-8ef4-f7d3b533ecec admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Apr 09 20:44:59.732744 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:44:59.848637 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-29357094-6117-441e-9610-b57d26c80fd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 1024, "disk": 10, "name": "ds1G"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:59.874350 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-29357094-6117-441e-9610-b57d26c80fd6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135039 Apr 09 20:44:59.877118 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:44:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 20:44:59.888854 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-a3deaa5b-5946-4462-9346-1bc457286911 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:44:59.915781 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-a3deaa5b-5946-4462-9346-1bc457286911 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030726 Apr 09 20:44:59.932216 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Apr 9 20:44:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:02.498891 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-29357094-6117-441e-9610-b57d26c80fd6 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:02.500565 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-29357094-6117-441e-9610-b57d26c80fd6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002231 Apr 09 20:45:02.511625 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:02.566975 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-76e2971f-98fe-4924-b47a-0a4731847b4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "id": "d3"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:02.591156 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-76e2971f-98fe-4924-b47a-0a4731847b4a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083807 Apr 09 20:45:02.604643 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-4ee602fb-01ca-4505-9716-578f3f6e5504 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:02.611395 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:02.631301 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-4ee602fb-01ca-4505-9716-578f3f6e5504 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030707 Apr 09 20:45:02.641175 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Apr 9 20:45:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:05.197206 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-76e2971f-98fe-4924-b47a-0a4731847b4a admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:05.197206 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-76e2971f-98fe-4924-b47a-0a4731847b4a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Apr 09 20:45:05.197206 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:05.242757 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:05.276100 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.095458 Apr 09 20:45:05.277748 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:05.288762 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-42f78bb4-1086-47d2-a733-456c71686b9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:05.315339 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-42f78bb4-1086-47d2-a733-456c71686b9a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030412 Apr 09 20:45:05.315932 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Apr 9 20:45:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:08.126940 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:08.128029 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Apr 09 20:45:08.128616 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:08.199760 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-9d691bb3-0234-4773-9832-bbd564f4b2ea admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:08.226623 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-9d691bb3-0234-4773-9832-bbd564f4b2ea admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091164 Apr 09 20:45:08.227612 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 20:45:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:10.651198 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:10.652722 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-d2b291ca-37a2-4ee5-8f45-828ab7ac0d27 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Apr 09 20:45:10.653998 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:10.716684 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-b9ed4e85-3fac-488e-874a-7ba6b1f6efbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "swap": 0}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:10.736525 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-b9ed4e85-3fac-488e-874a-7ba6b1f6efbe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075432 Apr 09 20:45:10.737510 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:10.749063 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-53a4909d-c6a7-4277-88dd-91059c4efac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:10.773553 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-53a4909d-c6a7-4277-88dd-91059c4efac4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028224 Apr 09 20:45:10.783109 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Apr 9 20:45:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:45:13.193690 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-b9ed4e85-3fac-488e-874a-7ba6b1f6efbe admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:13.195066 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-b9ed4e85-3fac-488e-874a-7ba6b1f6efbe admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Apr 09 20:45:13.195511 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:13.261341 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-ff034b74-1ba5-49bb-969c-b344e8b4fa35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:13.283417 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-ff034b74-1ba5-49bb-969c-b344e8b4fa35 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079730 Apr 09 20:45:13.284440 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:13.296141 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-b5291a02-f184-4b80-b0e4-35fff2d8b6e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:13.325019 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-b5291a02-f184-4b80-b0e4-35fff2d8b6e7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032521 Apr 09 20:45:13.325619 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Apr 9 20:45:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:15.840765 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-ff034b74-1ba5-49bb-969c-b344e8b4fa35 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:15.841980 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-ff034b74-1ba5-49bb-969c-b344e8b4fa35 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Apr 09 20:45:15.842370 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:15.911697 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-4a59f1fb-616e-4f32-90cc-bae88b09fa7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:15.932781 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-4a59f1fb-616e-4f32-90cc-bae88b09fa7f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084325 Apr 09 20:45:15.933584 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 20:45:15.946129 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-b9737a86-e8e6-4275-a236-394b76c0c190 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:15.970087 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-b9737a86-e8e6-4275-a236-394b76c0c190 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027756 Apr 09 20:45:15.970698 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Apr 9 20:45:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:18.506091 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-4a59f1fb-616e-4f32-90cc-bae88b09fa7f admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:18.507218 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-4a59f1fb-616e-4f32-90cc-bae88b09fa7f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 09 20:45:18.507611 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:18.567822 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-a119a2dc-b24b-42dd-8f88-d2417634fd9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "disk": 80}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:18.586741 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-a119a2dc-b24b-42dd-8f88-d2417634fd9f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073238 Apr 09 20:45:18.587458 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:18.598963 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-00ee2bf8-1b06-4016-9ce1-96d9fbbb2d7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:18.621440 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-00ee2bf8-1b06-4016-9ce1-96d9fbbb2d7e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026099 Apr 09 20:45:18.622017 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Apr 9 20:45:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:45:20.996335 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-a119a2dc-b24b-42dd-8f88-d2417634fd9f admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:20.997420 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-a119a2dc-b24b-42dd-8f88-d2417634fd9f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 09 20:45:20.997791 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:21.058278 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:21.076491 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072752 Apr 09 20:45:21.077067 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Apr 9 20:45:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:21.089700 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-44f9b3fa-45c7-49f9-82e0-6b7cfcc0389a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:21.113234 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-44f9b3fa-45c7-49f9-82e0-6b7cfcc0389a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027690 Apr 09 20:45:21.113743 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Apr 9 20:45:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:45:48.091776 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:48.092846 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 09 20:45:48.093289 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:48.157704 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-d3724181-d1c8-407c-8898-7463f18b9972 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:48.175102 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-d3724181-d1c8-407c-8898-7463f18b9972 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075481 Apr 09 20:45:48.175681 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 20:45:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:49.656223 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:49.657289 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-02654d76-1798-4663-9de1-61ef5a94ee28 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Apr 09 20:45:49.657686 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:49.927548 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-492445ca-d372-4863-b4f0-acd6e30ac919 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:49.933296 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.wsgi [None req-492445ca-d372-4863-b4f0-acd6e30ac919 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 09 20:45:49.933865 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-492445ca-d372-4863-b4f0-acd6e30ac919 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=126147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:49.934665 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-492445ca-d372-4863-b4f0-acd6e30ac919 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063118 Apr 09 20:45:49.935172 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:45:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:49.945676 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-c9a0de03-20ec-45ad-a4f8-e2d344e0947b admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:49.965945 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-c9a0de03-20ec-45ad-a4f8-e2d344e0947b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023906 Apr 09 20:45:49.966467 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:49.976286 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-7e89150f-a120-45e1-8afd-875e60b2a4a7 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:49.998696 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-7e89150f-a120-45e1-8afd-875e60b2a4a7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026034 Apr 09 20:45:49.999194 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:50.008751 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-25067946-d040-4eb4-832e-e60ce8f9b9fe admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:50.014571 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.wsgi [None req-25067946-d040-4eb4-832e-e60ce8f9b9fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 09 20:45:50.015126 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-25067946-d040-4eb4-832e-e60ce8f9b9fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=126148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:50.015911 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-25067946-d040-4eb4-832e-e60ce8f9b9fe admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010770 Apr 09 20:45:50.016414 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:45:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 09 20:45:51.353303 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-7e89150f-a120-45e1-8afd-875e60b2a4a7 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:51.354323 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-7e89150f-a120-45e1-8afd-875e60b2a4a7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 09 20:45:51.354727 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:51.570228 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-16156573-1d5c-46b9-9cb3-d64bc29ebea7 admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:51.575893 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.wsgi [None req-16156573-1d5c-46b9-9cb3-d64bc29ebea7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 09 20:45:51.576462 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-16156573-1d5c-46b9-9cb3-d64bc29ebea7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=126148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:51.577293 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-16156573-1d5c-46b9-9cb3-d64bc29ebea7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071805 Apr 09 20:45:51.577809 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:45:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:51.588397 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-998e4a58-f594-4ef4-97ec-cdc1e5531a9e admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:51.602256 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-998e4a58-f594-4ef4-97ec-cdc1e5531a9e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 Apr 09 20:45:51.602980 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:51.612758 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-391a69f6-1cc2-4cda-8f6b-170c6b2c589a admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:51.626614 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-391a69f6-1cc2-4cda-8f6b-170c6b2c589a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017835 Apr 09 20:45:51.627131 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:51.636249 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-adf69a8b-5ca0-4650-a14b-12417a265232 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:51.641832 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.wsgi [None req-adf69a8b-5ca0-4650-a14b-12417a265232 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 09 20:45:51.642388 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-adf69a8b-5ca0-4650-a14b-12417a265232 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=126147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:51.643160 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-adf69a8b-5ca0-4650-a14b-12417a265232 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010522 Apr 09 20:45:51.643641 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:45:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:52.959897 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-391a69f6-1cc2-4cda-8f6b-170c6b2c589a admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:52.960978 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-391a69f6-1cc2-4cda-8f6b-170c6b2c589a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Apr 09 20:45:52.961472 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:53.163756 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-9d281283-c76d-4887-b6b8-a811a5d657eb admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:53.169263 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.wsgi [None req-9d281283-c76d-4887-b6b8-a811a5d657eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 09 20:45:53.169832 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-9d281283-c76d-4887-b6b8-a811a5d657eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=126147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:53.170627 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-9d281283-c76d-4887-b6b8-a811a5d657eb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066462 Apr 09 20:45:53.171138 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:45:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:45:53.184498 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-9669c72e-4cfe-4da1-9f94-35086e39f26d admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:53.199896 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-9669c72e-4cfe-4da1-9f94-35086e39f26d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019044 Apr 09 20:45:53.200405 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:45:53.210557 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:53.223731 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017267 Apr 09 20:45:53.224228 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:45:53.233415 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-bf8bc270-c381-4b8e-b00e-64869bfe5ba4 admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:53.239130 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.wsgi [None req-bf8bc270-c381-4b8e-b00e-64869bfe5ba4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 09 20:45:53.239687 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-bf8bc270-c381-4b8e-b00e-64869bfe5ba4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=126148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:45:53.240462 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-bf8bc270-c381-4b8e-b00e-64869bfe5ba4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010620 Apr 09 20:45:53.240936 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:45:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 09 20:45:54.595638 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:54.596649 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Apr 09 20:45:54.597065 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:54.805343 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-818f8a61-e174-49ab-95bc-0708969f1c64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:54.828602 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-818f8a61-e174-49ab-95bc-0708969f1c64 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.087463 Apr 09 20:45:54.829117 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Apr 9 20:45:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:56.164512 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:56.165548 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 09 20:45:56.165954 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:56.371247 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-3265341c-15c5-4927-8121-1a3b6749e7ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:56.394241 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-3265341c-15c5-4927-8121-1a3b6749e7ab admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.086301 Apr 09 20:45:56.394824 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Apr 9 20:45:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:57.740864 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:57.741906 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 09 20:45:57.742300 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:57.942803 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-fd79affa-214f-4ff6-a335-510dc01ed924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:57.962648 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-fd79affa-214f-4ff6-a335-510dc01ed924 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075716 Apr 09 20:45:57.963373 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Apr 9 20:45:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:45:59.300024 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:45:59.301023 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Apr 09 20:45:59.301448 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:45:59.508194 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-4bce7598-3e42-424a-9fe4-19fdc2644fd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:45:59.537489 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-4bce7598-3e42-424a-9fe4-19fdc2644fd5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.091174 Apr 09 20:45:59.538216 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Apr 9 20:45:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:46:00.865065 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:46:00.866104 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Apr 09 20:46:00.866636 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:46:01.078489 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-50c7327a-cffa-4ad5-9c63-4f047a9e33e4 admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:46:01.097328 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-50c7327a-cffa-4ad5-9c63-4f047a9e33e4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084143 Apr 09 20:46:01.097862 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sat Apr 9 20:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:47:06.480752 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.481799 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-badbe6fc-6b6e-430d-9131-a4cf4ee79301 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Apr 09 20:47:06.482165 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:47:06.551366 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-c18b5325-9843-433e-907f-4fa39b30b45b admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.570559 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-c18b5325-9843-433e-907f-4fa39b30b45b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081597 Apr 09 20:47:06.571111 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:47:06.593959 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-c6b9f3e2-1778-4526-8bfc-b1b32f75a971 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.601886 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-c6b9f3e2-1778-4526-8bfc-b1b32f75a971 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012373 Apr 09 20:47:06.602411 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:47:06.614236 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-3df248d7-84b8-46f3-824d-6034cb8584be admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.621908 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-3df248d7-84b8-46f3-824d-6034cb8584be admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011337 Apr 09 20:47:06.622423 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:47:06.633663 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-ffb7b6d2-ee85-4b60-9e7a-a30d1c4af6e7 admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.641081 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-ffb7b6d2-ee85-4b60-9e7a-a30d1c4af6e7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010957 Apr 09 20:47:06.641582 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:47:06.652410 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:47:06.659929 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010939 Apr 09 20:47:06.660398 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Apr 9 20:47:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:49:10.010382 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-10bb6a12-9e78-43a1-9638-d50c7a68f115 tempest-verify_tempest_config-1228050053 tempest-verify_tempest_config-1228050053-project] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:49:10.012440 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-10bb6a12-9e78-43a1-9638-d50c7a68f115 tempest-verify_tempest_config-1228050053 tempest-verify_tempest_config-1228050053-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119408 Apr 09 20:49:10.012985 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 20:49:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:53:10.580336 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:53:10.581524 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 09 20:53:10.581922 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:53:10.843474 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:53:10.844651 ncdv-master-1 devstack@n-api.service[126147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:53:10.844651 ncdv-master-1 devstack@n-api.service[126147]: warnings.warn(msg) Apr 09 20:53:10.845897 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:53:10.846341 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:53:10.847129 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:53:10.847558 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:53:10.887894 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-ef89d1eb-4c1e-4a18-8192-63fc393b407a admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.164097 Apr 09 20:53:10.888448 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:53:10 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:53:12.244087 ncdv-master-1 devstack@n-api.service[126148]: DEBUG nova.api.openstack.wsgi [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] Calling method '>' {{(pid=126148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:53:12.245147 ncdv-master-1 devstack@n-api.service[126148]: INFO nova.api.openstack.requestlog [None req-7d97527a-a90a-48be-aad1-7432541b61eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Apr 09 20:53:12.245536 ncdv-master-1 devstack@n-api.service[126148]: [pid: 126148|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Apr 9 20:53:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:53:12.458182 ncdv-master-1 devstack@n-api.service[126147]: DEBUG nova.api.openstack.wsgi [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] Calling method '>' {{(pid=126147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:53:12.459354 ncdv-master-1 devstack@n-api.service[126147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:53:12.459354 ncdv-master-1 devstack@n-api.service[126147]: warnings.warn(msg) Apr 09 20:53:12.461076 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:53:12.461524 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:53:12.462323 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:53:12.462755 ncdv-master-1 devstack@n-api.service[126147]: DEBUG oslo_concurrency.lockutils [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:53:12.484740 ncdv-master-1 devstack@n-api.service[126147]: INFO nova.api.openstack.requestlog [None req-150201f1-2c1a-4ff9-8f46-876318fafe1b admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.095674 Apr 09 20:53:12.485991 ncdv-master-1 devstack@n-api.service[126147]: [pid: 126147|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:53:12 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:54:00.991101 ncdv-master-1 devstack@n-api.service[126146]: Sat Apr 9 20:54:00 2022 - graceful shutdown triggered... Apr 09 20:54:00.991198 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Apr 09 20:54:00.992181 ncdv-master-1 devstack@n-api.service[126147]: Gracefully killing worker 1 (pid: 126147)... Apr 09 20:54:00.992607 ncdv-master-1 devstack@n-api.service[126148]: Gracefully killing worker 2 (pid: 126148)... Apr 09 20:54:01.993152 ncdv-master-1 devstack@n-api.service[126146]: worker 1 buried after 1 seconds Apr 09 20:54:01.993152 ncdv-master-1 devstack@n-api.service[126146]: worker 2 buried after 1 seconds Apr 09 20:54:01.993152 ncdv-master-1 devstack@n-api.service[126146]: goodbye to uWSGI. Apr 09 20:54:01.995711 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Apr 09 20:54:01.996710 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Apr 09 20:54:02.001198 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 09 20:54:02.034211 ncdv-master-1 devstack@n-api.service[141807]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 9 20:54:02 2022] *** Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: nodename: ncdv-master-1 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: machine: x86_64 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: clock source: unix Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: pcre jit disabled Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: detected number of CPU cores: 4 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: current working directory: / Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: detected binary path: /usr/bin/uwsgi-core Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: your processes number limit is 47680 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: your memory page size is 4096 bytes Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: detected max file descriptor number: 2048 Apr 09 20:54:02.036157 ncdv-master-1 devstack@n-api.service[141807]: lock engine: pthread robust mutexes Apr 09 20:54:02.037086 ncdv-master-1 devstack@n-api.service[141807]: thunder lock: enabled Apr 09 20:54:02.037086 ncdv-master-1 devstack@n-api.service[141807]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 09 20:54:02.037086 ncdv-master-1 devstack@n-api.service[141807]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 09 20:54:02.087561 ncdv-master-1 devstack@n-api.service[141807]: Python main interpreter initialized at 0x5591cbb669c0 Apr 09 20:54:02.087561 ncdv-master-1 devstack@n-api.service[141807]: python threads support enabled Apr 09 20:54:02.087561 ncdv-master-1 devstack@n-api.service[141807]: your server socket listen backlog is limited to 100 connections Apr 09 20:54:02.087561 ncdv-master-1 devstack@n-api.service[141807]: your mercy for graceful operations on workers is 90 seconds Apr 09 20:54:02.088031 ncdv-master-1 devstack@n-api.service[141807]: mapped 403077 bytes (393 KB) for 2 cores Apr 09 20:54:02.088031 ncdv-master-1 devstack@n-api.service[141807]: *** Operational MODE: preforking *** Apr 09 20:54:02.088278 ncdv-master-1 devstack@n-api.service[141807]: *** uWSGI is running in multiple interpreter mode *** Apr 09 20:54:02.088278 ncdv-master-1 devstack@n-api.service[141807]: spawned uWSGI master process (pid: 141807) Apr 09 20:54:02.088459 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 09 20:54:02.090686 ncdv-master-1 devstack@n-api.service[141807]: spawned uWSGI worker 1 (pid: 141818, cores: 1) Apr 09 20:54:02.091090 ncdv-master-1 devstack@n-api.service[141807]: spawned uWSGI worker 2 (pid: 141819, cores: 1) Apr 09 20:54:02.091424 ncdv-master-1 devstack@n-api.service[141807]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 09 20:54:03.356263 ncdv-master-1 devstack@n-api.service[141819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 09 20:54:03.359843 ncdv-master-1 devstack@n-api.service[141818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 09 20:54:04.282971 ncdv-master-1 devstack@n-api.service[141819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:54:04.282971 ncdv-master-1 devstack@n-api.service[141819]: from cryptography.utils import int_from_bytes Apr 09 20:54:04.283303 ncdv-master-1 devstack@n-api.service[141818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:54:04.283303 ncdv-master-1 devstack@n-api.service[141818]: from cryptography.utils import int_from_bytes Apr 09 20:54:04.283457 ncdv-master-1 devstack@n-api.service[141819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:54:04.283457 ncdv-master-1 devstack@n-api.service[141819]: from cryptography.utils import int_from_bytes Apr 09 20:54:04.283584 ncdv-master-1 devstack@n-api.service[141818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 20:54:04.283584 ncdv-master-1 devstack@n-api.service[141818]: from cryptography.utils import int_from_bytes Apr 09 20:54:06.648462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:54:06.649010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:54:06.649149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:54:06.649499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:54:06.649582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:54:06.649658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:54:06.649742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:54:06.649812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:54:06.650146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:54:06.650305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.650397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:54:06.650493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.650777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.650930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.651876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.652937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.653924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.654986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.655883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.656117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.656293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.656428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.656751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.656941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.657174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.657441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.657565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.657777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.657886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.658828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.659778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.660814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.661799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.662826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.663982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.664920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.665093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.665332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.665470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.665587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.665920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.666040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.666351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.666351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.666743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.666892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.667041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.667180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.667325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.667325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.667726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.668956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.669112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.670936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.671951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.672850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.673935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.674818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.675921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.676960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.677942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.678811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.679948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.680960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.681899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.682838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.683945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.684961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.685924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.686904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.687956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.688925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.689907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.690842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.691956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.692974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.693214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.693342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.693550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:54:06.693677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.693903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.694668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.694668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.694858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.694942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.695890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.696901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.697858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.698925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.699952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.700886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.701242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.701596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.701703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.701953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.702961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.703975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.704273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.704356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.704611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.704698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.704928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.705911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.706900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.707969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.708183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.708339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.708475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.708567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.708771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.709831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.710926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.711930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.712891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.713861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.714928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.715839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.716930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.717930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.718064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.718236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.718400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.718717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.718943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.719135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.719293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.719495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.719805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.719960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.720888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.721887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.722994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.723921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.724822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.725988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.726991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.727994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.728948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.729942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.730909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.731857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.732822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.733855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.734807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.735023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.735113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.735393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.735808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.736983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.737971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.738931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.739888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.740932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.741906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.742835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.743983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.744925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.745895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.746974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.747921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.749925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.750884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.751814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.752794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.753787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.754968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.755915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.756864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.757168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.757262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.757510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.757623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.757835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.758877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.759955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.760839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.761996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.762930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.763958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.764888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.765842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.766829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.767771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.768998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.769976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.770927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.771962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.772903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.773859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.774956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.775997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.776943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.777876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.778858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.779006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.779146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.779296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.779640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.779961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.780960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.781269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.781363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.781485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.781569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.782152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.782268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.782268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.782479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.782791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.783792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.784958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.785897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.786931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.787845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.788833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.789075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.789170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.789413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.789532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.790998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.791985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.792991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.793893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.794865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.795967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.796898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.797933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.798927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.799049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.799190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.799305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.799826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.799976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.800876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.801151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.801275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.801396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.801519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.801916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.802846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.803996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.804955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.805093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.805387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.805518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.805704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.805821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.806801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.807939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.808994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.809966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.810085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.810288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.810411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.810600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.810716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.811010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.811124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.811326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.811441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.811708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.812903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.813890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.814869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.815079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.815794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.815925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.816958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.817939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.818878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.819810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.820960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.821099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.821305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.821419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.821619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.821744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.822890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.823469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.823595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.823713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.823822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.823936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.824968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.825984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.826969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.827956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.828931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.829950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.830974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.831904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.832299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.832395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.832466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.832534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.832801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.833996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.834961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.835926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.836893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.837884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.838954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.839915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.840205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.840454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.840929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.841956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.842079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.842488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.842625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.842866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.843925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.844982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.845252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.845488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.845612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.845720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.845828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.846827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.847832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.848980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.849160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.849330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.850977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.851985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.852093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.852247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.852381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.852760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.852886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.853940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.854980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.855969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.856878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.857876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.858957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.859983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.860252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.860378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.860933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.861942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.862063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.862230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.862356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.862807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.862937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.863049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.863157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.863920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.864869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.865963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.866813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.867946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.868936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.869958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.870901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.871900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.872096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.872215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.872407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.872528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.872923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.873989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.874995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.875202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.875328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.875542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.875666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.875893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.876886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.877959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.878917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.879864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.880983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.881956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.882073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.882268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.882395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.882596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.882712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.883914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.884891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.885952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.886976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.887118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.887350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.887506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.887743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.887902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.888954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.889167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.889313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.889479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.889751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.889924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.890957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.891261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.891561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.891745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.891972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.892712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.893414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.893414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.893700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.893841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.894983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.895887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.896915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.897076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.897236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.897474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.898240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.898395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.898592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.898744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.898888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.899936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.900971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.901995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.902235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.902479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.902627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.902779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.902962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.903406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.903557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.903711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.903852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.904845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.905908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.906916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.907104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.907324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.907488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.907708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.907874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.908958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.909875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.910909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.911990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.912145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.912382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.912629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.912909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.913074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.913514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.913693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.913837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.913987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:54:06.914819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:54:06.914819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:54:06.936368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:06.937594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_db.sqlalchemy.engines [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.002993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.context [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141819) load_cells /opt/stack/nova/nova/context.py:464}} Apr 09 20:54:07.003786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.context [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141818) load_cells /opt/stack/nova/nova/context.py:464}} Apr 09 20:54:07.007637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:07.008346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:07.009357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:07.010066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:07.010250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:07.010898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:07.012228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:07.012898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:07.025234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_db.sqlalchemy.engines [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.026521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_db.sqlalchemy.engines [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.030242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.031124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.188131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_db.sqlalchemy.engines [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.192202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:54:07.633290 ncdv-master-1 devstack@n-api.service[141819]: WARNING keystonemiddleware.auth_token [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:54:07.639952 ncdv-master-1 devstack@n-api.service[141819]: WARNING keystonemiddleware.auth_token [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:54:07.643283 ncdv-master-1 devstack@n-api.service[141818]: WARNING keystonemiddleware.auth_token [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:54:07.649864 ncdv-master-1 devstack@n-api.service[141818]: WARNING keystonemiddleware.auth_token [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:54:07.869813 ncdv-master-1 devstack@n-api.service[141819]: WARNING keystonemiddleware.auth_token [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:54:07.873071 ncdv-master-1 devstack@n-api.service[141818]: WARNING keystonemiddleware.auth_token [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 20:54:07.875079 ncdv-master-1 devstack@n-api.service[141819]: WARNING keystonemiddleware.auth_token [None req-cf7ee2d7-1166-4627-ba77-b7dab72afd19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:54:07.878456 ncdv-master-1 devstack@n-api.service[141818]: WARNING keystonemiddleware.auth_token [None req-5e0b1b63-7591-4132-9202-4bc24494eef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 20:54:07.880604 ncdv-master-1 devstack@n-api.service[141819]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591cbb669c0 pid: 141819 (default app) Apr 09 20:54:07.883858 ncdv-master-1 devstack@n-api.service[141818]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591cbb669c0 pid: 141818 (default app) Apr 09 20:54:57.045203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:57.047761 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.047761 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:57.049329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.049947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.050894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.051498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.096613 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ac7c929-cae4-424a-b658-be8536f56b58 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.592219 Apr 09 20:54:57.105752 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 20:54:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:57.162472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36f3e70a-bd8c-4a57-9d80-0752adcf3172 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1532567586", "id": 1598729671, "os-flavor-access:is_public": "True"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:57.180804 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.180804 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:57.236241 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-36f3e70a-bd8c-4a57-9d80-0752adcf3172 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.705823 Apr 09 20:54:57.245561 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1/2] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:54:55 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:54:57.325697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e9e686e8-99b8-4857-a163-4f88672c466c tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Calling method '.version_select at 0x7fb095327430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:57.447609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '.version_select at 0x7fb09541ce50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:57.448501 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.448501 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:57.457472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141818) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 09 20:54:57.458621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.459216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.487851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.488461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.511917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.512535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.519679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5995237c-6d10-438a-93c3-d02ff978e383 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.271919 Apr 09 20:54:57.521064 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 20:54:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:54:57.622883 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e9e686e8-99b8-4857-a163-4f88672c466c tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 371 microversion: 2.1 time: 0.515706 Apr 09 20:54:57.623477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 20:54:57 2022] GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:57.634560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-065c58d1-8c0e-464a-95c1-8b42e1b9ae9e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-775943804"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:57.676481 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.676481 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:57.679276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-065c58d1-8c0e-464a-95c1-8b42e1b9ae9e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 61c8ecee-816d-4533-affc-1b207abae744 for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:54:57.799714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-065c58d1-8c0e-464a-95c1-8b42e1b9ae9e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.168820 Apr 09 20:54:57.800962 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3/5] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:54:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:57.824642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:57.826819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.827395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.828325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.828861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:57.897627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e937fa8e-31d6-4498-8211-29ebe01f9b04 tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.375293 Apr 09 20:54:57.905852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Apr 9 20:54:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:54:57.912766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-077b10a6-d3c2-42c9-bba7-e748b85dde42 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:57.915047 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.915047 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:57.961390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Calling method '.version_select at 0x7fb0952a0dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:57.962885 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:57.962885 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:57.970304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141819) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 09 20:54:57.971514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:57.972103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.004806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.005497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.019876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.020536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.030088 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dc4f1e2b-b2d6-4af1-aa08-1cefbd09f9e5 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.227663 Apr 09 20:54:58.031283 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 4/7] 10.222.0.30 () {60 vars in 1207 bytes} [Sat Apr 9 20:54:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:54:58.231852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0d87ac1c-ce63-45fa-b637-8e2b638c532e tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1516093618", "id": 261848765, "os-flavor-access:is_public": "False"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:58.233620 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.233620 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:58.253112 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-077b10a6-d3c2-42c9-bba7-e748b85dde42 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1598729671/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.345834 Apr 09 20:54:58.253881 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 4/8] 10.222.0.30 () {62 vars in 1264 bytes} [Sat Apr 9 20:54:57 2022] POST /compute/v2.1/flavors/1598729671/os-extra_specs => generated 62 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:54:58.259932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb0952a3ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:58.284263 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0d87ac1c-ce63-45fa-b637-8e2b638c532e tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.251745 Apr 09 20:54:58.285063 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 5/9] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:54:58 2022] POST /compute/v2.1/flavors => generated 436 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:58.294183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d48b3ee6-c3ba-403f-bf11-6c5f4859317f tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:58.296005 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.296005 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:58.308008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d48b3ee6-c3ba-403f-bf11-6c5f4859317f tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.308468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d48b3ee6-c3ba-403f-bf11-6c5f4859317f tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.401925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.402370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.403167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.403712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.503808 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e2b2267-b254-4e1d-b850-9db4b5cb2ffd tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 328 microversion: 2.1 time: 0.247294 Apr 09 20:54:58.505226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 5/10] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:54:58 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:58.515530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:58.516547 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.516547 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:58.518313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.518995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.519771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:58.520384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:58.552995 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bcf5e4d8-4187-409b-8aa8-47c4b8ec123b tempest-AZAdminV2TestJSON-1829299999 tempest-AZAdminV2TestJSON-1829299999-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.041813 Apr 09 20:54:58.554056 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 20:54:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:58.571930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3356d8cb-39e3-4d8a-a4ce-b0df9d12972b tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:58.573479 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.573479 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:58.614156 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3356d8cb-39e3-4d8a-a4ce-b0df9d12972b tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1598729671" status: 202 len: 0 microversion: 2.86 time: 0.057516 Apr 09 20:54:58.616428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 7/12] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Apr 9 20:54:58 2022] DELETE /compute/v2.1/flavors/1598729671 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:54:58.632108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-457fd313-46e8-4d3a-bcd7-c93fc6275719 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:58.633658 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.633658 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:54:58.769538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-457fd313-46e8-4d3a-bcd7-c93fc6275719 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/261848765/action" status: 200 len: 96 microversion: 2.1 time: 0.151458 Apr 09 20:54:58.770777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 8/13] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Apr 9 20:54:58 2022] POST /compute/v2.1/flavors/261848765/action => generated 96 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:54:58.784253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-19e7e21f-3819-4f40-8eb5-a76dd37550c7 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:58.820668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-19e7e21f-3819-4f40-8eb5-a76dd37550c7 tempest-FlavorMetadataValidation-594905111 tempest-FlavorMetadataValidation-594905111-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.049337 Apr 09 20:54:58.833454 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 9/14] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:54:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:54:58.901495 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d48b3ee6-c3ba-403f-bf11-6c5f4859317f tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.615005 Apr 09 20:54:58.902107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 6/15] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:54:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:58.914482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68adceef-f404-4824-86f0-303bc2a2cbac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:58.916122 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:58.916122 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:59.098228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-425309764", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:59.470553 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-68adceef-f404-4824-86f0-303bc2a2cbac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 1bfb0a0b08e044a28171febe8b4a4d9c combination. Apr 09 20:54:59.473019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68adceef-f404-4824-86f0-303bc2a2cbac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 1bfb0a0b08e044a28171febe8b4a4d9c combination. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:54:59.474905 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68adceef-f404-4824-86f0-303bc2a2cbac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/261848765/action" status: 409 len: 152 microversion: 2.1 time: 0.564863 Apr 09 20:54:59.476468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 7/16] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Apr 9 20:54:58 2022] POST /compute/v2.1/flavors/261848765/action => generated 152 bytes in 567 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:54:59.482291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:59.484225 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:59.484225 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:59.495508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:59.496602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:59.531959 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Apr 09 20:54:59.532569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:54:59.533746 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b996028-1916-4d3d-b035-7dbe78f62278 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.056000 Apr 09 20:54:59.538056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 8/17] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:54:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Apr 09 20:54:59.547456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8eef2090-c9cd-4e03-916b-99a226752ef9 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:59.550306 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:59.550306 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:59.679328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:54:59.777759 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8eef2090-c9cd-4e03-916b-99a226752ef9 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/261848765/action" status: 200 len: 21 microversion: 2.1 time: 0.238529 Apr 09 20:54:59.782245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 9/18] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Apr 9 20:54:59 2022] POST /compute/v2.1/flavors/261848765/action => generated 21 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:54:59.792976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f823b5e-6cc4-4529-a564-44318df01dbd tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:54:59.794847 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:59.794847 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:54:59.809895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f823b5e-6cc4-4529-a564-44318df01dbd tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:54:59.810462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f823b5e-6cc4-4529-a564-44318df01dbd tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:54:59.974457 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f823b5e-6cc4-4529-a564-44318df01dbd tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.190861 Apr 09 20:54:59.975138 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 10/19] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:54:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:54:59.987414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fff1fc7-1930-4c01-8f13-676d38e209a2 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:54:59.988756 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:54:59.988756 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.034459 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fff1fc7-1930-4c01-8f13-676d38e209a2 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/261848765" status: 202 len: 0 microversion: 2.1 time: 0.052124 Apr 09 20:55:00.037883 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:54:59 2022] DELETE /compute/v2.1/flavors/261848765 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:00.049235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c7843c2-a56d-4647-832b-38d32c83ebf5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.050473 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.050473 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.085632 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c7843c2-a56d-4647-832b-38d32c83ebf5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.046177 Apr 09 20:55:00.086395 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 12/21] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:00 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:00.092944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9d4ca31-1221-4f36-8c8b-ae496180c0d8 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.168495 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9d4ca31-1221-4f36-8c8b-ae496180c0d8 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080705 Apr 09 20:55:00.172438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 13/22] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:00.187426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f71bfc2f-6ba8-41e2-8e91-fd99cc28ae42 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-219863783"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.189203 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.189203 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.190380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-f71bfc2f-6ba8-41e2-8e91-fd99cc28ae42 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 83f7ee45-c049-474d-afb8-a49b8a1c6eed for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:00.212217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:00.213282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:00.213890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:00.214428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:00.215567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:00.233285 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f71bfc2f-6ba8-41e2-8e91-fd99cc28ae42 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058741 Apr 09 20:55:00.237414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 14/23] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:00.245966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:00.246416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:00.247219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:00.247435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e309ec70-ab0a-473a-acac-501f3c5938b6 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1419956955"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.247646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:00.252456 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.252456 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.253435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-e309ec70-ab0a-473a-acac-501f3c5938b6 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Generated uuid 747e33bd-5a06-4e1e-b48c-51ac25d238b4 for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:00.301307 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e309ec70-ab0a-473a-acac-501f3c5938b6 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.061616 Apr 09 20:55:00.305616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:00.310442 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 15/24] 10.222.0.30 () {62 vars in 1204 bytes} [Sat Apr 9 20:55:00 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:00.324367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for user c87fb11072e34ee194e32b634c10b4a8 and project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:00.324492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd4bce6d-3ead-4b96-95f0-17af0143b37d tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1975124741", "id": 573735089, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.324588 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.324588 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.342896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.utils [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] cores quota exceeded for a22480ed945441e39568d90ae3891421, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141818) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 09 20:55:00.344175 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Apr 09 20:55:00.345061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:00.358413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52616924-166e-4400-8db0-0c6095f64ff2 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.535658 Apr 09 20:55:00.359742 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 10/25] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:54:58 2022] POST /compute/v2.1/servers => generated 111 bytes in 1537 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:00.369779 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd4bce6d-3ead-4b96-95f0-17af0143b37d tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.058173 Apr 09 20:55:00.370741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 16/26] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:00.382407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-701bfc88-e0b2-47e4-9fde-16d6fca78d88 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2024841642"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.547907 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.547907 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:00.595803 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-701bfc88-e0b2-47e4-9fde-16d6fca78d88 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.223694 Apr 09 20:55:00.601763 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 17/27] 10.222.0.30 () {62 vars in 1209 bytes} [Sat Apr 9 20:55:00 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:00.606529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb095c89e50>, body: {"quota_set": {"cores": 20}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.746663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-762da1b2-8eb4-4f4e-9d6c-0916b8d72b7a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:00.749796 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.749796 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:00.751029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-762da1b2-8eb4-4f4e-9d6c-0916b8d72b7a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:00.752116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-762da1b2-8eb4-4f4e-9d6c-0916b8d72b7a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:00.753145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-762da1b2-8eb4-4f4e-9d6c-0916b8d72b7a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.391870 Apr 09 20:55:00.758146 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 11/28] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:00.763974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25e2fd35-9104-45e8-b46c-c217c37b2ef4 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.764958 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.764958 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:00.773694 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-25e2fd35-9104-45e8-b46c-c217c37b2ef4 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] HTTP exception thrown: Access list not available for public flavors. Apr 09 20:55:00.778511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25e2fd35-9104-45e8-b46c-c217c37b2ef4 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:00.779622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-25e2fd35-9104-45e8-b46c-c217c37b2ef4 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/573735089/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020300 Apr 09 20:55:00.782221 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 12/29] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Apr 9 20:55:00 2022] GET /compute/v2.1/flavors/573735089/os-flavor-access => generated 91 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:00.793575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee1d43a9-3b84-4099-9ffa-c610d1028cdf tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.797722 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.797722 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:00.835077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee1d43a9-3b84-4099-9ffa-c610d1028cdf tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.051588 Apr 09 20:55:00.844771 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 13/30] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Apr 9 20:55:00 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:00.849006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2f7fc34-8eb1-4a7a-8596-d6aa47323343 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.852438 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.852438 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:00.970690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2f7fc34-8eb1-4a7a-8596-d6aa47323343 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.129446 Apr 09 20:55:00.971334 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 14/31] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:00 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:00.978412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bfc73fc6-f529-4e3a-8270-618a52f82e90 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:00.980555 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:00.980555 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:01.026581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bfc73fc6-f529-4e3a-8270-618a52f82e90 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/573735089" status: 202 len: 0 microversion: 2.1 time: 0.053819 Apr 09 20:55:01.028713 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 15/32] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:55:00 2022] DELETE /compute/v2.1/flavors/573735089 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:01.049817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68c51d4b-1eb9-4982-9d3e-2376af1b00e0 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:01.056450 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:01.056450 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:01.077357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c51d4b-1eb9-4982-9d3e-2376af1b00e0 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.080030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c51d4b-1eb9-4982-9d3e-2376af1b00e0 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:01.259679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.260142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:01.264000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.265720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:01.389107 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35cd848b-4e6b-4e62-82d1-7a1de5964847 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 329 microversion: 2.1 time: 0.783930 Apr 09 20:55:01.390023 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 18/33] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:00 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 329 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:01.402314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-400c4650-bde4-48fe-b6f5-55f2cbff9566 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1656878909"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:01.407434 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:01.407434 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:01.410731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-400c4650-bde4-48fe-b6f5-55f2cbff9566 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 85bc2536-b3df-44a0-a92c-5f211226447b for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:01.457325 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-400c4650-bde4-48fe-b6f5-55f2cbff9566 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063938 Apr 09 20:55:01.466581 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 19/34] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:01.477928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73b6d6ec-e285-4fb2-a5d1-ed2180f4f809 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:01.524373 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73b6d6ec-e285-4fb2-a5d1-ed2180f4f809 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056222 Apr 09 20:55:01.531518 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 20/35] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:01.537289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce4627a0-bb2c-44a4-876a-90dacbcfc33a tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Calling method '.version_select at 0x7fb094126dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:01.710261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68c51d4b-1eb9-4982-9d3e-2376af1b00e0 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.676552 Apr 09 20:55:01.718517 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 16/36] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Apr 9 20:55:01 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:01.726756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1437058670"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:01.730681 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:01.730681 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:01.742777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.743734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:01.758598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.760385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:01.774302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1437058670 could not be found. Apr 09 20:55:01.774985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1437058670 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:01.777684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51b27d3b-8be5-4b6c-bf4e-b72867e40468 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.057127 Apr 09 20:55:01.779060 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 17/37] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:01.791440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c69d01c3-2ec7-47d1-80fd-8c9fe49824bb tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1943522075", "id": 578271696, "os-flavor-access:is_public": "False"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:01.794437 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:01.794437 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:01.835723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c69d01c3-2ec7-47d1-80fd-8c9fe49824bb tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.055265 Apr 09 20:55:01.845283 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 18/38] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:01.863070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d942749-fc49-4c6f-8322-ab88e6f88662 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:01.865296 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:01.865296 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:01.877946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d942749-fc49-4c6f-8322-ab88e6f88662 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:01.878796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d942749-fc49-4c6f-8322-ab88e6f88662 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:02.058237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d942749-fc49-4c6f-8322-ab88e6f88662 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.210021 Apr 09 20:55:02.061058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 19/39] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Apr 9 20:55:01 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:02.074835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b4beaf0a-b557-4114-868e-c4d2686c1268 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:02.076020 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.076020 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.108075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b4beaf0a-b557-4114-868e-c4d2686c1268 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045264 Apr 09 20:55:02.108710 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 20/40] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:02 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:02.122203 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce4627a0-bb2c-44a4-876a-90dacbcfc33a tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 371 microversion: 2.1 time: 0.589519 Apr 09 20:55:02.124259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 21/41] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 20:55:01 2022] GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:02.142827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-242832a5-6c25-4f47-afaa-de05cfaa9542 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:02.146224 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.146224 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:02.201063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-242832a5-6c25-4f47-afaa-de05cfaa9542 tempest-AggregatesAdminTestV241-1338441468 tempest-AggregatesAdminTestV241-1338441468-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.073343 Apr 09 20:55:02.202307 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Apr 9 20:55:02 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:02.211225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5289791-266a-47f6-b665-387c2e44d14a tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.213914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5289791-266a-47f6-b665-387c2e44d14a tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:02.215176 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5289791-266a-47f6-b665-387c2e44d14a tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009491 Apr 09 20:55:02.232066 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 23/43] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:55:02.244822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb094217310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.499392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-67dd3263-324a-4e18-a832-b20989ca0741 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.501154 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.501154 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.502023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67dd3263-324a-4e18-a832-b20989ca0741 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9b6de40886804ad791f4039382c3747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb0a0b08e044a28171febe8b4a4d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:02.502670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-67dd3263-324a-4e18-a832-b20989ca0741 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:02.503476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-67dd3263-324a-4e18-a832-b20989ca0741 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] 10.222.0.30 "POST /compute/v2.1/flavors/578271696/action" status: 403 len: 130 microversion: 2.1 time: 0.392251 Apr 09 20:55:02.504015 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 21/44] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/flavors/578271696/action => generated 130 bytes in 395 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:02.530807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e50e676-c135-4645-86dd-abfb3fd6d408 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.533113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e50e676-c135-4645-86dd-abfb3fd6d408 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:02.541585 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e50e676-c135-4645-86dd-abfb3fd6d408 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.026914 Apr 09 20:55:02.571452 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:55:02.593840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a94dc63a-962b-4882-b01a-033b7edb6547 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2013693189", "name": "tempest-test_aggregate-2065908249"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.626461 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.626461 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.627474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-a94dc63a-962b-4882-b01a-033b7edb6547 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 211a6cce-5d25-4368-afeb-4e43c498a6d6 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:02.713604 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a94dc63a-962b-4882-b01a-033b7edb6547 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.136749 Apr 09 20:55:02.715581 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:02.728218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46a0777a-f6d8-4263-83c9-ce02da6416a5 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:02.729730 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.729730 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.759888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46a0777a-f6d8-4263-83c9-ce02da6416a5 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/578271696" status: 202 len: 0 microversion: 2.1 time: 0.041490 Apr 09 20:55:02.762451 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 24/47] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:55:02 2022] DELETE /compute/v2.1/flavors/578271696 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:02.769726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5405b4ea-5894-4841-a40a-d8f167501169 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1437087002"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.771813 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.771813 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.774322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5405b4ea-5894-4841-a40a-d8f167501169 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:02.775309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5405b4ea-5894-4841-a40a-d8f167501169 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:02.776590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5405b4ea-5894-4841-a40a-d8f167501169 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012803 Apr 09 20:55:02.783924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 25/48] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:02.800826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11c848a6-0833-47f5-9101-8f6c481ff942 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:02.802345 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.802345 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.822325 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11c848a6-0833-47f5-9101-8f6c481ff942 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.036423 Apr 09 20:55:02.833027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:55:02 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:02.847664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4348e076-dba3-40c5-a7a1-78db9ca3c377 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:02.920987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4348e076-dba3-40c5-a7a1-78db9ca3c377 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081834 Apr 09 20:55:02.921671 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 27/50] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:02.956452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b98c6f7-6e0d-45ee-ac30-9d51cc75b78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1299788349"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:02.964299 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:02.964299 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:02.965682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-5b98c6f7-6e0d-45ee-ac30-9d51cc75b78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid e3732998-1d07-469a-b16e-f6ce5c1e848e for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:03.008706 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b98c6f7-6e0d-45ee-ac30-9d51cc75b78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077484 Apr 09 20:55:03.010734 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 28/51] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:03.023890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a02440d1-0ecb-4ea4-8e77-5a8823e6d438 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:03.025317 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.025317 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:03.230101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a02440d1-0ecb-4ea4-8e77-5a8823e6d438 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:03.231498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a02440d1-0ecb-4ea4-8e77-5a8823e6d438 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:03.350877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:03.352901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:03.358739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:03.359600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:03.399366 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a02440d1-0ecb-4ea4-8e77-5a8823e6d438 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 315 microversion: 2.1 time: 0.387344 Apr 09 20:55:03.411689 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 29/52] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/os-aggregates/5/action => generated 315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:03.417892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72f8a6e1-c5c3-4243-ba9e-1d21afe3e598 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2024861723", "id": 3437197, "os-flavor-access:is_public": "False"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:03.419938 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.419938 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:03.449473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72f8a6e1-c5c3-4243-ba9e-1d21afe3e598 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.036330 Apr 09 20:55:03.457937 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 30/53] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/flavors => generated 430 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:03.470936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-288fad53-1132-4caf-87d4-d0fb40426e61 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1299788349"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:03.474936 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.474936 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:03.476572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-288fad53-1132-4caf-87d4-d0fb40426e61 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 483aa19e-02d5-4424-a30d-96ba99c69131 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:03.500853 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-288fad53-1132-4caf-87d4-d0fb40426e61 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1299788349 already exists. Apr 09 20:55:03.503304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-288fad53-1132-4caf-87d4-d0fb40426e61 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1299788349 already exists. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:03.506250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-288fad53-1132-4caf-87d4-d0fb40426e61 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.047053 Apr 09 20:55:03.512553 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb9385d6-9401-459c-9af5-ed6785efe076 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 328 microversion: 2.1 time: 1.277863 Apr 09 20:55:03.513026 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 31/54] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:03.526619 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 24/55] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:02 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 328 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:03.534154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23d2b7df-9120-42f8-9627-301bd2c994b6 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:03.537804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-379e61c9-d078-476f-94b2-c3f2abb767ad tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:03.537966 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.537966 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:03.542132 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.542132 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:03.600939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-379e61c9-d078-476f-94b2-c3f2abb767ad tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.072788 Apr 09 20:55:03.602444 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 25/56] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:03.616213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35ff8535-a9a8-45fe-8df7-acac6bd9edcc tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-705192727"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:03.618448 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.618448 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:03.620738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-35ff8535-a9a8-45fe-8df7-acac6bd9edcc tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 760e8b59-3747-4a18-9adf-61021b7eb2cc for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:03.672944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35ff8535-a9a8-45fe-8df7-acac6bd9edcc tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065142 Apr 09 20:55:03.674442 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 26/57] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:03.684991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9282c38-d123-44d3-8b23-a20fa0c82d9a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:03.686112 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:03.686112 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:03.687408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b9282c38-d123-44d3-8b23-a20fa0c82d9a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:03.688442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9282c38-d123-44d3-8b23-a20fa0c82d9a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:03.690028 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9282c38-d123-44d3-8b23-a20fa0c82d9a tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.009179 Apr 09 20:55:03.694710 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 27/58] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:55:03.699904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7dcd0a32-2650-4a93-939f-ebccffbe3ca1 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:03.741194 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7dcd0a32-2650-4a93-939f-ebccffbe3ca1 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.044506 Apr 09 20:55:03.747568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:04.287893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-980996752", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "availability_zone": "tempest-test_az-2013693189"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:04.310637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23d2b7df-9120-42f8-9627-301bd2c994b6 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/3437197/action" status: 200 len: 94 microversion: 2.1 time: 0.796339 Apr 09 20:55:04.320657 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 32/60] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/flavors/3437197/action => generated 94 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:04.342184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e005a96-c7e9-41ff-af72-4f622e157b76 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:04.345364 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:04.345364 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:04.398014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2e005a96-c7e9-41ff-af72-4f622e157b76 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 09 20:55:04.400127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e005a96-c7e9-41ff-af72-4f622e157b76 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:04.403854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e005a96-c7e9-41ff-af72-4f622e157b76 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.078119 Apr 09 20:55:04.408274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 33/61] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:04 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:04.431081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-382312869", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:04.536563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:04.546407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:04.547552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:04.548561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:04.549549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:04.968704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:04.969146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:04.969624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:04.970218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:04.970856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:04.990066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:04.990513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:04.991327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:04.991759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:05.056853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:05.080041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for user c87fb11072e34ee194e32b634c10b4a8 and project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:05.122566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.utils [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] instances quota exceeded for a22480ed945441e39568d90ae3891421, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141818) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 09 20:55:05.123807 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Apr 09 20:55:05.126237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:05.128628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fb204d3-cb46-4c00-aeb1-7e856a0fbac9 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.717286 Apr 09 20:55:05.130554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 34/62] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:04 2022] POST /compute/v2.1/servers => generated 119 bytes in 721 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:05.159757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79699a78-ea03-4d01-b094-fdf364179325 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:05.165347 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:05.165347 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:05.168741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-79699a78-ea03-4d01-b094-fdf364179325 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9b6de40886804ad791f4039382c3747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb0a0b08e044a28171febe8b4a4d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:05.169586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79699a78-ea03-4d01-b094-fdf364179325 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:05.173130 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79699a78-ea03-4d01-b094-fdf364179325 tempest-FlavorsAccessNegativeTestJSON-1440644821 tempest-FlavorsAccessNegativeTestJSON-1440644821-project] 10.222.0.30 "POST /compute/v2.1/flavors/3437197/action" status: 403 len: 133 microversion: 2.1 time: 0.036425 Apr 09 20:55:05.182005 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 35/63] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:05 2022] POST /compute/v2.1/flavors/3437197/action => generated 133 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:05.194792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b67f8ca0-2e13-4a8f-afac-5a6b568eb78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-967146556"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:05.199078 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:05.199078 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:05.202897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-b67f8ca0-2e13-4a8f-afac-5a6b568eb78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 7643f426-28bf-40de-952e-2d59aba27e33 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:05.266341 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b67f8ca0-2e13-4a8f-afac-5a6b568eb78e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076914 Apr 09 20:55:05.267014 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 36/64] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:05.288127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb0950f5ca0>, body: {"quota_set": {"instances": 10}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:05.713929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:06.218268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:06.225412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:06.226335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:06.226781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:06.258850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:06.259550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:06.260183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:06.260762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:06.261413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:06.294336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:06.296550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:06.299928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:06.300593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:06.331852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Getting quotas for project 47d1b7dc90f744f3861133f61e9b773a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:06.337185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Getting quotas for user dd3b417af048460da3ef7f6250a9b796 and project 47d1b7dc90f744f3861133f61e9b773a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:06.363584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:06.367307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:06.380232 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f594ef0-4ace-4762-9c51-aaaf4162f18e tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 329 microversion: 2.1 time: 1.097882 Apr 09 20:55:06.380854 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 37/65] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:05 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 329 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:06.401099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69bd1a7f-dc8c-44bd-8473-1b19cf040397 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1bfb0a0b08e044a28171febe8b4a4d9c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:06.402518 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:06.402518 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:06.469384 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4912883-8610-4bf0-a705-4cadca224bd8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719763 Apr 09 20:55:06.471041 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 29/66] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:55:06.478702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c0b59aa-ac83-42f3-9403-c85a56c80bbf tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:06.480030 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:06.480030 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:06.481877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c0b59aa-ac83-42f3-9403-c85a56c80bbf tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:06.483042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c0b59aa-ac83-42f3-9403-c85a56c80bbf tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:06.485383 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c0b59aa-ac83-42f3-9403-c85a56c80bbf tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.012053 Apr 09 20:55:06.486444 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 30/67] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 20:55:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:06.853171 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69bd1a7f-dc8c-44bd-8473-1b19cf040397 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/3437197/action" status: 200 len: 21 microversion: 2.1 time: 0.458471 Apr 09 20:55:06.859477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 38/68] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:06 2022] POST /compute/v2.1/flavors/3437197/action => generated 21 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:06.870301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79d7635a-fdbe-4731-8f57-e9718cc6aa9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Calling method '.version_select at 0x7fb0940a4ca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:06.912499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f4963b1-e3ad-46ba-8d93-113ef68f6064 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1316113177", "ram": 512, "vcpus": 1, "disk": 10, "id": 799317071, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:06.914514 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:06.914514 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:06.948044 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f4963b1-e3ad-46ba-8d93-113ef68f6064 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.460068 Apr 09 20:55:06.949712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 31/69] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:06 2022] POST /compute/v2.1/flavors => generated 413 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:06.962701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d35edab-203d-49dc-aa63-0f7fcdaf30db tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:06.965664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d35edab-203d-49dc-aa63-0f7fcdaf30db tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:07.187811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d35edab-203d-49dc-aa63-0f7fcdaf30db tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:07.207230 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d35edab-203d-49dc-aa63-0f7fcdaf30db tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1242 microversion: 2.1 time: 0.256248 Apr 09 20:55:07.207818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 32/70] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:06 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1242 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:07.224345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-159e9bff-f93d-49b1-86bd-fe3333af86ba tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:07.225593 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:07.225593 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:07.272017 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-159e9bff-f93d-49b1-86bd-fe3333af86ba tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.057834 Apr 09 20:55:07.274168 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 33/71] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:07.294929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05879ca5-972d-4efd-8e52-94d4e971edac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:07.297350 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:07.297350 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:07.350375 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05879ca5-972d-4efd-8e52-94d4e971edac tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/3437197" status: 202 len: 0 microversion: 2.1 time: 0.074448 Apr 09 20:55:07.351512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 34/72] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:07 2022] DELETE /compute/v2.1/flavors/3437197 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:07.491432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79d7635a-fdbe-4731-8f57-e9718cc6aa9d tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 371 microversion: 2.1 time: 0.623926 Apr 09 20:55:07.491976 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 39/73] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 20:55:06 2022] GET /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 371 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:07.520075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b3e4681-b02f-43d7-9359-e7a17b29a5d5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:07.520979 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:07.520979 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:07.551763 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9b3e4681-b02f-43d7-9359-e7a17b29a5d5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 09 20:55:07.552370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b3e4681-b02f-43d7-9359-e7a17b29a5d5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:07.553246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b3e4681-b02f-43d7-9359-e7a17b29a5d5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053761 Apr 09 20:55:07.553904 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 40/74] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:07.578222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-24985667-1811-47b5-9d05-eceb98b71cdb tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:07.635827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-24985667-1811-47b5-9d05-eceb98b71cdb tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.080713 Apr 09 20:55:07.649238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 41/75] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:07 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:07.655119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb0940d0820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:07.974718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba7b9c40-1070-4b92-8dbb-9c6ce513f309 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:08.009303 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ba7b9c40-1070-4b92-8dbb-9c6ce513f309 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] HTTP exception thrown: Flavor 799317071 has no extra specs with key hw:cpu_thread_policy. Apr 09 20:55:08.011262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba7b9c40-1070-4b92-8dbb-9c6ce513f309 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Returning 404 to user: Flavor 799317071 has no extra specs with key hw:cpu_thread_policy. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:08.019075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba7b9c40-1070-4b92-8dbb-9c6ce513f309 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] 10.222.0.30 "GET /compute/v2.1/flavors/799317071/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.662095 Apr 09 20:55:08.021119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 35/76] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:55:07 2022] GET /compute/v2.1/flavors/799317071/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 669 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:08.044079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6c0cd72-46b2-4921-918e-80817fb48e44 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:08.047076 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:08.047076 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:08.049352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6c0cd72-46b2-4921-918e-80817fb48e44 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:08.054695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6c0cd72-46b2-4921-918e-80817fb48e44 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:08.054695 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6c0cd72-46b2-4921-918e-80817fb48e44 tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029244 Apr 09 20:55:08.065530 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 36/77] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:55:08 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:08.078954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e132ff8-a58d-4b03-8a69-9f41cc1edb85 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-606542765", "id": 1571882770, "os-flavor-access:is_public": "False"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.086959 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:08.086959 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:08.132620 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e132ff8-a58d-4b03-8a69-9f41cc1edb85 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.062586 Apr 09 20:55:08.133871 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 37/78] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors => generated 438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:08.206806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:08.208563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:08.209817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:08.212019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:08.321660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1da7341c-fdb1-4c64-b0d7-cca85fe18eed tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 325 microversion: 2.1 time: 0.681758 Apr 09 20:55:08.322600 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 42/79] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:07 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 325 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:08.338985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c08d827b-8846-4083-ab16-97c3200d12f5 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.340791 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:08.340791 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:08.341920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c08d827b-8846-4083-ab16-97c3200d12f5 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b41bdd61ec4043b8ab68c53117601467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16b0ae6fece49df9063907aa97f8639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:08.342750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c08d827b-8846-4083-ab16-97c3200d12f5 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:08.343626 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c08d827b-8846-4083-ab16-97c3200d12f5 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] 10.222.0.30 "POST /compute/v2.1/flavors/799317071/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019789 Apr 09 20:55:08.344173 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 43/80] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors/799317071/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:08.355813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-33cc4cd9-48c3-49fd-8998-e7d8cd576587 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "11512ab5dc41425abfd94276cf39520d"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.472784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38f15473-90e2-450c-b3e0-c027995804bf tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-25873154", "ram": 512, "vcpus": 1, "disk": 10, "id": 1403332135, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.508780 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38f15473-90e2-450c-b3e0-c027995804bf tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.371729 Apr 09 20:55:08.516936 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 38/81] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors => generated 414 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:08.523384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:08.524148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:08.532107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:08.532887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:08.534020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:08.534591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:08.861775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:08.881349 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-33cc4cd9-48c3-49fd-8998-e7d8cd576587 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] HTTP exception thrown: Flavor access not found for 21 / 11512ab5dc41425abfd94276cf39520d combination. Apr 09 20:55:08.881971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-33cc4cd9-48c3-49fd-8998-e7d8cd576587 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Returning 404 to user: Flavor access not found for 21 / 11512ab5dc41425abfd94276cf39520d combination. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:08.882948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-33cc4cd9-48c3-49fd-8998-e7d8cd576587 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1571882770/action" status: 404 len: 124 microversion: 2.1 time: 0.536938 Apr 09 20:55:08.883613 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 44/82] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors/1571882770/action => generated 124 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:08.884849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7601c7ca-864e-40d3-a3a6-594b58bb448c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1242 microversion: 2.1 time: 0.366073 Apr 09 20:55:08.897716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-825c6e7f-d89a-4189-8c5a-63a0112060c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.899919 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 39/83] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:08 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1242 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:08.923514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-242662950", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:08.949143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-825c6e7f-d89a-4189-8c5a-63a0112060c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/799317071/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062746 Apr 09 20:55:08.955425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 45/84] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors/799317071/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:08.961225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97acef46-eb7b-48ee-ac87-af0dcbdcc1c7 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.004698 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97acef46-eb7b-48ee-ac87-af0dcbdcc1c7 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047492 Apr 09 20:55:09.006063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 46/85] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:09.010981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3f5c1da3-12a7-4e68-be7b-b5d24749e956 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.012035 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:09.012035 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:09.052332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:09.057715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3f5c1da3-12a7-4e68-be7b-b5d24749e956 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1571882770" status: 202 len: 0 microversion: 2.1 time: 0.043275 Apr 09 20:55:09.058560 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 47/86] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:55:09 2022] DELETE /compute/v2.1/flavors/1571882770 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:09.069995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1475e048-df1c-43a3-9287-19aadab3cf77 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.070767 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:09.070767 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:09.071623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1475e048-df1c-43a3-9287-19aadab3cf77 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b41bdd61ec4043b8ab68c53117601467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16b0ae6fece49df9063907aa97f8639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:09.072253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1475e048-df1c-43a3-9287-19aadab3cf77 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:09.073725 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1475e048-df1c-43a3-9287-19aadab3cf77 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010465 Apr 09 20:55:09.081422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 48/87] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 20:55:09 2022] DELETE /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:09.315483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:09.315931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:09.316461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:09.317110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:09.317830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:09.327024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:09.327550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:09.328425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:09.328873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:09.340418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-263b47ba-6998-47f8-aad0-0b85b0724c42 tempest-FlavorsExtraSpecsTestJSON-656558269 tempest-FlavorsExtraSpecsTestJSON-656558269-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.347692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:09.354999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Getting quotas for user c87fb11072e34ee194e32b634c10b4a8 and project a22480ed945441e39568d90ae3891421. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:09.356840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-263b47ba-6998-47f8-aad0-0b85b0724c42 tempest-FlavorsExtraSpecsTestJSON-656558269 tempest-FlavorsExtraSpecsTestJSON-656558269-project] 10.222.0.30 "GET /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.274016 Apr 09 20:55:09.359561 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 49/88] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 20:55:09 2022] GET /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:09.367998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.utils [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] ram quota exceeded for a22480ed945441e39568d90ae3891421, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141819) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 09 20:55:09.368769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Apr 09 20:55:09.369570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-acbe219e-ecb2-4b19-b319-1b0eba4e90a5 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.370016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:09.370879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff6aed57-cd1a-4a94-a713-3ff651ed7ee3 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.469836 Apr 09 20:55:09.373149 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 40/89] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 471 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:09.379444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f274c3c-92eb-4b2c-a2da-b14902b1f8d6 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.381087 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:09.381087 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:09.391322 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-acbe219e-ecb2-4b19-b319-1b0eba4e90a5 tempest-FlavorsAccessNegativeTestJSON-415109289 tempest-FlavorsAccessNegativeTestJSON-415109289-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.025461 Apr 09 20:55:09.392078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 50/90] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:09 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:09.407509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f274c3c-92eb-4b2c-a2da-b14902b1f8d6 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/799317071/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034829 Apr 09 20:55:09.409530 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 41/91] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Apr 9 20:55:09 2022] POST /compute/v2.1/flavors/799317071/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:09.414712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-08f7608e-357d-44fa-87ec-68191cd34c1f tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.437226 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-08f7608e-357d-44fa-87ec-68191cd34c1f tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026391 Apr 09 20:55:09.438082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 42/92] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Apr 9 20:55:09 2022] POST /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:09.446768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Action: 'update', calling method: .version_select at 0x7fb09411e310>, body: {"quota_set": {"ram": 51200}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.525357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7c733e8-d9a7-40fa-816c-987d3f7e641d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.536402 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7c733e8-d9a7-40fa-816c-987d3f7e641d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.138067 Apr 09 20:55:09.537718 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 51/93] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:55:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:09.542746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0944384a-5c7f-4a4f-8a7c-05f4350e9209 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.543990 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:09.543990 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:09.544858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0944384a-5c7f-4a4f-8a7c-05f4350e9209 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b41bdd61ec4043b8ab68c53117601467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16b0ae6fece49df9063907aa97f8639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:09.545527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0944384a-5c7f-4a4f-8a7c-05f4350e9209 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:09.546637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0944384a-5c7f-4a4f-8a7c-05f4350e9209 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383 tempest-FlavorsExtraSpecsNegativeTestJSON-701189383-project] 10.222.0.30 "PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007708 Apr 09 20:55:09.547202 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 52/94] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:09 2022] PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:09.553529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c48d03b6-f20e-4b05-865b-fcf44b7f38e2 tempest-FlavorsExtraSpecsTestJSON-656558269 tempest-FlavorsExtraSpecsTestJSON-656558269-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:09.572385 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c48d03b6-f20e-4b05-865b-fcf44b7f38e2 tempest-FlavorsExtraSpecsTestJSON-656558269 tempest-FlavorsExtraSpecsTestJSON-656558269-project] 10.222.0.30 "GET /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023807 Apr 09 20:55:09.573491 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 53/95] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 20:55:09 2022] GET /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:09.935546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:09.936125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:09.937940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:09.938828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:09.947815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc7f5c1a-6fa5-4074-8253-6ce0fe5f5bd2 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-996029601", "id": 1004132164, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:09.950850 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:09.950850 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:09.977524 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc7f5c1a-6fa5-4074-8253-6ce0fe5f5bd2 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.401344 Apr 09 20:55:09.979287 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 54/96] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:09 2022] POST /compute/v2.1/flavors => generated 424 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:09.989484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c61503eb-87f5-43d2-8c0e-0d3069a0ec78 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.007682 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c61503eb-87f5-43d2-8c0e-0d3069a0ec78 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] HTTP exception thrown: Flavor 799317071 has no extra specs with key hw:cpu_thread_policy. Apr 09 20:55:10.011304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c61503eb-87f5-43d2-8c0e-0d3069a0ec78 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Returning 404 to user: Flavor 799317071 has no extra specs with key hw:cpu_thread_policy. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:10.012519 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c61503eb-87f5-43d2-8c0e-0d3069a0ec78 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/799317071/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.030132 Apr 09 20:55:10.014759 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 55/97] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 20:55:09 2022] DELETE /compute/v2.1/flavors/799317071/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:10.023629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2ff52fb-33f9-4bda-9184-afd57f7f91aa tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.042141 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dffbd008-1405-400c-86d5-46287304dd30 tempest-QuotasAdminNegativeTest-1524531457 tempest-QuotasAdminNegativeTest-1524531457-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 200 len: 329 microversion: 2.1 time: 0.599058 Apr 09 20:55:10.043882 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 43/98] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:09 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 329 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:10.052041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.053761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:10.064910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2ff52fb-33f9-4bda-9184-afd57f7f91aa tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048552 Apr 09 20:55:10.066002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:10.066478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:10.067296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:10.067718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:10.072907 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 56/99] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Apr 9 20:55:10 2022] POST /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.085646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d12fc68d-725c-4330-bf76-c443716dc78a tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.099867 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d12fc68d-725c-4330-bf76-c443716dc78a tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024779 Apr 09 20:55:10.105662 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 57/100] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.128081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef609396-0283-4466-975b-6455cd252d4b tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.136063 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ef609396-0283-4466-975b-6455cd252d4b tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] HTTP exception thrown: Request body and URI mismatch Apr 09 20:55:10.142604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef609396-0283-4466-975b-6455cd252d4b tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:10.144713 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef609396-0283-4466-975b-6455cd252d4b tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.041828 Apr 09 20:55:10.146946 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 58/101] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:10 2022] PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:10.169742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7146f96-9b24-4eea-a599-f3cd3bd3d168 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Action: 'update', calling method: .version_select at 0x7fb094090940>, body: {"quota_set": {"ram": 0}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.174933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c7146f96-9b24-4eea-a599-f3cd3bd3d168 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c87fb11072e34ee194e32b634c10b4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22480ed945441e39568d90ae3891421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:10.175623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7146f96-9b24-4eea-a599-f3cd3bd3d168 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:10.178054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:10.186925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7146f96-9b24-4eea-a599-f3cd3bd3d168 tempest-QuotasAdminNegativeTest-1255903854 tempest-QuotasAdminNegativeTest-1255903854-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421" status: 403 len: 116 microversion: 2.1 time: 0.034182 Apr 09 20:55:10.189081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 59/102] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:10 2022] PUT /compute/v2.1/os-quota-sets/a22480ed945441e39568d90ae3891421 => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:10.191963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93d2d012-bf67-48aa-bb49-e471e4ee06dd tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1296 microversion: 2.1 time: 0.145953 Apr 09 20:55:10.199592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 44/103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1296 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:10.205482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c7568fe-d15a-4aa7-8353-398cb8bacaa0 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.212775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3fe98b9-9657-47b9-a8da-2ada6c22c81e tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1271055460", "id": 1641654892, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.215805 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:10.215805 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:10.230622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c7568fe-d15a-4aa7-8353-398cb8bacaa0 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040339 Apr 09 20:55:10.231252 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 60/104] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.255164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12c2f9d8-a558-49d4-b893-ddca215a2463 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.255334 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a3fe98b9-9657-47b9-a8da-2ada6c22c81e tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.053649 Apr 09 20:55:10.256049 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 45/105] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:10 2022] POST /compute/v2.1/flavors => generated 425 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:10.259209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12c2f9d8-a558-49d4-b893-ddca215a2463 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:10.262580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12c2f9d8-a558-49d4-b893-ddca215a2463 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.024274 Apr 09 20:55:10.264654 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 61/106] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:55:10 2022] PUT /compute/v2.1/flavors/799317071/os-extra_specs/hw:numa_nodes => generated 117 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:55:10.272949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87c2c4e8-0a09-44de-9638-6a657673f22a tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.275997 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:10.275997 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:10.276747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab7b5a14-b868-4058-a09e-4213ae67fa8c tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.298349 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab7b5a14-b868-4058-a09e-4213ae67fa8c tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031774 Apr 09 20:55:10.299115 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 62/107] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.310365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c503286-d34a-49dd-96b7-ff4b5daeffa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.338221 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87c2c4e8-0a09-44de-9638-6a657673f22a tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.079875 Apr 09 20:55:10.340723 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 46/108] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Apr 9 20:55:10 2022] PUT /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes => generated 22 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.355314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Action: 'create', calling method: .version_select at 0x7fb08f7a6a60>, body: {"keypair": {"name": "tempest-keypair-1795275409"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:10.357306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c503286-d34a-49dd-96b7-ff4b5daeffa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/799317071" status: 202 len: 0 microversion: 2.1 time: 0.056406 Apr 09 20:55:10.358107 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 63/109] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:55:10 2022] DELETE /compute/v2.1/flavors/799317071 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:10.365204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a87ed74f-eaa2-478d-a971-dab332522a45 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.384027 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a87ed74f-eaa2-478d-a971-dab332522a45 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019517 Apr 09 20:55:10.390798 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 64/110] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/1403332135/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.397229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2515f09d-d43c-4aed-9fb0-ba1c112623c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.406712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for project 430f19ffcb28429189b8c76282d2077b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:10.411551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for user 2d51c9bfc0124777b559e1d2cd1e2d50 and project 430f19ffcb28429189b8c76282d2077b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:10.435714 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2515f09d-d43c-4aed-9fb0-ba1c112623c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454 tempest-FlavorsExtraSpecsNegativeTestJSON-1249077454-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.043436 Apr 09 20:55:10.449167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 65/111] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:10.482300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d642b141-7574-4b5f-a0e0-7ed859945abd tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.561925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d642b141-7574-4b5f-a0e0-7ed859945abd tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.111489 Apr 09 20:55:10.563164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 66/112] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 20:55:10 2022] DELETE /compute/v2.1/flavors/1403332135/os-extra_specs/hw:numa_nodes => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:10.574206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d5f7b27-c6f6-4e7e-b4d4-192cb540ebd0 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.619475 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2d5f7b27-c6f6-4e7e-b4d4-192cb540ebd0 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1403332135/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.051766 Apr 09 20:55:10.620076 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 67/113] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 20:55:10 2022] DELETE /compute/v2.1/flavors/1403332135/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:10.633082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eb3696c6-7076-4b47-8044-3b4ced45953a tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.648238 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eb3696c6-7076-4b47-8044-3b4ced45953a tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1403332135/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020044 Apr 09 20:55:10.652462 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 68/114] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/1403332135/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:10.660390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f95b101-fdb6-4ca8-a312-7a6f4eb1ef31 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.720491 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f95b101-fdb6-4ca8-a312-7a6f4eb1ef31 tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1403332135" status: 202 len: 0 microversion: 2.1 time: 0.064509 Apr 09 20:55:10.723219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 69/115] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:55:10 2022] DELETE /compute/v2.1/flavors/1403332135 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:10.738638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fbc5ceb8-bfaa-4215-aab0-1bab5b17231f tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:10.799157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fbc5ceb8-bfaa-4215-aab0-1bab5b17231f tempest-FlavorsExtraSpecsTestJSON-614927764 tempest-FlavorsExtraSpecsTestJSON-614927764-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.068703 Apr 09 20:55:10.802348 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 70/116] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:10 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:10.876718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for project 430f19ffcb28429189b8c76282d2077b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:10.884414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for user 2d51c9bfc0124777b559e1d2cd1e2d50 and project 430f19ffcb28429189b8c76282d2077b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:10.917738 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db67ac08-4243-40eb-ad78-084a58c72689 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.575047 Apr 09 20:55:10.926940 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 47/117] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 20:55:10 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:11.214553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:11.215223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:11.236464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:11.237888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:11.239124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:11.241570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:11.398509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:11.406980 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3dc162c2-93d8-4194-9788-74019f57f011 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1296 microversion: 2.1 time: 0.198720 Apr 09 20:55:11.407941 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 48/118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:11 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:12.233205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-872450456", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:12.350752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:12.424136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:12.425482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:12.450242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:12.454069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:12.456457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:12.464267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:13.127736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:13.129645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:13.130400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:13.132065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:13.133975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:13.162200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:13.163858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:13.166708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:13.169777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:13.233242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:13.244247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e989f0d8-6569-4236-8315-25e90d5366d9 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.824039 Apr 09 20:55:13.244873 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 49/119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:12 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:13.261385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Getting quotas for project 10c5c17262b94d898c4aaa03102b4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:13.279152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Getting quotas for user 111ebd03dde445c99b447894d3ad03e7 and project 10c5c17262b94d898c4aaa03102b4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:13.322142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:13.327609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:13.484409 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e4631c7-74c8-45fa-a498-905d7a9cc8ae tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.476585 Apr 09 20:55:13.496609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 71/120] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:55:13.505222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cfa91116-1ba9-4457-859d-0bd138837f57 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:13.506993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cfa91116-1ba9-4457-859d-0bd138837f57 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:13.700775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cfa91116-1ba9-4457-859d-0bd138837f57 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:13.715955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cfa91116-1ba9-4457-859d-0bd138837f57 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1219 microversion: 2.1 time: 0.218200 Apr 09 20:55:13.731578 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 50/121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:13 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:14.263138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:14.264157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:14.312343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:14.313819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:14.318533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:14.320552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:14.748411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b50d82d8-ab82-4e2a-965d-8d0c2bcfe440 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:14.749263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b50d82d8-ab82-4e2a-965d-8d0c2bcfe440 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:14.998375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:15.000124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b50d82d8-ab82-4e2a-965d-8d0c2bcfe440 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:15.012247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b50d82d8-ab82-4e2a-965d-8d0c2bcfe440 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1219 microversion: 2.1 time: 0.267733 Apr 09 20:55:15.021152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 51/122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:14 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1219 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:15.066664 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-257c347b-0bd4-4754-9f5a-47e6eba07d0c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.808662 Apr 09 20:55:15.076934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 72/123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:14 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:16.029328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:16.029929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:16.037585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:16.038039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:16.038832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:16.039260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:16.083992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:16.084628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:16.094040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:16.113290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:16.114239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:16.114571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:16.286549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:16.294459 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-059d76fa-fc83-4d3e-bb8f-562a20f4dc42 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1271 microversion: 2.1 time: 0.268997 Apr 09 20:55:16.297461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 52/124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:16 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:16.688789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:16.696348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e42620f-17b0-4f11-918f-c496d8986063 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.616060 Apr 09 20:55:16.696921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 73/125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:16 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:16.821424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-192509044", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "1641654892", "adminPass": "***", "networks": [{"uuid": "fd4e1e04-2e4f-4f58-a730-1ef6a5f38dba"}], "security_groups": [{"name": "tempest-securitygroup--1301942103"}], "key_name": "tempest-keypair-1795275409", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:17.313211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:17.314540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:17.324697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:17.332830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:17.333915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:17.338664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:17.544782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:17.555075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99a0cba6-ae72-4fa6-9c9c-aeb1fc7b50fd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1277 microversion: 2.1 time: 0.245093 Apr 09 20:55:17.556429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 74/126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:17 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:17.713450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:17.714461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:17.731717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:17.732669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:17.735301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:17.737940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:18.087964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:18.098835 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1c4b3a9-a3de-45cb-9206-cea3825163b2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.389231 Apr 09 20:55:18.099801 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 75/127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:17 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:18.578857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:18.581233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:18.613591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:18.625847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:18.627271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:18.629785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:18.783932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:18.797016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6913155f-82b9-4644-9b32-f99c2bcf8157 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1277 microversion: 2.1 time: 0.227423 Apr 09 20:55:18.799751 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 76/128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:18 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:19.470188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cf3f0297-58bd-47f7-a7aa-b011b4102527 req-2e3bb53d-41b9-4233-a27d-ced616c34760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b31d467-dacc-4afb-b318-c50a9df98118", "tag": "0411e5c5-1a1c-4057-a321-d7244bb102f7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:19.485632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cf3f0297-58bd-47f7-a7aa-b011b4102527 req-2e3bb53d-41b9-4233-a27d-ced616c34760 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:19.486329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cf3f0297-58bd-47f7-a7aa-b011b4102527 req-2e3bb53d-41b9-4233-a27d-ced616c34760 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:19.532868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cf3f0297-58bd-47f7-a7aa-b011b4102527 req-2e3bb53d-41b9-4233-a27d-ced616c34760 service nova] Creating event network-changed:0411e5c5-1a1c-4057-a321-d7244bb102f7 for instance 1b31d467-dacc-4afb-b318-c50a9df98118 on nch1-master-1 Apr 09 20:55:19.533804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cf3f0297-58bd-47f7-a7aa-b011b4102527 req-2e3bb53d-41b9-4233-a27d-ced616c34760 service nova] Acquired lock "compute-rpcapi-router" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:55:19.535226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:19.535987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:19.537008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:19.538011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:19.549329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.rpcapi [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 09 20:55:19.550759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] Releasing lock "compute-rpcapi-router" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:55:19.576063 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49e5d797-e7d0-4108-a64d-70fa8424ba4b None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.700214 Apr 09 20:55:19.577449 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 77/129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:19.584831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:19.586504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:19.596793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:19.597624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:19.599005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:19.599717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:20.067295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:20.076823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0279f70e-262d-429c-9769-530f9091a847 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.497407 Apr 09 20:55:20.083206 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 78/130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:19 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:20.101482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:20.104510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:20.129682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:20.130926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:20.131915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:20.135405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:20.433240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:20.441420 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf3f5c04-9072-4d07-91a8-3abacaf0d3ac tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.356001 Apr 09 20:55:20.445347 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 79/131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:20 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:21.105848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:21.106632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:21.126166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:21.127072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:21.128284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:21.129392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:21.479332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:21.488989 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e262380-7e80-4189-acb8-317ce767b8c2 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.389265 Apr 09 20:55:21.503485 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 80/132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:21 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:21.513053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:21.513910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:21.520740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:21.521482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:21.522534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:21.523321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:21.793277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:21.817818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c6db462-f953-40a4-973c-50531eb96b71 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.299132 Apr 09 20:55:21.817818 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 81/133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:21 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:22.237919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e05b37c0-3cb2-4014-af16-195532ff3cc6 req-a1fea559-5a59-49ac-8ac8-d4f5df562204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c79f229-9d8b-4e20-b53c-684f5b9afd1f", "tag": "f5376796-653d-489e-95db-73d08d90ad01"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:22.273794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e05b37c0-3cb2-4014-af16-195532ff3cc6 req-a1fea559-5a59-49ac-8ac8-d4f5df562204 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:22.274894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e05b37c0-3cb2-4014-af16-195532ff3cc6 req-a1fea559-5a59-49ac-8ac8-d4f5df562204 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:22.308069 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e05b37c0-3cb2-4014-af16-195532ff3cc6 req-a1fea559-5a59-49ac-8ac8-d4f5df562204 service nova] Creating event network-changed:f5376796-653d-489e-95db-73d08d90ad01 for instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f on nch2-master-1 Apr 09 20:55:22.323363 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e05b37c0-3cb2-4014-af16-195532ff3cc6 req-a1fea559-5a59-49ac-8ac8-d4f5df562204 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098653 Apr 09 20:55:22.327780 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 82/134] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:22.512370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:22.513345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:22.528492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:22.532168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:22.533118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:22.533514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:22.805937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:22.824049 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f694485-2d4d-42b9-8a4a-013f8956ad7c tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.314555 Apr 09 20:55:22.856974 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 83/135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:22 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:22.868856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:22.870663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:22.885936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:22.886773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:22.888109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:22.888958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.147455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:23.156080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-537c84d3-9b08-4c68-aabe-311d64b6d9b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.297421 Apr 09 20:55:23.157300 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 84/136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:22 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:23.710246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f720160>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:23.711592 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:23.711592 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:23.713210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.713811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.714822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.716678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.834179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18bad966-13d4-416d-9c9f-1179f2917eb6 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.612188 Apr 09 20:55:23.842773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 85/137] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:55:23 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:23.853635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f705700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:23.855310 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:23.855310 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:23.862787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.863419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.864403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.864988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.902222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41a7c5bc-e001-4ccc-9115-eff4c94cdb90 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.057312 Apr 09 20:55:23.909716 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 86/138] 10.222.0.30 () {58 vars in 1138 bytes} [Sat Apr 9 20:55:23 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:23.916646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:23.918046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:23.927269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.927868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:23.929141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:23.929922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:24.241618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:24.255539 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f850b4a2-9dbc-4a6a-8597-3db4ae538577 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.342554 Apr 09 20:55:24.257487 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 87/139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:23 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:24.264354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f713790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:24.266661 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:24.266661 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:24.269182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:24.269963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:24.271596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:24.272580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:24.308265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0e93cfb-0a2d-4f92-83e9-4ed8239faa37 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.048745 Apr 09 20:55:24.310395 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 88/140] 10.222.0.30 () {58 vars in 1144 bytes} [Sat Apr 9 20:55:24 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:24.756883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee5d6185-786a-4f17-b95b-ce60988ff6d5 tempest-InstanceUsageAuditLogTestJSON-1759520772 tempest-InstanceUsageAuditLogTestJSON-1759520772-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:24.757843 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:24.757843 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:24.883870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee5d6185-786a-4f17-b95b-ce60988ff6d5 tempest-InstanceUsageAuditLogTestJSON-1759520772 tempest-InstanceUsageAuditLogTestJSON-1759520772-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-09 20:55:23" status: 200 len: 318 microversion: 2.1 time: 0.563689 Apr 09 20:55:24.895454 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 89/141] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 20:55:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-09%2020%3A55%3A23 => generated 318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:24.918812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:24.924919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:24.951709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:24.952202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:24.963938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:24.964396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:25.298300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:25.310863 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ed35661-e809-4980-9f4e-4061fa33c506 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.413711 Apr 09 20:55:25.320331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 90/142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:24 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:25.320331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b809dd70-4d54-4ca3-b789-51f071e309e3 tempest-InstanceUsageAuditLogTestJSON-1759520772 tempest-InstanceUsageAuditLogTestJSON-1759520772-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:25.320736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] validate_networks() for [('fd4e1e04-2e4f-4f58-a730-1ef6a5f38dba', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:25.324422 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:25.324422 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:25.336708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b809dd70-4d54-4ca3-b789-51f071e309e3 tempest-InstanceUsageAuditLogTestJSON-1759520772 tempest-InstanceUsageAuditLogTestJSON-1759520772-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023063 Apr 09 20:55:25.337564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 91/143] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 20:55:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:25.563775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b9fba27-eade-49d3-8562-fad3c820d32c tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840 tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:25.564901 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:25.564901 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:25.566071 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4b9fba27-eade-49d3-8562-fad3c820d32c tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840 tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Apr 09 20:55:25.566912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b9fba27-eade-49d3-8562-fad3c820d32c tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840 tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:25.567972 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b9fba27-eade-49d3-8562-fad3c820d32c tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840 tempest-InstanceUsageAuditLogNegativeTestJSON-1449390840-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.229446 Apr 09 20:55:25.568747 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 92/144] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Apr 9 20:55:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:55:25.583512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:25.586461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:25.597862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:25.598773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:25.599782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:25.600408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:25.929428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:25.951729 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-92340f4d-2c5a-44f4-b12d-b373f33060ee tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.381636 Apr 09 20:55:25.952830 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 93/145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:25 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:26.190277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1831038b-3491-4b59-8dc6-bac0dec22a61 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:26.191066 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:26.191066 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:26.192777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1831038b-3491-4b59-8dc6-bac0dec22a61 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b43c1912a5ad474d9cdc541530e83b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c759b75f393d41f5885d084346557894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:26.193454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1831038b-3491-4b59-8dc6-bac0dec22a61 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:26.194270 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1831038b-3491-4b59-8dc6-bac0dec22a61 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.239728 Apr 09 20:55:26.194812 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 94/146] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 20:55:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 241 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:26.203662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b236360-8704-44ca-8bcb-9670ccc5195a tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:26.204539 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:26.204539 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:26.205827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b236360-8704-44ca-8bcb-9670ccc5195a tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b43c1912a5ad474d9cdc541530e83b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c759b75f393d41f5885d084346557894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:26.206470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b236360-8704-44ca-8bcb-9670ccc5195a tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:26.207425 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b236360-8704-44ca-8bcb-9670ccc5195a tempest-InstanceUsageAuditLogNegativeTestJSON-172838571 tempest-InstanceUsageAuditLogNegativeTestJSON-172838571-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-09 20:55:26" status: 403 len: 128 microversion: 2.1 time: 0.007804 Apr 09 20:55:26.208422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 95/147] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 20:55:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-09%2020%3A55%3A26 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:55:26.329173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:26.330011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:26.336837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.337626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:26.338940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.339832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:26.619365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:26.620946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:26.621615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:26.623697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:26.624280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:26.639010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.639741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:26.640706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.641300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:26.650878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:26.661695 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45681bd9-3f1f-4917-b645-7414ddb578c5 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.337619 Apr 09 20:55:26.662286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 96/148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:26 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:26.668150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for project 430f19ffcb28429189b8c76282d2077b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:26.676809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for user 2d51c9bfc0124777b559e1d2cd1e2d50 and project 430f19ffcb28429189b8c76282d2077b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:26.689242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:26.692221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:26.800304 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba7b81ea-46a4-43f2-8bf3-e5ca6c744279 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.983107 Apr 09 20:55:26.800944 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 53/149] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 9985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 20:55:26.822345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35d0330a-46bf-4710-bcc3-97887bed5b98 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:26.823159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35d0330a-46bf-4710-bcc3-97887bed5b98 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:26.942640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35d0330a-46bf-4710-bcc3-97887bed5b98 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:26.961295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35d0330a-46bf-4710-bcc3-97887bed5b98 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1264 microversion: 2.1 time: 0.150002 Apr 09 20:55:26.965497 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 97/150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:26 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:26.976728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:26.977381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:26.992463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.993628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:26.994973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:26.998748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:27.303703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:27.315591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4cd9440-7859-493a-b29a-b4d86f2c99ad tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.350023 Apr 09 20:55:27.322152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 54/151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:26 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:27.678299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:27.679295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:27.685944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:27.686699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:27.687697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:27.688327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:27.980883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:27.981888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:27.991750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:27.992343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:27.994962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:27.995659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:28.031258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:28.039619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee2d5e30-856c-4a56-ba2e-e6eb18db1464 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.364994 Apr 09 20:55:28.040971 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 98/152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:27 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:28.079949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:28.088030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f496b14b-244b-4377-bcf6-bce78f9fe9e7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1338 microversion: 2.1 time: 0.111887 Apr 09 20:55:28.088857 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 55/153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:27 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:28.331951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:28.332420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:28.365697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:28.366078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:28.366896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:28.367386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:28.719333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:28.727216 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-593293b8-9bbe-4e1b-9f78-4974f50a92ba tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.399247 Apr 09 20:55:28.731025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 99/154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:28 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:29.061315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:29.062490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:29.071024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.072082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.073165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.073854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.106208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:29.106816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:29.118441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.119786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.121829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.122441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.200860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:29.210501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e30ed93-a335-4401-bf55-139a6fdb11de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1344 microversion: 2.1 time: 0.108766 Apr 09 20:55:29.211838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 100/155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:29 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:29.300186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:29.316540 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bfe4b9ed-8cde-4e24-9edf-365dec620f88 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.260301 Apr 09 20:55:29.317825 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 56/156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:29 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:29.747048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:29.748140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:29.756788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.757254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.759566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:29.761092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:29.959079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:29.967591 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e388b2af-3b5b-40e3-a66b-01797f0800e8 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.224295 Apr 09 20:55:29.975074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 101/157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:29 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:30.228206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:30.229024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:30.237311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:30.241950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:30.249382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:30.254002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:30.587789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:30.595562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-83c84b2e-fac3-43e2-8d29-d39bf64bd6af tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.371401 Apr 09 20:55:30.599681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 57/158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:30 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:30.604520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:30.618090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:30.630016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:30.630696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:30.631652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:30.632223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:30.727869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c76b995-ef2f-4c95-a10a-e4d4cea9039b tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] Action: 'create', calling method: .version_select at 0x7fb08f72eca0>, body: {"security_group": {"name": "tempest-securitygroup-1731447653", "description": "tempest-description-642483883"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:31.012345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:31.025096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fabb4af4-ed2f-4968-9361-129fe2a96a2e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.424095 Apr 09 20:55:31.025722 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 58/159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:30 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:31.035488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5793bd7b-c38e-4750-937e-6b1e29d43b12 req-735dd687-ffc0-431f-9d41-bb18537eff9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3765143e-2819-46e6-94ae-6d26f95a5ef4", "tag": "5fceff8c-349f-449f-affd-fa4876c4f5d7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:31.066642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5793bd7b-c38e-4750-937e-6b1e29d43b12 req-735dd687-ffc0-431f-9d41-bb18537eff9e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.067087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5793bd7b-c38e-4750-937e-6b1e29d43b12 req-735dd687-ffc0-431f-9d41-bb18537eff9e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.088075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5793bd7b-c38e-4750-937e-6b1e29d43b12 req-735dd687-ffc0-431f-9d41-bb18537eff9e service nova] Creating event network-changed:5fceff8c-349f-449f-affd-fa4876c4f5d7 for instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 on nch1-master-1 Apr 09 20:55:31.088905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5793bd7b-c38e-4750-937e-6b1e29d43b12 req-735dd687-ffc0-431f-9d41-bb18537eff9e service nova] Acquired lock "compute-rpcapi-router" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:55:31.090592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.091204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.092231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.092866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.110961 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.rpcapi [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 09 20:55:31.112837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] Releasing lock "compute-rpcapi-router" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:55:31.171151 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87efcad4-4777-4532-9bbe-9d770901ffb3 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139272 Apr 09 20:55:31.171909 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 59/160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:31.191290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:31.192030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:31.210579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.215326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.216681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.217225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.323932 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c76b995-ef2f-4c95-a10a-e4d4cea9039b tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.066885 Apr 09 20:55:31.326224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 102/161] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 20:55:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:31.348813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4de62f67-f41b-4157-82c9-df7938dde4e4 tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] Action: 'create', calling method: .version_select at 0x7fb08f644f70>, body: {"security_group": {"name": "tempest-securitygroup-763071604", "description": "tempest-description-225595739"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:31.415798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:31.430418 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-338291e2-5220-4d5a-97cc-0e7d84bfbe1f tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.256874 Apr 09 20:55:31.433004 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 60/162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:31 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:31.587072 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4de62f67-f41b-4157-82c9-df7938dde4e4 tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.248186 Apr 09 20:55:31.587806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 103/163] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 20:55:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:31.618342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:31.619311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:31.630265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.634179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.636110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:31.637533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:31.930965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:31.946751 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7105054-3948-42d2-bb4f-bc0c9bfee500 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.334990 Apr 09 20:55:31.947880 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 104/164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:31 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:31.952566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fab6e3bb-6482-4787-96a8-e6d9814cdfff tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] Action: 'create', calling method: .version_select at 0x7fb08f7b14c0>, body: {"security_group": {"name": "tempest-securitygroup-910231789", "description": "tempest-description-212171429"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:32.158842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1168178800", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:32.242092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:32.334952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fab6e3bb-6482-4787-96a8-e6d9814cdfff tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.739862 Apr 09 20:55:32.335780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 61/165] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 20:55:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:32.340814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:32.341690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:32.347943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.348391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.349387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.350007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.574656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:32.575312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:32.575865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:32.576887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:32.577376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:32.586837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.587409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.588622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.590185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.599461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:32.612316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Getting quotas for project 5fc90b2020ab417e8b6ba2bfb69d6ba5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:32.612542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf144cd3-1673-475e-8a9b-2223efaca792 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.275326 Apr 09 20:55:32.613416 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 62/166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:32 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:32.618288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Getting quotas for user 58162fde653b45ed9ca0a2f5e066eea5 and project 5fc90b2020ab417e8b6ba2bfb69d6ba5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:32.636816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:32.641629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:32.708933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5880cde-efe5-4039-ac79-feadaee0a2ab tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758821 Apr 09 20:55:32.718780 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 105/167] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:55:32.728855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2e51443-56ed-46d2-a50e-a2edbeaf5940 tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] Action: 'create', calling method: .version_select at 0x7fb0951d7670>, body: {"security_group": {"name": "tempest-securitygroup-401765640", "description": "tempest-description-1767581639"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:32.765441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6fef9f2b-ca1f-4aa9-b788-fadabf108a90 req-d9bca66e-fcb7-45c1-b964-06f0a56a5073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d467-dacc-4afb-b318-c50a9df98118", "name": "network-vif-plugged", "status": "completed", "tag": "0411e5c5-1a1c-4057-a321-d7244bb102f7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:32.773897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6fef9f2b-ca1f-4aa9-b788-fadabf108a90 req-d9bca66e-fcb7-45c1-b964-06f0a56a5073 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.774558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6fef9f2b-ca1f-4aa9-b788-fadabf108a90 req-d9bca66e-fcb7-45c1-b964-06f0a56a5073 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.787352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6fef9f2b-ca1f-4aa9-b788-fadabf108a90 req-d9bca66e-fcb7-45c1-b964-06f0a56a5073 service nova] Creating event network-vif-plugged:0411e5c5-1a1c-4057-a321-d7244bb102f7 for instance 1b31d467-dacc-4afb-b318-c50a9df98118 on nch1-master-1 Apr 09 20:55:32.793440 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6fef9f2b-ca1f-4aa9-b788-fadabf108a90 req-d9bca66e-fcb7-45c1-b964-06f0a56a5073 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178574 Apr 09 20:55:32.794682 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 63/168] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:32.802929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:32.803883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:32.810500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.811434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:32.812521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:32.813409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:33.046495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:33.060469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-760e139b-5e62-4e03-9d38-c4105110c7ac tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.264079 Apr 09 20:55:33.065423 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 64/169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:32 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:33.078122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-238ebdb1-cb7d-4100-ba49-ab203c3c3efa tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:33.081026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-238ebdb1-cb7d-4100-ba49-ab203c3c3efa tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:33.093482 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2e51443-56ed-46d2-a50e-a2edbeaf5940 tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.373483 Apr 09 20:55:33.095305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 106/170] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 20:55:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:33.100703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:33.101946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:33.112296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:33.113771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:33.114596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:33.116101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:33.180461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-238ebdb1-cb7d-4100-ba49-ab203c3c3efa tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:33.193636 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-238ebdb1-cb7d-4100-ba49-ab203c3c3efa tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1223 microversion: 2.1 time: 0.126106 Apr 09 20:55:33.194565 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 65/171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:33 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:33.208419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68a4303f-978d-4d2b-a04a-6f86a007d7ca tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] Calling method '.version_select at 0x7fb0940e9ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:33.338832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:33.346830 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49765def-0aa8-429a-a5dc-351038f31e1e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.249994 Apr 09 20:55:33.348045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 107/172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:33 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:33.629531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:33.630369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:33.638611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:33.639238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:33.640118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:33.640550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:33.832489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:33.840280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9610c36f-a96f-4b04-81d7-dde9cd9c3ca0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.215554 Apr 09 20:55:33.849825 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 108/173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:33 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:34.023081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-437769580", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6f2c6748-eb93-475b-8e01-8a36bd1222c2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:34.074713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] validate_networks() for [('6f2c6748-eb93-475b-8e01-8a36bd1222c2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:34.713426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68a4303f-978d-4d2b-a04a-6f86a007d7ca tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8308 microversion: 2.1 time: 1.516983 Apr 09 20:55:34.713953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 66/174] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 20:55:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8308 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:34.719358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:34.719940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:34.727768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.728231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.729193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.729823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.730451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:34.731040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:34.732098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:34.732763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:34.733626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:34.744313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.744756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.745715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.746342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.764786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:34.769656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for user 9c775742dfc04cec8559f9e4d13239b0 and project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:34.781895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:34.785339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:34.836024 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc199ed2-04c0-4cf0-801d-b07d9b1fdb27 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.864734 Apr 09 20:55:34.836958 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 109/175] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 09 20:55:34.841979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:34.842608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:34.848783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.849271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.850041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.850470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.901751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:34.909732 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c31263fc-51b0-441b-9fb1-61c9dc4cd237 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1338 microversion: 2.1 time: 0.194389 Apr 09 20:55:34.919092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 67/176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:34 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:34.919092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:34.919092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:34.922571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.923386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:34.924181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:34.924616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:35.069565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.083152 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fac91c0-d5fe-4cc4-95d3-5c5da6cc2bc9 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1275 microversion: 2.1 time: 0.244761 Apr 09 20:55:35.084072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 110/177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:34 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:35.088944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f20c612e-2744-4c81-b1cd-ac3d12408b0f tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] Calling method '.version_select at 0x7fb08f6f8ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.240141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.250075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d1bebfb-0106-41a8-b480-1cf806f1c9c5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.338681 Apr 09 20:55:35.250983 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 68/178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:34 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:35.256151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.257219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:35.330881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.338817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.340519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.341986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8fbb5c9a-d8a6-4888-8425-3f523d7523b7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1261 microversion: 2.25 time: 0.089831 Apr 09 20:55:35.343026 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 69/179] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:35 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:35.347691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.348453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:35.354674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:35.355122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:35.355911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:35.356325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:35.460639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f20c612e-2744-4c81-b1cd-ac3d12408b0f tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.374820 Apr 09 20:55:35.461706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 111/180] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 20:55:35 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:35.473726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf52c8ca-8a3d-42f9-b7c2-3669725664bd tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] Calling method '.version_select at 0x7fb0940909d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.563592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:35.571542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b0b5184-c052-4169-8c12-e17bc0abe4ad tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.227245 Apr 09 20:55:35.572422 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 70/181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:35 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:35.716162 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf52c8ca-8a3d-42f9-b7c2-3669725664bd tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3816d3e0-430e-4c2e-ab21-a9fc5d24b427" status: 202 len: 0 microversion: 2.1 time: 0.246320 Apr 09 20:55:35.726225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 112/182] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:55:35 2022] DELETE /compute/v2.1/os-security-groups/3816d3e0-430e-4c2e-ab21-a9fc5d24b427 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 20:55:35.728302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a721c621-84fd-490f-835c-67b40361db44 tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] Calling method '.version_select at 0x7fb08f74c430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.900433 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a721c621-84fd-490f-835c-67b40361db44 tempest-SecurityGroupsTestAdminJSON-1278020297 tempest-SecurityGroupsTestAdminJSON-1278020297-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/93e3b5a4-a0ff-4b67-b0fc-48d8378b0c58" status: 202 len: 0 microversion: 2.1 time: 0.177047 Apr 09 20:55:35.910318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a71df552-8aee-4011-8811-2599980f1475 tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] Calling method '.version_select at 0x7fb08f644160>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.921092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 71/183] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:55:35 2022] DELETE /compute/v2.1/os-security-groups/93e3b5a4-a0ff-4b67-b0fc-48d8378b0c58 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:35.926529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:35.927471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:35.936718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:35.937502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:35.938488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:35.939138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.183661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.203821 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b29cd70f-c16b-4351-b726-db6dc797c46b tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1488 microversion: 2.1 time: 0.281002 Apr 09 20:55:36.207330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 72/184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:35 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1488 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:36.219120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.220114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:36.236051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.236869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.237913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.238553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.283306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a71df552-8aee-4011-8811-2599980f1475 tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4da65d92-962e-4865-a382-cd14303568a2" status: 202 len: 0 microversion: 2.1 time: 0.376995 Apr 09 20:55:36.283975 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 113/185] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:55:35 2022] DELETE /compute/v2.1/os-security-groups/4da65d92-962e-4865-a382-cd14303568a2 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:36.288735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.294249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:36.318108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.321583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.322584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.323176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.560298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.568641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-774103e1-a5cb-4f01-92af-bbea6b3baa52 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.359954 Apr 09 20:55:36.569285 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 73/186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:36 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:36.574175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.574787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:36.580980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.581803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.582743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.583223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.767979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b45713cb-c9d6-41b6-aa1d-ed560c016628 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1639 microversion: 2.1 time: 0.482724 Apr 09 20:55:36.770325 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 114/187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:36 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1639 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:36.776540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f6aa7db-9150-4ff5-9e05-fa3664f1207f tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] Calling method '.version_select at 0x7fb08f6449d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.807982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.820664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da7f9d6e-4da1-4b0c-b61f-0fff7363901f tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.248779 Apr 09 20:55:36.823179 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 74/188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:36 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:36.829118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.829731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:36.844441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.845420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.846209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.846637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.937390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.948680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.950429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:36.951653 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4cde0e5b-4aa2-4f90-b5ba-851b0995bf7c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1341 microversion: 2.25 time: 0.127297 Apr 09 20:55:36.952583 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 75/189] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:36 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1341 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:36.957882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:36.958303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:36.964320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.965022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:36.965857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:36.966343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.043923 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f6aa7db-9150-4ff5-9e05-fa3664f1207f tempest-SecurityGroupsTestAdminJSON-1411527335 tempest-SecurityGroupsTestAdminJSON-1411527335-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c6b3fa7a-b859-4bbb-849f-635ae59236f2" status: 202 len: 0 microversion: 2.1 time: 0.272282 Apr 09 20:55:37.044562 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 115/190] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:55:36 2022] DELETE /compute/v2.1/os-security-groups/c6b3fa7a-b859-4bbb-849f-635ae59236f2 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:37.055425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:37.055926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:37.071151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.074926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.078738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.079417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.144937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:55:37.221119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:37.238809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-23c6ace2-53c7-4b56-b7c6-bf2aa53e0da1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.284560 Apr 09 20:55:37.240996 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 76/191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:36 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:37.369953 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7992dce6-e699-4ef5-811b-aa5410a36e74 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 204 len: 0 microversion: 2.1 time: 0.324041 Apr 09 20:55:37.371499 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 116/192] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:37 2022] DELETE /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:55:37.380964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:37.381610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:37.389155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.391944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.393423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.394017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.444195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b0cce1c1-a439-4ac6-b7b0-adef294bac94 req-a5a304f2-b5e5-4743-be98-97637fae8992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eaef15a-5756-47f4-8e9d-879861e77ada", "tag": "dfee8680-3642-4a06-b77e-904d4daa6e7e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:37.458060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b0cce1c1-a439-4ac6-b7b0-adef294bac94 req-a5a304f2-b5e5-4743-be98-97637fae8992 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.458499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b0cce1c1-a439-4ac6-b7b0-adef294bac94 req-a5a304f2-b5e5-4743-be98-97637fae8992 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.482043 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b0cce1c1-a439-4ac6-b7b0-adef294bac94 req-a5a304f2-b5e5-4743-be98-97637fae8992 service nova] Creating event network-changed:dfee8680-3642-4a06-b77e-904d4daa6e7e for instance 5eaef15a-5756-47f4-8e9d-879861e77ada on nch2-master-1 Apr 09 20:55:37.492737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b0cce1c1-a439-4ac6-b7b0-adef294bac94 req-a5a304f2-b5e5-4743-be98-97637fae8992 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057971 Apr 09 20:55:37.498399 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 117/193] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:37.585673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:37.587181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:37.588125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:37.594229 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e0c49f7-e360-48b4-9d9b-1f200c0beec4 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1494 microversion: 2.1 time: 0.218236 Apr 09 20:55:37.594825 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 77/194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:37 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1494 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:37.595795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.596647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.597636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.598232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.803735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:37.818193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5090c32-6a02-419f-9301-05b2d9d1aadc tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.235573 Apr 09 20:55:37.828103 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 118/195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:37 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:37.843935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:37.845290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:37.853830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.854372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.856090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.856590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.922385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f09b5e60-cee8-4369-8f03-01af1bf48274 req-84e66f94-5ef8-4b16-8a96-db2ce1d83a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3765143e-2819-46e6-94ae-6d26f95a5ef4", "name": "network-vif-plugged", "status": "completed", "tag": "5fceff8c-349f-449f-affd-fa4876c4f5d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:37.930553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f09b5e60-cee8-4369-8f03-01af1bf48274 req-84e66f94-5ef8-4b16-8a96-db2ce1d83a4e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.930996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f09b5e60-cee8-4369-8f03-01af1bf48274 req-84e66f94-5ef8-4b16-8a96-db2ce1d83a4e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:37.943057 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f09b5e60-cee8-4369-8f03-01af1bf48274 req-84e66f94-5ef8-4b16-8a96-db2ce1d83a4e service nova] Creating event network-vif-plugged:5fceff8c-349f-449f-affd-fa4876c4f5d7 for instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 on nch1-master-1 Apr 09 20:55:37.948733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f09b5e60-cee8-4369-8f03-01af1bf48274 req-84e66f94-5ef8-4b16-8a96-db2ce1d83a4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Apr 09 20:55:37.949380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 119/196] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:37.974308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:37.975188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:37.986595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:37.987180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.001503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.002828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.068235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.076198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84b73f34-a8b5-4b1f-b144-5cdf9271d7de tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.242108 Apr 09 20:55:38.077114 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 78/197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:37 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:38.158241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.166439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.167939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.169088 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f0f0870-9860-43c1-8673-facc3e7c653a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1383 microversion: 2.25 time: 0.202176 Apr 09 20:55:38.169660 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 120/198] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:37 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1383 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:55:38.256161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:38.256772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:38.262897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.263341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.264289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.264721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.403662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.411276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5428561-42db-4c20-a0ab-71b76ee66f62 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.159000 Apr 09 20:55:38.411833 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 79/199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:38 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:38.611938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:38.612549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:38.623673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.624130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.624895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.625361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.775225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:38.784667 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fe0abd4-922d-48a0-84e3-3ce56559eefa tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1494 microversion: 2.1 time: 0.176475 Apr 09 20:55:38.786008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 121/200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:38 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1494 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:38.837419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:38.838378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:38.844946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.846346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:38.847249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:38.847803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.024698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.033849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0280b92f-c48c-47c9-b25f-b06606821498 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.201607 Apr 09 20:55:39.044181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 80/201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:38 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:39.093025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:39.093661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:39.103369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.103835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.104633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.105094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.187193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:39.187810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:39.194355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.195055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.196008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.196641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.286347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.293751 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f73c3a9-76da-4da1-abad-1889ed9decb0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1412 microversion: 2.1 time: 0.204957 Apr 09 20:55:39.294559 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 122/202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:39 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:39.365143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.376249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.377828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.378957 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d880a4ba-9f46-495d-acf1-ac1f9a668a37 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1383 microversion: 2.25 time: 0.195707 Apr 09 20:55:39.379664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 81/203] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:39 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1383 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:39.427737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:39.428346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:39.434450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.435095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.436321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.436905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.577281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:39.584884 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a7f919f-339f-438d-81b6-1698ae2aa15e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.160975 Apr 09 20:55:39.585743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 123/204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:39 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:39.731382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-52b71e6d-771b-41ef-8673-089801035009 req-1a9f84c0-30bc-410e-b876-9ba7fb61c804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bb8bb5-bfe6-45ed-8c3e-31e7d4719680", "tag": "c8cc001c-614d-4bb1-934a-dd12049b69f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:39.741601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-52b71e6d-771b-41ef-8673-089801035009 req-1a9f84c0-30bc-410e-b876-9ba7fb61c804 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.742265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-52b71e6d-771b-41ef-8673-089801035009 req-1a9f84c0-30bc-410e-b876-9ba7fb61c804 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.754561 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-52b71e6d-771b-41ef-8673-089801035009 req-1a9f84c0-30bc-410e-b876-9ba7fb61c804 service nova] Creating event network-changed:c8cc001c-614d-4bb1-934a-dd12049b69f8 for instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 on nch1-master-1 Apr 09 20:55:39.759968 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-52b71e6d-771b-41ef-8673-089801035009 req-1a9f84c0-30bc-410e-b876-9ba7fb61c804 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034354 Apr 09 20:55:39.760815 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 82/205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:39.802072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:39.802682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:39.808805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.809460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.810411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.810939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:39.975600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-147b87d3-f21b-4b29-ae2b-14818de5ef43 req-5ef0a2e9-c01e-4fb8-ba2d-c2a63e520280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c79f229-9d8b-4e20-b53c-684f5b9afd1f", "name": "network-vif-plugged", "status": "completed", "tag": "f5376796-653d-489e-95db-73d08d90ad01"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:39.986270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-147b87d3-f21b-4b29-ae2b-14818de5ef43 req-5ef0a2e9-c01e-4fb8-ba2d-c2a63e520280 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:39.986713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-147b87d3-f21b-4b29-ae2b-14818de5ef43 req-5ef0a2e9-c01e-4fb8-ba2d-c2a63e520280 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.002286 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-147b87d3-f21b-4b29-ae2b-14818de5ef43 req-5ef0a2e9-c01e-4fb8-ba2d-c2a63e520280 service nova] Creating event network-vif-plugged:f5376796-653d-489e-95db-73d08d90ad01 for instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f on nch2-master-1 Apr 09 20:55:40.007938 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-147b87d3-f21b-4b29-ae2b-14818de5ef43 req-5ef0a2e9-c01e-4fb8-ba2d-c2a63e520280 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040871 Apr 09 20:55:40.009107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 83/206] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:40.033139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b417af048460da3ef7f6250a9b796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d1b7dc90f744f3861133f61e9b773a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.041075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec594650-222c-41df-b552-889db1e8cea5 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 200 len: 1494 microversion: 2.1 time: 0.242945 Apr 09 20:55:40.041668 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 124/207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:39 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:40.053547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:40.054382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:40.064735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.064905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.065870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.066364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.346557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.353358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1343868814", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:40.366562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5761e2d2-2fab-4d91-a7ed-bd8c148290c0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.318426 Apr 09 20:55:40.370863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 84/208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:40 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:40.382177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:40.387749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:40.396077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.396532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.397876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.398463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.430783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:40.626133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.633725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03d54fee-c4a9-45c0-aff9-41dcfabed620 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1611 microversion: 2.1 time: 0.261459 Apr 09 20:55:40.634238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 85/209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:40 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1611 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:40.643447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:40.644177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:40.652097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.652912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.653980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.654623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.711949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:40.712604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:40.713517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:40.713970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:40.714528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:40.738643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.739371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.740613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.741073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.761125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:40.765470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:40.779807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:40.783290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:40.814200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.823001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.824941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:40.826479 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-892e9671-fe86-4ee9-bd19-ba0a24c606c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1383 microversion: 2.25 time: 0.191101 Apr 09 20:55:40.826992 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 86/210] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:40 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1383 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:40.832045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:40.832653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:40.839277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.839735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.840578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.841020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.844797 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97ffcd85-acca-4879-b556-3ec902552dee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683024 Apr 09 20:55:40.848546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 125/211] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:55:40.860033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:40.860033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:40.879441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.879887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:40.885415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:40.886351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.016840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60ba6531-c04d-4470-a085-10e77e759405 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166074 Apr 09 20:55:41.024564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 126/212] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 20:55:40 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:41.031038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-088ab7b1-1082-439a-b46a-a49c31904f08 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.032525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-088ab7b1-1082-439a-b46a-a49c31904f08 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:41.172408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-088ab7b1-1082-439a-b46a-a49c31904f08 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:41.181136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-088ab7b1-1082-439a-b46a-a49c31904f08 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1217 microversion: 2.1 time: 0.155123 Apr 09 20:55:41.193065 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 127/213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:41 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:41.199221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.200649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:41.206762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:41.209859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.210615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.211660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.213916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.218593 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-102f1ab7-4bf5-4a04-992a-16b04ca6354d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.390527 Apr 09 20:55:41.219426 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 87/214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:40 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:41.239992 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] HTTP exception thrown: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. Apr 09 20:55:41.240791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Returning 404 to user: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:41.242250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3bdabec8-5bc2-4b0a-880c-6e7f418d4f89 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 404 len: 111 microversion: 2.1 time: 0.047341 Apr 09 20:55:41.243022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 128/215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:41 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:41.252954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1c21a4f9-25fe-4c59-ad66-9637357e773a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.254486 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.254486 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.264881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c21a4f9-25fe-4c59-ad66-9637357e773a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.265673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c21a4f9-25fe-4c59-ad66-9637357e773a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.394380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.396948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:41.411465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.412485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.413651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.414355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.426152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1c21a4f9-25fe-4c59-ad66-9637357e773a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 300 microversion: 2.1 time: 0.176959 Apr 09 20:55:41.427163 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 88/216] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-aggregates/5/action => generated 300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:41.442451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ab8b838-a234-4c87-ba9f-c32a53b485fc tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.443782 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.443782 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.481788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ab8b838-a234-4c87-ba9f-c32a53b485fc tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.047732 Apr 09 20:55:41.483251 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 89/217] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:41 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:41.503851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8ffa42a-78ce-4338-8a7a-6a29e6bbec66 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1362494158"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.506157 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.506157 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.507553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-f8ffa42a-78ce-4338-8a7a-6a29e6bbec66 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid b56408a9-9104-4f7c-a6cd-0ca3b980dd09 for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:41.542190 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8ffa42a-78ce-4338-8a7a-6a29e6bbec66 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044499 Apr 09 20:55:41.543547 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 90/218] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:41.555100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7da09007-9785-4087-b3f2-3b37db7188dd tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.556763 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.556763 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.566427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da09007-9785-4087-b3f2-3b37db7188dd tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.567242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da09007-9785-4087-b3f2-3b37db7188dd tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.701547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7da09007-9785-4087-b3f2-3b37db7188dd tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.150393 Apr 09 20:55:41.702227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 91/219] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:41.713369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-603d25a7-ea74-492d-b6cd-fcf28d36f7a3 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.714160 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.714160 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.721276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-603d25a7-ea74-492d-b6cd-fcf28d36f7a3 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.012248 Apr 09 20:55:41.721844 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 92/220] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 20:55:41 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:41.731809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ea10dfe-44fc-4e9f-af68-5b577409eb13 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.733095 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.733095 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:41.742400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea10dfe-44fc-4e9f-af68-5b577409eb13 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.742837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea10dfe-44fc-4e9f-af68-5b577409eb13 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.850974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ea10dfe-44fc-4e9f-af68-5b577409eb13 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.122591 Apr 09 20:55:41.851740 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 93/221] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:41.857552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7d5eb3eb-f55c-4fb0-989d-37d7096c9227 req-6bc4cd60-8653-475c-b357-9c92d3d2a03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d467-dacc-4afb-b318-c50a9df98118", "name": "network-vif-deleted", "tag": "0411e5c5-1a1c-4057-a321-d7244bb102f7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.865000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7d5eb3eb-f55c-4fb0-989d-37d7096c9227 req-6bc4cd60-8653-475c-b357-9c92d3d2a03b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.865475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7d5eb3eb-f55c-4fb0-989d-37d7096c9227 req-6bc4cd60-8653-475c-b357-9c92d3d2a03b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.875760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7d5eb3eb-f55c-4fb0-989d-37d7096c9227 req-6bc4cd60-8653-475c-b357-9c92d3d2a03b service nova] Creating event network-vif-deleted:0411e5c5-1a1c-4057-a321-d7244bb102f7 for instance 1b31d467-dacc-4afb-b318-c50a9df98118 on nch1-master-1 Apr 09 20:55:41.880772 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7d5eb3eb-f55c-4fb0-989d-37d7096c9227 req-6bc4cd60-8653-475c-b357-9c92d3d2a03b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028067 Apr 09 20:55:41.882482 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 94/222] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:41.888915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.889615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:41.895939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.896343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.897151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:41.897581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:41.929755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:41.938334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb09b437-79e5-4e64-a34b-be34f3ff565b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.550983 Apr 09 20:55:41.939206 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 129/223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:41 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:41.946384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ea527ef-1a8c-442b-9cb9-cca65eb3330f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:41.947755 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.947755 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:41.969997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ea527ef-1a8c-442b-9cb9-cca65eb3330f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.027062 Apr 09 20:55:41.970596 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 130/224] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:41.980387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-32ea6366-6a41-4325-bbe6-7a1ca74853f7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-980025728"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:41.981765 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:41.981765 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:41.982750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-32ea6366-6a41-4325-bbe6-7a1ca74853f7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 793cf240-e566-4557-ad48-7c52d5dbad31 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:42.007579 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-32ea6366-6a41-4325-bbe6-7a1ca74853f7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030491 Apr 09 20:55:42.008353 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 131/225] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:42.018443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07502d6f-c9f3-4ce8-a28d-3c5b9fe2d2b7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.019695 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.019695 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.028477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07502d6f-c9f3-4ce8-a28d-3c5b9fe2d2b7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.028932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07502d6f-c9f3-4ce8-a28d-3c5b9fe2d2b7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.136019 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07502d6f-c9f3-4ce8-a28d-3c5b9fe2d2b7 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.121057 Apr 09 20:55:42.136622 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 132/226] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.146577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20658dc5-12f1-4f6e-ada3-47ae537038ee tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.147356 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.147356 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.154054 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20658dc5-12f1-4f6e-ada3-47ae537038ee tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.011132 Apr 09 20:55:42.154844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 133/227] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:55:42 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:42.164213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec2376cc-898d-4773-abc3-ba8f0b55e070 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.165478 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.165478 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.173202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec2376cc-898d-4773-abc3-ba8f0b55e070 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.173646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec2376cc-898d-4773-abc3-ba8f0b55e070 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.207817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:42.216845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:42.218631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:42.219911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b708412-277a-4557-a155-ec4ec530c1db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.336881 Apr 09 20:55:42.220472 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 95/228] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:41 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:42.225884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.226878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:42.234127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.235109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.236193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.236848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.286419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec2376cc-898d-4773-abc3-ba8f0b55e070 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.125508 Apr 09 20:55:42.287124 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 134/229] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:42.291889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.292595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:42.299268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.299803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.300859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.301320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.317975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:42.326437 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-446d6d57-9c36-43dc-834a-57dc794bb5a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1269 microversion: 2.1 time: 0.104741 Apr 09 20:55:42.327194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 96/230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:42 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:42.331659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cae5b5c2-310e-49a7-bc5e-0e69361c437c tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.332845 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.332845 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.355312 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cae5b5c2-310e-49a7-bc5e-0e69361c437c tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.026716 Apr 09 20:55:42.355973 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 97/231] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:42 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:42.366924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e064e517-dae3-4bc7-bd18-e8c9ee1b0144 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1185831508"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.368530 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.368530 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.369429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-e064e517-dae3-4bc7-bd18-e8c9ee1b0144 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 30f8e178-59ff-4c50-9bd9-c9e3118d7fce for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:42.392931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e064e517-dae3-4bc7-bd18-e8c9ee1b0144 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.030347 Apr 09 20:55:42.394323 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 98/232] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.404571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-456fb449-6adb-4914-97c9-5a9b5b816c6f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.405947 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.405947 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.414317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-456fb449-6adb-4914-97c9-5a9b5b816c6f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.414806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-456fb449-6adb-4914-97c9-5a9b5b816c6f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.499097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:42.508050 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3621b21-1d1b-4f1d-a637-dfbe3927b74a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1319 microversion: 2.1 time: 0.219661 Apr 09 20:55:42.509659 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 135/233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:42 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:42.548521 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-456fb449-6adb-4914-97c9-5a9b5b816c6f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.148278 Apr 09 20:55:42.549981 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 99/234] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.560777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5904474-c8a8-4f88-9d61-8ceb66dfd667 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.562138 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.562138 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.576143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5904474-c8a8-4f88-9d61-8ceb66dfd667 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.576688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5904474-c8a8-4f88-9d61-8ceb66dfd667 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.690520 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5904474-c8a8-4f88-9d61-8ceb66dfd667 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.134554 Apr 09 20:55:42.691303 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 136/235] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.701824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9a374e1-1760-4ba1-b971-9397d82b1567 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.702717 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.702717 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.727794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9a374e1-1760-4ba1-b971-9397d82b1567 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.029739 Apr 09 20:55:42.733142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 100/236] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 09 20:55:42.741815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a4ad6e4-d7d3-4ede-8aca-1e2107bcf86e tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1425246537"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.743121 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.743121 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.744012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-1a4ad6e4-d7d3-4ede-8aca-1e2107bcf86e tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 6557912f-f560-4378-874e-5507268ac902 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:42.775222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a4ad6e4-d7d3-4ede-8aca-1e2107bcf86e tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037144 Apr 09 20:55:42.777482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 137/237] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.787510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a519b97b-c1ea-4192-abf5-7bbc861b52c4 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.788442 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.788442 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.803908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aad56640-c86b-47fd-86e0-5fc0d3c1a3df tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1944890277"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.806105 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.806105 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.807869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-aad56640-c86b-47fd-86e0-5fc0d3c1a3df tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid d8674bf8-0219-44ba-8502-274a884eab41 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:42.820352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a519b97b-c1ea-4192-abf5-7bbc861b52c4 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.036712 Apr 09 20:55:42.821339 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 101/238] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:42.833245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0188ef48-472d-4677-9aff-5f7fc487652a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.834184 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.834184 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.843389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0188ef48-472d-4677-9aff-5f7fc487652a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Apr 09 20:55:42.843985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0188ef48-472d-4677-9aff-5f7fc487652a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:42.844806 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0188ef48-472d-4677-9aff-5f7fc487652a tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.019841 Apr 09 20:55:42.848529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 102/239] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:42 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:42.854639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aad56640-c86b-47fd-86e0-5fc0d3c1a3df tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062975 Apr 09 20:55:42.855475 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 138/240] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:42.857598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ff9df8b-01e3-4ffb-8863-de018b135cba tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.858369 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.858369 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.871071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17bcdda5-553f-43d1-95cf-58a1584c7d39 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.872917 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.872917 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:42.887983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17bcdda5-553f-43d1-95cf-58a1584c7d39 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:42.888650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17bcdda5-553f-43d1-95cf-58a1584c7d39 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:42.908559 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1ff9df8b-01e3-4ffb-8863-de018b135cba tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Apr 09 20:55:42.909235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ff9df8b-01e3-4ffb-8863-de018b135cba tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:42.910037 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ff9df8b-01e3-4ffb-8863-de018b135cba tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.058577 Apr 09 20:55:42.910966 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 103/241] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:42.923904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-346246bf-c669-493f-b88c-4b130a4588f8 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-97125410", "name": "tempest-test_aggregate-437444674"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:42.948125 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:42.948125 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:42.950039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-346246bf-c669-493f-b88c-4b130a4588f8 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid b5b095b0-9ef0-4ca6-bfb1-d9383ff04a2d for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:42.988784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-346246bf-c669-493f-b88c-4b130a4588f8 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.071396 Apr 09 20:55:42.990103 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 104/242] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:42.995525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:42.996306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:43.003995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.005166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.005800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.006331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.097360 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17bcdda5-553f-43d1-95cf-58a1584c7d39 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.234681 Apr 09 20:55:43.104441 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 139/243] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:43.114833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.118002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:43.135430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.139870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.141132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.141277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.381206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.394134 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf31af23-0349-469f-b040-0a8c5ca7227e tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.402570 Apr 09 20:55:43.394790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 105/244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:42 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:43.399821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a53a872-c1a6-4f1e-b34f-a6f6a3ada7a2 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.400669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.400975 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:43.400975 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:43.409189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb16f8a7-a7d0-45ff-a20e-6e742b17a13a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 200 len: 1589 microversion: 2.1 time: 0.303313 Apr 09 20:55:43.409772 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 140/245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:43 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 1589 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:43.416975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-beef5d9a-f73c-4550-aad8-34b2cc104b9c tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:43.418974 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:43.418974 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:43.420131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-beef5d9a-f73c-4550-aad8-34b2cc104b9c tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a24beaf728454be58cfed6a585166e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132a3cf21adc4ce8a00f6c26761cb996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.421303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-beef5d9a-f73c-4550-aad8-34b2cc104b9c tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:43.422258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-beef5d9a-f73c-4550-aad8-34b2cc104b9c tempest-AggregatesAdminNegativeTestJSON-906695288 tempest-AggregatesAdminNegativeTestJSON-906695288-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.010015 Apr 09 20:55:43.423516 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 141/246] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:43 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:43.430133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.430734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:43.445203 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a53a872-c1a6-4f1e-b34f-a6f6a3ada7a2 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.049095 Apr 09 20:55:43.454202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.454837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.455431 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 106/247] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:43.456652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.457587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.537415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f3257c79-c4f5-4b30-8cb8-e814218c67ba req-60b289b9-da1f-4662-9964-21198b181bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3765143e-2819-46e6-94ae-6d26f95a5ef4", "tag": "5fceff8c-349f-449f-affd-fa4876c4f5d7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:43.555799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f3257c79-c4f5-4b30-8cb8-e814218c67ba req-60b289b9-da1f-4662-9964-21198b181bf8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.556296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f3257c79-c4f5-4b30-8cb8-e814218c67ba req-60b289b9-da1f-4662-9964-21198b181bf8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.570733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f3257c79-c4f5-4b30-8cb8-e814218c67ba req-60b289b9-da1f-4662-9964-21198b181bf8 service nova] Creating event network-changed:5fceff8c-349f-449f-affd-fa4876c4f5d7 for instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 on nch1-master-1 Apr 09 20:55:43.576292 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f3257c79-c4f5-4b30-8cb8-e814218c67ba req-60b289b9-da1f-4662-9964-21198b181bf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119342 Apr 09 20:55:43.577159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 107/248] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:43.584140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.585105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:43.593642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.594432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.595448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.596226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.704993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.718575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.723266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.736523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c00eabc-35b6-4f41-aad7-99c02a704a04 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1275 microversion: 2.1 time: 0.157756 Apr 09 20:55:43.737481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:43.738582 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2bd54a78-f871-48ff-9115-824c029c3068 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.314019 Apr 09 20:55:43.739281 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 108/249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:43 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:43.743599 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 142/250] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:43 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:43.746445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-690551d4-6f3a-4a04-9192-2a407efcf122 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:43.747916 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:43.747916 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:43.757326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-258fcc46-3344-4b2e-ad78-5471d68be87d tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.758098 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:43.758098 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:43.766732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690551d4-6f3a-4a04-9192-2a407efcf122 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.768677 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-258fcc46-3344-4b2e-ad78-5471d68be87d tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Apr 09 20:55:43.769952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-258fcc46-3344-4b2e-ad78-5471d68be87d tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:43.770597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690551d4-6f3a-4a04-9192-2a407efcf122 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.771662 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-258fcc46-3344-4b2e-ad78-5471d68be87d tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027148 Apr 09 20:55:43.775131 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 143/251] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:43 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:43.789999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.791020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:43.802695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.808160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.811424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:43.812072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:43.940650 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-690551d4-6f3a-4a04-9192-2a407efcf122 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.200304 Apr 09 20:55:43.947440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 109/252] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:43 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:43.951374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86a75a8f-7ccb-4b6a-aa8d-a0e5373e3341 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.952150 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:43.952150 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:43.972655 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-86a75a8f-7ccb-4b6a-aa8d-a0e5373e3341 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Apr 09 20:55:43.973687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86a75a8f-7ccb-4b6a-aa8d-a0e5373e3341 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:43.974971 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-86a75a8f-7ccb-4b6a-aa8d-a0e5373e3341 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.032152 Apr 09 20:55:43.975796 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 110/253] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:43.985629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d5b610d-851d-4bb5-94e7-da0a461d76a5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:43.997022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:44.007373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6fdc8de-89e8-4756-8423-60ab868587cd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1469 microversion: 2.1 time: 0.230275 Apr 09 20:55:44.008112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 144/254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:43 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:44.013767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef2dc8e7-35bf-46ed-ba1d-067a5ee80d49 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1304103112"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:44.016501 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.016501 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.017459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-ef2dc8e7-35bf-46ed-ba1d-067a5ee80d49 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 73ba3016-bd8a-48a8-af12-42856be307ba for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:44.029762 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d5b610d-851d-4bb5-94e7-da0a461d76a5 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.052024 Apr 09 20:55:44.031145 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 111/255] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:43 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:44.067925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef2dc8e7-35bf-46ed-ba1d-067a5ee80d49 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058736 Apr 09 20:55:44.069078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 145/256] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.078210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2c4a049-c42f-45a7-84d0-c975f8169e3e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-639716778"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:44.080022 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.080022 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.081234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-c2c4a049-c42f-45a7-84d0-c975f8169e3e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Generated uuid 8b49634a-a686-4e27-a306-7abca022fa01 for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:44.118437 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2c4a049-c42f-45a7-84d0-c975f8169e3e tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048174 Apr 09 20:55:44.119630 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 146/257] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.131083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59a70e8c-d629-4cab-b089-9d375523e649 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.132973 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.132973 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.144939 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59a70e8c-d629-4cab-b089-9d375523e649 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.023036 Apr 09 20:55:44.145785 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 147/258] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.154741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f713040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.156231 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.156231 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.157796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.158428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.159440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.160096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.186778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7bed47b-df30-413f-a567-e8cce9cc2e8d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.039548 Apr 09 20:55:44.187486 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 148/259] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.192768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:44.194224 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.194224 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.194682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.195027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:44.203049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.203731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.204087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.204538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.205786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.206315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.210489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.211140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.240216 ncdv-master-1 devstack@n-api.service[141818]: ERROR nova.api.openstack.compute.aggregates [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Apr 09 20:55:44.240916 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Apr 09 20:55:44.244311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:44.245304 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8cedd491-626f-4cb8-852a-d909945843ff tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.056598 Apr 09 20:55:44.246161 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 149/260] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:44 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:55:44.254864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c7c052b-5b86-4498-ba89-1e8e15c236bf tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:44.256348 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.256348 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.287554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:55:44.298219 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c7c052b-5b86-4498-ba89-1e8e15c236bf tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.047047 Apr 09 20:55:44.298841 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 150/261] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 20:55:44 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.310718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f4508b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.313974 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.313974 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.315229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.323771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.325182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.326078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.358141 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-916bd50a-440a-4ef0-8f4d-4433e3dfd32d tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.051532 Apr 09 20:55:44.359665 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 151/262] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.374039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d744319-835b-4702-a43a-d20e15eeb3c8 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.378309 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.378309 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.415030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d744319-835b-4702-a43a-d20e15eeb3c8 tempest-AggregatesAdminNegativeTestJSON-604369035 tempest-AggregatesAdminNegativeTestJSON-604369035-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053845 Apr 09 20:55:44.416490 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 152/263] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:44 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:44.429256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-28b63ffe-5aff-4a27-891a-8089c17eccf6 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.430085 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.430085 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.460554 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-28b63ffe-5aff-4a27-891a-8089c17eccf6 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.041876 Apr 09 20:55:44.461206 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 153/264] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.472870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f713c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.474161 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.474161 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.477407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-658ed993-5b74-42b7-afd2-c85cba7985a1 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 204 len: 0 microversion: 2.1 time: 0.444815 Apr 09 20:55:44.478520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.479065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.479782 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 112/265] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:44 2022] DELETE /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:55:44.482932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.483424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.487255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.488510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:44.495980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.496709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.501297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.501809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.536859 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9ddec080-3ef5-4f5b-b4d5-37d58eeb1331 tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.074426 Apr 09 20:55:44.538340 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 154/266] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.545714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2c357a5-232f-4210-9fae-87f446d6f23f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.546792 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.546792 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.592610 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2c357a5-232f-4210-9fae-87f446d6f23f tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.053191 Apr 09 20:55:44.593245 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 155/267] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:44 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:44.605202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.606087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:44.621682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.622451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.623689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.624319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.695348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:44.710374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b35b77c0-7f83-44f4-ab9a-17e02fbf83d4 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.228979 Apr 09 20:55:44.712493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 113/268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:44.720740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f7cf940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.725185 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.725185 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:44.742499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.744012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.774492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.775127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.823285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:44.832873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60cbf653-7f48-402a-a7a5-8fa4d93b8621 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1475 microversion: 2.1 time: 0.237686 Apr 09 20:55:44.834002 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 156/269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1475 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:44.839172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35b55048-a024-4dc3-9a13-6344c54e03e0 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327731280", "availability_zone": "tempest-test_az-753663768"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:44.840891 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:44.840891 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:44.842188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.aggregate [None req-35b55048-a024-4dc3-9a13-6344c54e03e0 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid dedd02a0-c19a-47ed-b490-324205eb0ebe for aggregate {{(pid=141818) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:44.862800 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a74556d-5e58-45c1-b68f-6395e18045ca tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.147991 Apr 09 20:55:44.868202 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 114/270] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.869293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.869915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:44.876834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.877331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.878090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.878523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.888060 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35b55048-a024-4dc3-9a13-6344c54e03e0 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.052619 Apr 09 20:55:44.888956 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 157/271] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Apr 9 20:55:44 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:44.898652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:44.900816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:44.911129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.912253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:44.913977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:44.917404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.126470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:45.127428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:45.134130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7c359fa-0ef6-4b93-9168-86230c3308e2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.268654 Apr 09 20:55:45.136948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:45.138715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:45.139997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-02f33b88-9cab-45a5-8085-d81eae7c91ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.245569 Apr 09 20:55:45.142499 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 158/272] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:45.145804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 115/273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:44 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:45.147993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Calling method '.version_select at 0x7fb08f61d940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.149012 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.149012 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:45.161217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.162455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.172161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6611c45-ce74-4af5-a9e6-4e6b16aaa69b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327731280_new", "availability_zone": "tempest-test_az-753663768_new"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:45.175040 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.175040 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:45.180052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.180558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.218913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1c6b8c8-8a7e-4130-9dd2-af73d57dadbb tempest-HostsAdminTestJSON-550937116 tempest-HostsAdminTestJSON-550937116-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.075229 Apr 09 20:55:45.225795 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 159/274] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.241006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6611c45-ce74-4af5-a9e6-4e6b16aaa69b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.243239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6611c45-ce74-4af5-a9e6-4e6b16aaa69b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.289383 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6611c45-ce74-4af5-a9e6-4e6b16aaa69b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.140803 Apr 09 20:55:45.290271 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 116/275] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 20:55:45 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.301602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd883516-f75c-4a25-84bf-85d4cdde3512 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.302381 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.302381 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:45.309336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd883516-f75c-4a25-84bf-85d4cdde3512 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.012650 Apr 09 20:55:45.314203 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 160/276] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.321696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6018fba1-3a6a-4ae8-9d60-dd6f20f0e5a2 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.323642 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.323642 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:45.363226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-91b5e518-6bdb-4cd2-a833-0d722c62e7c6 req-c2b5a28b-f434-42d3-a407-3aada2a91bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eaef15a-5756-47f4-8e9d-879861e77ada", "name": "network-vif-plugged", "status": "completed", "tag": "dfee8680-3642-4a06-b77e-904d4daa6e7e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:45.377083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-91b5e518-6bdb-4cd2-a833-0d722c62e7c6 req-c2b5a28b-f434-42d3-a407-3aada2a91bac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.377757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-91b5e518-6bdb-4cd2-a833-0d722c62e7c6 req-c2b5a28b-f434-42d3-a407-3aada2a91bac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.387788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6018fba1-3a6a-4ae8-9d60-dd6f20f0e5a2 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.069687 Apr 09 20:55:45.390662 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 117/277] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:45 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:45.399502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1d9bd6a-ba9b-4ca4-a7e8-0554e8504627 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1734844970"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:45.405195 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.405195 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:45.406274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-c1d9bd6a-ba9b-4ca4-a7e8-0554e8504627 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Generated uuid 6e2360d5-0dda-49e0-b0ba-d66e3214f6c8 for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 20:55:45.409639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-91b5e518-6bdb-4cd2-a833-0d722c62e7c6 req-c2b5a28b-f434-42d3-a407-3aada2a91bac service nova] Creating event network-vif-plugged:dfee8680-3642-4a06-b77e-904d4daa6e7e for instance 5eaef15a-5756-47f4-8e9d-879861e77ada on nch2-master-1 Apr 09 20:55:45.426996 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-91b5e518-6bdb-4cd2-a833-0d722c62e7c6 req-c2b5a28b-f434-42d3-a407-3aada2a91bac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065469 Apr 09 20:55:45.432894 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 161/278] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.460115 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1d9bd6a-ba9b-4ca4-a7e8-0554e8504627 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064440 Apr 09 20:55:45.461208 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 118/279] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 20:55:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:45.473129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7531088e-e077-4c02-b20a-73bc972ccf40 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.474266 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.474266 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:45.487693 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7531088e-e077-4c02-b20a-73bc972ccf40 tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.015150 Apr 09 20:55:45.490245 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 162/280] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.503703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18df6921-9295-40b9-944d-cbeb81849a1b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.504488 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:45.504488 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:45.540799 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18df6921-9295-40b9-944d-cbeb81849a1b tempest-AggregatesAdminTestJSON-1053329451 tempest-AggregatesAdminTestJSON-1053329451-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.041894 Apr 09 20:55:45.541597 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 119/281] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:55:45 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 20:55:45.550864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.551469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:45.559524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.560079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.561020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.561580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.581878 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] HTTP exception thrown: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. Apr 09 20:55:45.582547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Returning 404 to user: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:45.583718 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-634718ed-d32b-4f82-b4db-655ea0938c05 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 404 len: 111 microversion: 2.1 time: 0.036896 Apr 09 20:55:45.584656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 163/282] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:45 2022] DELETE /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:45.593292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.594167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] [instance: 1b31d467-dacc-4afb-b318-c50a9df98118] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:45.607960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.608716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.610129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.611519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.647853 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] HTTP exception thrown: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. Apr 09 20:55:45.650149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] Returning 404 to user: Instance 1b31d467-dacc-4afb-b318-c50a9df98118 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:45.652547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5517ddc-72ad-4d6d-8237-40b5ff552433 tempest-AggregatesAdminTestJSON-760849916 tempest-AggregatesAdminTestJSON-760849916-project] 10.222.0.30 "GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118" status: 404 len: 111 microversion: 2.1 time: 0.063805 Apr 09 20:55:45.654392 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 120/283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/servers/1b31d467-dacc-4afb-b318-c50a9df98118 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:45.730128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.730808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:45.749961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.752546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.757544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.759519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.781254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e20d8d62-a2a5-4550-9540-5d66b7fa51e3 req-4c3124c4-6a8e-4c16-8426-03cb6e175deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acad92b7-b70e-44e1-9c3d-2938f626d037", "tag": "ea23a674-89c2-48ea-9d14-9a710c1b9f16"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:45.806845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e20d8d62-a2a5-4550-9540-5d66b7fa51e3 req-4c3124c4-6a8e-4c16-8426-03cb6e175deb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.812920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e20d8d62-a2a5-4550-9540-5d66b7fa51e3 req-4c3124c4-6a8e-4c16-8426-03cb6e175deb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.843311 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e20d8d62-a2a5-4550-9540-5d66b7fa51e3 req-4c3124c4-6a8e-4c16-8426-03cb6e175deb service nova] Creating event network-changed:ea23a674-89c2-48ea-9d14-9a710c1b9f16 for instance acad92b7-b70e-44e1-9c3d-2938f626d037 on nch1-master-1 Apr 09 20:55:45.859028 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e20d8d62-a2a5-4550-9540-5d66b7fa51e3 req-4c3124c4-6a8e-4c16-8426-03cb6e175deb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081537 Apr 09 20:55:45.860347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 121/284] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:45.872319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:45.875186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:45.892675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.895790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:45.897218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:45.905799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:46.260520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.268738 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f25d7f3-e6b3-4bba-9b98-ea1779c9f91b tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1475 microversion: 2.1 time: 0.407017 Apr 09 20:55:46.269387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 122/285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:46.273890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:46.274492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:46.288715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.301011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-630a2eb4-921c-4589-a8a6-e878257dcfc2 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1323 microversion: 2.1 time: 0.573273 Apr 09 20:55:46.301927 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 164/286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:45 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:46.305161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:46.305719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:46.306740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:46.306974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:46.307581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:46.313868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:46.314529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:46.315496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:46.316040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:46.316225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:46.632754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.643447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.646735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.647930 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6f1a21b-7134-4142-b872-439839c91b9b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.345035 Apr 09 20:55:46.648816 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 165/287] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:46 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:46.658305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:46.667328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c912c6ff-7f7b-49d4-a513-192f72449168 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.396801 Apr 09 20:55:46.667879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 123/288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:46 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:47.290469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.291791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.321815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.322562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.327416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.328113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.330524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.331028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.331259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.331755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.332544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.332907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.453833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.465211 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72014ec2-5508-4a77-bbed-04e02f5f1cbd tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 200 len: 1304 microversion: 2.1 time: 0.183670 Apr 09 20:55:47.467743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 166/289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:47.589852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.597416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6801cdd-0edb-4674-8f59-3d00fd3d7af0 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1473 microversion: 2.1 time: 0.281172 Apr 09 20:55:47.598538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 124/290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:47.615288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.616110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.622986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.624099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.625232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.625905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.650636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.651308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:47.652256 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e001b043-832a-4faa-bddd-82a0372ce636 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.040975 Apr 09 20:55:47.652669 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 167/291] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada/diagnostics => generated 117 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:47.665080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.666198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.670411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.671750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.673380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.674021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.675084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.675567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.682019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.682452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.683519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.684102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.706128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:55:47.954921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.955121 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-91a26978-23fb-4069-b7a1-9b2ee1130116 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 204 len: 0 microversion: 2.1 time: 0.295153 Apr 09 20:55:47.956623 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 125/292] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:47 2022] DELETE /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 20:55:47.970614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.972925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.973139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:47.976939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:47.979724 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8f937fd4-1a2c-4a67-9cb6-76b326b726bd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.317613 Apr 09 20:55:47.983650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 168/293] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:55:47.994418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:47.995659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.995659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:47.996616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:47.997242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.013572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:48.033258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.035706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.038045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.039320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.213607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:48.220999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-631fdca1-52a7-4b79-aa03-2a87e5a20128 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.263266 Apr 09 20:55:48.230537 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 126/294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:48.235946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cfaa14e0-5402-4426-96ba-807652abf36d req-cb7aa7b3-6843-4fb1-a9eb-f7b6eb2802a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c79f229-9d8b-4e20-b53c-684f5b9afd1f", "name": "network-vif-deleted", "tag": "f5376796-653d-489e-95db-73d08d90ad01"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:48.250512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cfaa14e0-5402-4426-96ba-807652abf36d req-cb7aa7b3-6843-4fb1-a9eb-f7b6eb2802a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.251084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cfaa14e0-5402-4426-96ba-807652abf36d req-cb7aa7b3-6843-4fb1-a9eb-f7b6eb2802a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.285839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cfaa14e0-5402-4426-96ba-807652abf36d req-cb7aa7b3-6843-4fb1-a9eb-f7b6eb2802a9 service nova] Creating event network-vif-deleted:f5376796-653d-489e-95db-73d08d90ad01 for instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f on nch2-master-1 Apr 09 20:55:48.291668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cfaa14e0-5402-4426-96ba-807652abf36d req-cb7aa7b3-6843-4fb1-a9eb-f7b6eb2802a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059811 Apr 09 20:55:48.293095 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 127/295] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:48.299553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9961c832-d0c8-4c75-9fab-7830b6825ae6 req-84ff970c-6b87-46af-bc3e-779aee4958cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bb8bb5-bfe6-45ed-8c3e-31e7d4719680", "name": "network-vif-plugged", "status": "completed", "tag": "c8cc001c-614d-4bb1-934a-dd12049b69f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:48.308870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9961c832-d0c8-4c75-9fab-7830b6825ae6 req-84ff970c-6b87-46af-bc3e-779aee4958cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.309423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9961c832-d0c8-4c75-9fab-7830b6825ae6 req-84ff970c-6b87-46af-bc3e-779aee4958cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.322953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9961c832-d0c8-4c75-9fab-7830b6825ae6 req-84ff970c-6b87-46af-bc3e-779aee4958cd service nova] Creating event network-vif-plugged:c8cc001c-614d-4bb1-934a-dd12049b69f8 for instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 on nch1-master-1 Apr 09 20:55:48.328627 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9961c832-d0c8-4c75-9fab-7830b6825ae6 req-84ff970c-6b87-46af-bc3e-779aee4958cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034071 Apr 09 20:55:48.329542 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 128/296] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:48.331750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:48.352396 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-74bf0d26-5cf7-4c67-be54-6fee8c99cc1b tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1479 microversion: 2.1 time: 0.367450 Apr 09 20:55:48.364532 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 169/297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:47 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1479 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:48.484048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:48.485339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:48.506408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.507443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.508459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:48.509029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:48.538260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. Apr 09 20:55:48.539179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:48.540301 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b093a6f3-7e4c-4169-97ac-42068200230a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 404 len: 111 microversion: 2.1 time: 0.060653 Apr 09 20:55:48.541368 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 129/298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:48 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:48.766466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1956413513", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:48.823435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:49.000185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:49.000912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:49.006922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.007640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.008769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.009456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.057915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:49.062184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:49.062906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:49.063417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:49.063833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:49.073824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.074359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.075162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.075592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.095313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Getting quotas for project 10c5c17262b94d898c4aaa03102b4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:49.099705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Getting quotas for user 111ebd03dde445c99b447894d3ad03e7 and project 10c5c17262b94d898c4aaa03102b4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:49.116952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:49.119274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:49.183910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a599169d-27cc-4103-9ca9-b0a2e3d7145d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421337 Apr 09 20:55:49.187528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.189472 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 170/299] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:55:49.202434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae9ae64e-0da6-4ba9-a862-5f7c7ff577b7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:49.203147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae9ae64e-0da6-4ba9-a862-5f7c7ff577b7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:49.214801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.231282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.233146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ad71fd2-e63a-41bc-8f6d-da9c2c222846 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1361 microversion: 2.25 time: 0.237181 Apr 09 20:55:49.239903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 130/300] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:48 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:55:49.244661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:49.249798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:49.258423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.264296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.265706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.266291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.275408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae9ae64e-0da6-4ba9-a862-5f7c7ff577b7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.282984 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae9ae64e-0da6-4ba9-a862-5f7c7ff577b7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1220 microversion: 2.1 time: 0.087732 Apr 09 20:55:49.284829 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 171/301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:49 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:49.371636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:49.372604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:49.379709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.380407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.381688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:49.384064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:49.587791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.612935 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc41703a-e4fc-4bda-8000-5ca6d66b48d4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.371897 Apr 09 20:55:49.630635 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 131/302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:49 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:49.767723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:49.775532 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a55d22bd-8e23-463e-8e6a-2558328ec08a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1479 microversion: 2.1 time: 0.408583 Apr 09 20:55:49.776963 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 172/303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:49 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1479 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:50.258969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.259828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:50.271107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.271642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.272826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.273350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.404730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5610be94-6644-496a-aba8-216abf34c9a5 tempest-AZAdminNegativeTestJSON-1454136120 tempest-AZAdminNegativeTestJSON-1454136120-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.405742 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:50.405742 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:50.406827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5610be94-6644-496a-aba8-216abf34c9a5 tempest-AZAdminNegativeTestJSON-1454136120 tempest-AZAdminNegativeTestJSON-1454136120-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '4b5944d7fb154068b102bbe1ba914d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fdacb13c2b449581a193ace4bc6a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.407873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5610be94-6644-496a-aba8-216abf34c9a5 tempest-AZAdminNegativeTestJSON-1454136120 tempest-AZAdminNegativeTestJSON-1454136120-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:50.409786 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5610be94-6644-496a-aba8-216abf34c9a5 tempest-AZAdminNegativeTestJSON-1454136120 tempest-AZAdminNegativeTestJSON-1454136120-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.384566 Apr 09 20:55:50.412622 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 132/304] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:50.446289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.453304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:50.490382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.490984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.495722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.500420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.544323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.558198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.561162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.565126 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-715cdd8d-a50c-4cd8-8727-0034272b2f8e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1557 microversion: 2.25 time: 0.311549 Apr 09 20:55:50.566919 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 173/305] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1557 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:50.581446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-16b0fe23-169d-4b41-be93-d4d517f1047f req-367af105-a591-4f9d-8f6b-3ebfb00365c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eaef15a-5756-47f4-8e9d-879861e77ada", "name": "network-vif-deleted", "tag": "dfee8680-3642-4a06-b77e-904d4daa6e7e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:50.608860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-16b0fe23-169d-4b41-be93-d4d517f1047f req-367af105-a591-4f9d-8f6b-3ebfb00365c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.610104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-16b0fe23-169d-4b41-be93-d4d517f1047f req-367af105-a591-4f9d-8f6b-3ebfb00365c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.623006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.630834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-16b0fe23-169d-4b41-be93-d4d517f1047f req-367af105-a591-4f9d-8f6b-3ebfb00365c4 service nova] Creating event network-vif-deleted:dfee8680-3642-4a06-b77e-904d4daa6e7e for instance 5eaef15a-5756-47f4-8e9d-879861e77ada on nch2-master-1 Apr 09 20:55:50.631136 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ffd407d7-2468-4d1e-a712-d803d20c1f43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1272 microversion: 2.1 time: 0.215971 Apr 09 20:55:50.631723 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 133/306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:50.647081 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-16b0fe23-169d-4b41-be93-d4d517f1047f req-367af105-a591-4f9d-8f6b-3ebfb00365c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073412 Apr 09 20:55:50.647732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 174/307] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:50.654050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.655230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:50.663277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.663936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.664929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.665592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.821608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:50.830395 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c707c8ff-0063-47da-b30f-a03531581a20 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.180406 Apr 09 20:55:50.845344 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 175/308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:50.852319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.853245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:50.859128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.859923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.860689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.861153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.921826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:50.922424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:50.930026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.930465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.930925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lazy-loading 'fault' on Instance uuid 5eaef15a-5756-47f4-8e9d-879861e77ada {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:55:50.932925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.936239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:50.938281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:50.939671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.147777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58162fde653b45ed9ca0a2f5e066eea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc90b2020ab417e8b6ba2bfb69d6ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:51.156226 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c73d74b-1e3a-4df6-a06c-ec5ce4385b7a tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 200 len: 1313 microversion: 2.1 time: 0.309325 Apr 09 20:55:51.156721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 176/309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:51.315663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:55:51.372736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ca6d93a-3c89-4d41-b237-f80c905e2d38 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 2049 microversion: 2.25 time: 0.738672 Apr 09 20:55:51.373669 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 134/310] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:50 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 2049 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:51.390678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:51.391977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:51.398239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.398964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.400053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.400726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.561090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:55:51.625709 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2859f2a5-b8ba-4955-bc53-db2b3e009670 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 2049 microversion: 2.25 time: 0.238424 Apr 09 20:55:51.629293 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 177/311] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:51 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 2049 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:51.644676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:51.646065 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:51.646065 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:51.648025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.648487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.649495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.651041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.662591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:51.663706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:51.681235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.682054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.683024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.683601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.706620 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af6b9909-57e4-4c25-a6e7-37bc5a217aa7 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.065635 Apr 09 20:55:51.714043 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 135/312] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Apr 9 20:55:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:55:51.777874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:51.785835 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-127824b7-a8b2-4737-a215-10baf213ffce tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1278 microversion: 2.1 time: 0.134122 Apr 09 20:55:51.786782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 178/313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:51 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:51.792331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:51.793558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:51.800414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.800606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.801776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.802505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:51.919877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'flavor' on Instance uuid 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:55:51.948941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb0940e9ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:51.950065 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:51.950065 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:51.952372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:51.955154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.018411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.020641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.025580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Going to try to live migrate instance to nch2-master-1 {{(pid=141818) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 20:55:52.041248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.041939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.050517 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa28d98b-7292-4c8e-b545-611d73ede937 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.340426 Apr 09 20:55:52.054988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 136/314] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:52.065675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.072365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:52.084218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.084702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.085502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.085939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.386250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:52.396781 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ac77c71-0a09-4f5c-895b-7117777639ae tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.340378 Apr 09 20:55:52.400320 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 137/315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:52.405745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ccceb233-1ab5-4db1-ac7c-c580c60256a8 req-c56554a6-bd3c-4a25-8e7f-f1980fbf5a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acad92b7-b70e-44e1-9c3d-2938f626d037", "name": "network-vif-plugged", "status": "completed", "tag": "ea23a674-89c2-48ea-9d14-9a710c1b9f16"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:52.414335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ccceb233-1ab5-4db1-ac7c-c580c60256a8 req-c56554a6-bd3c-4a25-8e7f-f1980fbf5a70 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.414924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ccceb233-1ab5-4db1-ac7c-c580c60256a8 req-c56554a6-bd3c-4a25-8e7f-f1980fbf5a70 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.428499 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ccceb233-1ab5-4db1-ac7c-c580c60256a8 req-c56554a6-bd3c-4a25-8e7f-f1980fbf5a70 service nova] Creating event network-vif-plugged:ea23a674-89c2-48ea-9d14-9a710c1b9f16 for instance acad92b7-b70e-44e1-9c3d-2938f626d037 on nch1-master-1 Apr 09 20:55:52.433781 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ccceb233-1ab5-4db1-ac7c-c580c60256a8 req-c56554a6-bd3c-4a25-8e7f-f1980fbf5a70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Apr 09 20:55:52.441489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 138/316] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:52.448928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f708b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.450370 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:52.450370 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:52.452015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.466432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.497913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.507082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.522093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.530895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.547281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-240952e1-1633-4f4f-bfc9-9e60556f2c3b tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.104176 Apr 09 20:55:52.548270 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 139/317] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:52.571860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.572686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] [instance: 5eaef15a-5756-47f4-8e9d-879861e77ada] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:52.586950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.587397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.588190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.588628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.617028 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] HTTP exception thrown: Instance 5eaef15a-5756-47f4-8e9d-879861e77ada could not be found. Apr 09 20:55:52.617441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] Returning 404 to user: Instance 5eaef15a-5756-47f4-8e9d-879861e77ada could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:55:52.618367 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e47f80aa-8e76-4504-9fd9-c62f8e94ad28 tempest-ServerDiagnosticsNegativeTest-1409142197 tempest-ServerDiagnosticsNegativeTest-1409142197-project] 10.222.0.30 "GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada" status: 404 len: 111 microversion: 2.1 time: 0.069143 Apr 09 20:55:52.619443 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 140/318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/servers/5eaef15a-5756-47f4-8e9d-879861e77ada => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:55:52.627151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f50cb80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.628593 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:52.628593 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:52.630371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.630959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.649266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.650452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.664684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.665590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.673927 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b1beba67-6f00-4b64-a5ac-2239c5756e01 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053297 Apr 09 20:55:52.681204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 141/319] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:52.691600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f50c8b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.693622 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:52.693622 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:52.695213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.695921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.720213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.721120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.740760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1389525e-36a2-43ba-888e-5647ecbf4e3d tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.058119 Apr 09 20:55:52.744290 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 142/320] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:52.766537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a100cf6-206a-4084-89a6-0933c73b66f7 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f50cca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.769732 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:52.769732 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:52.774208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a100cf6-206a-4084-89a6-0933c73b66f7 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.775393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a100cf6-206a-4084-89a6-0933c73b66f7 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.805562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a100cf6-206a-4084-89a6-0933c73b66f7 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.051828 Apr 09 20:55:52.808949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 143/321] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:52.815546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:52.816506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:52.827937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.828532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:52.829466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:52.830277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.048250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:53.061062 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-067f31b2-a3e4-48cb-af31-8daa2f12e209 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.250652 Apr 09 20:55:53.063104 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 144/322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:52 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:53.068909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f7b19d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:53.070705 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:53.070705 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:53.072732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.073377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.091854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.092703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.108159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.109701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.118487 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e5d3b0d-978f-4606-97cc-0b42ea614a59 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053198 Apr 09 20:55:53.119454 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 145/323] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:53.129730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f5aa670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:53.131188 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:53.131188 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:53.133528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.134155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.149731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.152191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.161967 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69c6432f-4c51-43b4-bd87-00cb06c19995 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.037125 Apr 09 20:55:53.163527 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 146/324] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:53.178685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f74cf70>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:53.179729 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:53.179729 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:53.181519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.182289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.200154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.200900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.208852 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f9ce91b-6e38-4315-a533-8da0b5e601fe tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.034575 Apr 09 20:55:53.210118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 147/325] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:55:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:53.224754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Calling method '.version_select at 0x7fb08f7b1040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:53.225823 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:53.225823 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:53.229762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.231052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.249271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.249855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.266446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.267829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.404748 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6fc10d7-7380-4b7c-affe-0f63bfca6f10 tempest-HypervisorAdminTestJSON-65804380 tempest-HypervisorAdminTestJSON-65804380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.185627 Apr 09 20:55:53.412554 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 148/326] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Apr 9 20:55:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:53.421176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-0ffc6c3e-9f37-44a7-9e5a-22c4702e92a0 req-11d8e1d9-c832-49fa-b67f-397510737f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41785a40-a163-4455-8ee5-1353161f2c3b", "tag": "969f5337-7c13-4c26-82e0-4f6bfc05cdf0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:53.442713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0ffc6c3e-9f37-44a7-9e5a-22c4702e92a0 req-11d8e1d9-c832-49fa-b67f-397510737f2b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.444736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0ffc6c3e-9f37-44a7-9e5a-22c4702e92a0 req-11d8e1d9-c832-49fa-b67f-397510737f2b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.475242 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-0ffc6c3e-9f37-44a7-9e5a-22c4702e92a0 req-11d8e1d9-c832-49fa-b67f-397510737f2b service nova] Creating event network-changed:969f5337-7c13-4c26-82e0-4f6bfc05cdf0 for instance 41785a40-a163-4455-8ee5-1353161f2c3b on nch2-master-1 Apr 09 20:55:53.481578 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-0ffc6c3e-9f37-44a7-9e5a-22c4702e92a0 req-11d8e1d9-c832-49fa-b67f-397510737f2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067320 Apr 09 20:55:53.483007 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 149/327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:53.492993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:53.498097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:53.508508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.508960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.512155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:53.512623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:53.765556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:53.774670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-807d0a98-e319-4d08-a8ec-f89f3b9ec60e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1317 microversion: 2.1 time: 0.290309 Apr 09 20:55:53.776311 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 150/328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:53 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:54.084981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:54.090437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:54.103732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:54.104483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:54.105694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:54.106278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:54.298980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:54.311089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-60dfd25a-29da-4e56-b7ac-e9d19be54069 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.235276 Apr 09 20:55:54.312377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 151/329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:54 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:54.793209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:54.794795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:54.802814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:54.803855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:54.804819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:54.805566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.009474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:55.017951 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd4d5b8e-b567-4ff1-a9f4-5417debfa9f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1467 microversion: 2.1 time: 0.230074 Apr 09 20:55:55.018531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 152/330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:54 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:55.509683 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23eacaf5-9cbe-4bc1-8e7f-e28ac769792b tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680/action" status: 202 len: 0 microversion: 2.25 time: 3.721580 Apr 09 20:55:55.510948 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 179/331] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 20:55:51 2022] POST /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680/action => generated 0 bytes in 3724 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:55:55.516529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:55.517388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:55.524717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.525428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.526211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.526800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.575694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:55.576504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:55.595178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.602177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.603775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.604455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.726124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:55.734958 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6ab2a15-897c-4595-ad4b-076c4418bcb2 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.222193 Apr 09 20:55:55.744392 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 180/332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:55 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:55.749276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:55.750057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:55.756466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.757182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.758190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:55.758853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:55.971417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:55.995020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:55.996085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e53ae51b-800e-4c38-9838-234ea5433c71 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1618 microversion: 2.1 time: 0.963388 Apr 09 20:55:55.997671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:55.997873 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 153/333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:55 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1618 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:55.998944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29d93aa8-2a38-458b-b5e2-5f842fad1e92 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.253524 Apr 09 20:55:56.012610 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 181/334] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:55 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:56.015004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: .version_select at 0x7fb08f4e0820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1409799504", "policies": ["affinity"]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:56.033832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:56.037962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:56.092087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:56.096197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:56.122766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.111808 Apr 09 20:55:56.123790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 154/335] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 20:55:56 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:55:56.333410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-118285837", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "426161ce-ad7e-4226-af71-00baafd1ea21"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:56.424332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:55:56.654744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:56.655713 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6df9c40f-fd5d-4603-9d75-c8f24e69056a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001316 Apr 09 20:55:56.656054 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 155/336] 10.222.0.30 () {56 vars in 885 bytes} [Sat Apr 9 20:55:56 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 09 20:55:56.757244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:56.759563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:56.777153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:56.778768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:56.779968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:56.783588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.029721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:55:57.030699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:55:57.031342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:55:57.032007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:55:57.032575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:55:57.067378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.067807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.068615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.069422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.089016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:57.096935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:57.110279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 2 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:55:57.113575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:57.115336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:57.122701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-484ae2eb-82dc-4b3d-8238-b82cb5083cd9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.374890 Apr 09 20:55:57.131807 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 156/337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:56 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:57.176743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141818) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 09 20:55:57.197721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:57.202059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:57.257855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:57.262104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:57.283368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=cef417c4-dee0-46c2-a42f-dc721270cc56,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:55:57.343419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:57.353026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:57.409736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:55:57.414380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:55:57.466967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00eadfd7-148f-4fa8-af6e-ab7f7894453f tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1035986162", "id": 348615881, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:57.469354 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:57.469354 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:57.473579 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8f510d2-fcc3-4311-ace8-097fb9ff924a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.143538 Apr 09 20:55:57.475322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 182/338] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 09 20:55:57.486951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:57.487919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:57.495032 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00eadfd7-148f-4fa8-af6e-ab7f7894453f tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.368340 Apr 09 20:55:57.509486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.509486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.509486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.509486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.512059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 157/339] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:57.530299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:57.536301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:57.537563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Searching by: {'deleted': False, 'project_id': 'b21b82d625c249269c02db9bbe700c7c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 20:55:57.564873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.565535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.566955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:57.567607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:57.710690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 20:55:57.820814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e3f13f0-ed01-458b-9b81-6c22e87567dc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.307046 Apr 09 20:55:57.821678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 158/340] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 20:55:57 2022] GET /compute/v2.1/servers => generated 1002 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:57.830906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa50042e-774a-4465-a0c0-d3db6704059a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:57.835153 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:57.835153 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:57.860584 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa50042e-774a-4465-a0c0-d3db6704059a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/348615881" status: 202 len: 0 microversion: 2.1 time: 0.037571 Apr 09 20:55:57.861380 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 159/341] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:55:57 2022] DELETE /compute/v2.1/flavors/348615881 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:57.871521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a6bbae7-7b94-4ff0-9a02-2b83d2db9598 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:57.872182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a6bbae7-7b94-4ff0-9a02-2b83d2db9598 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:58.020607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a6bbae7-7b94-4ff0-9a02-2b83d2db9598 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:58.031509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a6bbae7-7b94-4ff0-9a02-2b83d2db9598 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1218 microversion: 2.1 time: 0.168226 Apr 09 20:55:58.032581 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 160/342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:57 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.049868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:58.054633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc3d0b1e-d527-400b-bc03-25788c93f83b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.061545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:58.062946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:58.064098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f6cb53d-cc94-484d-bb35-f387f094c8f8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.587773 Apr 09 20:55:58.064670 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 183/343] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:57 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:58.101842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dc3d0b1e-d527-400b-bc03-25788c93f83b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.056677 Apr 09 20:55:58.102790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 161/344] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.118944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3af8efa5-1c83-4cc2-a041-174b2d119b65 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-369841217", "id": 1756162036, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:58.121402 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.121402 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:58.141563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.143349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:58.155260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.155994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.159651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.160450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.165476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3af8efa5-1c83-4cc2-a041-174b2d119b65 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.050684 Apr 09 20:55:58.172981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 184/345] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.181360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac4d909d-c126-460f-ad76-6892293cd36b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.233222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac4d909d-c126-460f-ad76-6892293cd36b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.054863 Apr 09 20:55:58.241229 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 185/346] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.262012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5d91756-2440-4bf6-a593-f1af34616e11 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.264079 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.264079 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:58.292868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5d91756-2440-4bf6-a593-f1af34616e11 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1756162036" status: 202 len: 0 microversion: 2.1 time: 0.043219 Apr 09 20:55:58.293953 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 186/347] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:55:58 2022] DELETE /compute/v2.1/flavors/1756162036 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:58.305575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e757f25a-7300-4f8c-b066-5f12da10aee6 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.331024 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e757f25a-7300-4f8c-b066-5f12da10aee6 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028735 Apr 09 20:55:58.332220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 187/348] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.517950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:58.527982 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7d44571-72e1-4d55-a079-b2a70318560d tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.391940 Apr 09 20:55:58.528779 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 162/349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.561058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7e1eaee-9ed0-4f2e-8c13-13548a9bb966 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-64773982", "id": 1369220416, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:58.565488 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.565488 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:58.596244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7e1eaee-9ed0-4f2e-8c13-13548a9bb966 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.045342 Apr 09 20:55:58.602921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 163/350] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:58 2022] POST /compute/v2.1/flavors => generated 427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.608057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c3b8e9ef-df61-4adf-a20a-9dcaa10e9c9b req-1dcacf77-10b1-43ca-9c05-8ab2d88e06c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bb8bb5-bfe6-45ed-8c3e-31e7d4719680", "name": "network-vif-unplugged", "status": "completed", "tag": "c8cc001c-614d-4bb1-934a-dd12049b69f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:58.629837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3b8e9ef-df61-4adf-a20a-9dcaa10e9c9b req-1dcacf77-10b1-43ca-9c05-8ab2d88e06c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.631376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3b8e9ef-df61-4adf-a20a-9dcaa10e9c9b req-1dcacf77-10b1-43ca-9c05-8ab2d88e06c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.647236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c3b8e9ef-df61-4adf-a20a-9dcaa10e9c9b req-1dcacf77-10b1-43ca-9c05-8ab2d88e06c6 service nova] Creating event network-vif-unplugged:c8cc001c-614d-4bb1-934a-dd12049b69f8 for instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 on nch1-master-1 Apr 09 20:55:58.669388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c3b8e9ef-df61-4adf-a20a-9dcaa10e9c9b req-1dcacf77-10b1-43ca-9c05-8ab2d88e06c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064614 Apr 09 20:55:58.670355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 164/351] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.677898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b86921a1-90a0-404b-8bde-feb3a4ee44fc tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.679104 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.679104 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:58.693195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.694604 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.694604 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:58.696140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.696689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.697653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.700260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.718181 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b86921a1-90a0-404b-8bde-feb3a4ee44fc tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1369220416" status: 202 len: 0 microversion: 2.1 time: 0.044856 Apr 09 20:55:58.719354 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 165/352] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:55:58 2022] DELETE /compute/v2.1/flavors/1369220416 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:58.727324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-98fe9d47-df1a-4aa9-b351-87bb9e16afe0 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.743942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08cabb6e-2923-4c74-b267-4fdfbbad0085 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.410285 Apr 09 20:55:58.745081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 188/353] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/os-services => generated 947 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.752535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-98fe9d47-df1a-4aa9-b351-87bb9e16afe0 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028722 Apr 09 20:55:58.764115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.764115 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.764115 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:58.765441 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 166/354] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:58.766740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.769526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.770487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.771568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf763159-faf2-4b9b-828b-2e0cfb49830e tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1152668488", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:58.772112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.773792 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.773792 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:58.792404 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf763159-faf2-4b9b-828b-2e0cfb49830e tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024639 Apr 09 20:55:58.799968 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 167/355] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:58 2022] POST /compute/v2.1/flavors => generated 507 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.806859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9e2ef89-ec25-443a-a684-039943d8536a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.827758 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3607b6e3-eaa8-4539-83a0-07820bc3a8cf tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.074921 Apr 09 20:55:58.830631 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9e2ef89-ec25-443a-a684-039943d8536a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/d80afaa9-2255-4d3e-8b4b-fca2dfa66e98" status: 202 len: 0 microversion: 2.1 time: 0.029505 Apr 09 20:55:58.831292 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 168/356] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:58 2022] DELETE /compute/v2.1/flavors/d80afaa9-2255-4d3e-8b4b-fca2dfa66e98 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:58.839769 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 189/357] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.840302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc7f1e41-10f8-4e56-933e-b341379e4c52 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.855285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.859788 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.859788 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:58.863075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.864082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.865941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.867545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.890992 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc7f1e41-10f8-4e56-933e-b341379e4c52 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.055142 Apr 09 20:55:58.902742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 169/358] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:55:58.915250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6741b002-1ed6-4ecb-9789-a133c501d026 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-894237149", "id": "17a58453-4d5a-4a48-89fa-826ed6afd000", "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:58.924251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-54c551fc-0646-436b-85bb-518c3e7b001b tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.075998 Apr 09 20:55:58.927493 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 190/359] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/os-services => generated 947 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.952294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6741b002-1ed6-4ecb-9789-a133c501d026 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040066 Apr 09 20:55:58.955935 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 170/360] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:58 2022] POST /compute/v2.1/flavors => generated 506 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:58.962512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:58.966018 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:58.966018 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:58.969637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.970092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.971124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:58.971582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:58.996421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6302f332-4b83-494d-bc5b-61fd76474d01 tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038849 Apr 09 20:55:58.997063 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 171/361] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:59.003454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a6065ae-657e-4a3c-99a2-70e1ea452a24 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.004246 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.004246 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:59.027824 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a6065ae-657e-4a3c-99a2-70e1ea452a24 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/17a58453-4d5a-4a48-89fa-826ed6afd000" status: 202 len: 0 microversion: 2.1 time: 0.029125 Apr 09 20:55:59.028463 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 172/362] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:55:58 2022] DELETE /compute/v2.1/flavors/17a58453-4d5a-4a48-89fa-826ed6afd000 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:55:59.043750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.046622 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.046622 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:59.048323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.048651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.049639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.050075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.079617 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f4e80d1-8b0a-4e20-80ec-043045c97e7a tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.047659 Apr 09 20:55:59.086730 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 173/363] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:59.092293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-286fa352-4622-41d3-b6b1-3f681ebe827c tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.118243 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-286fa352-4622-41d3-b6b1-3f681ebe827c tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029151 Apr 09 20:55:59.118919 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 174/364] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:59.123587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.124310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:59.132017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.132958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.133781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.134215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.208944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:59.218414 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-173b558f-23c0-419e-9403-a34d0abbd84b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1270 microversion: 2.1 time: 0.098472 Apr 09 20:55:59.229142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 175/365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:55:59.234510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.235116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:59.241711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.242161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.243318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.243754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.401959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Calling method '.version_select at 0x7fb08f2f1ca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.403818 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.403818 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:59.405466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.406097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.429015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.429761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.477383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.478151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.496096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.496825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.505880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:59.528753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.529553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.533790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:59.537542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:55:59.538476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60c7d32b-278e-4551-8356-220fdb265401 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.609279 Apr 09 20:55:59.542210 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 191/366] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Apr 9 20:55:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:59.547039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.548876 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94199ccb-6591-4dc4-b782-5764fae90006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.318693 Apr 09 20:55:59.549346 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.549346 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:55:59.550955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.551581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.552552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.553177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.565851 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 176/367] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:55:59.581756 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-834799b7-33ad-4258-9063-0a3758eeff5f tempest-ServicesAdminNegativeTestJSON-1517706396 tempest-ServicesAdminNegativeTestJSON-1517706396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038053 Apr 09 20:55:59.582585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ee6e52e-7fa5-4b95-bf1d-6292dd2ff739 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1500682643", "id": 187430697, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:55:59.583290 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 192/368] 10.222.0.30 () {58 vars in 1197 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:55:59.589135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.590041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:55:59.594268 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.594268 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:59.597399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.598071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.599064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.599644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.636198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ee6e52e-7fa5-4b95-bf1d-6292dd2ff739 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.065127 Apr 09 20:55:59.648110 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 177/369] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:55:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:55:59.657550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Calling method '.version_select at 0x7fb08f467b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:55:59.665627 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:55:59.665627 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:55:59.675723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.678753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.707637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.708082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.764910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.765604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.794548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.794999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.850878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:55:59.851427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:55:59.858866 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64153b25-a9c5-47a6-8ba7-38c0d0431949 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.204809 Apr 09 20:55:59.860125 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 178/370] 10.222.0.30 () {60 vars in 1221 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:00.045374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6d1d4b8-05fb-4b41-839b-0f6308c8d488 tempest-ServicesAdminNegativeTestJSON-996481978 tempest-ServicesAdminNegativeTestJSON-996481978-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.046663 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:00.046663 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:00.047773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d6d1d4b8-05fb-4b41-839b-0f6308c8d488 tempest-ServicesAdminNegativeTestJSON-996481978 tempest-ServicesAdminNegativeTestJSON-996481978-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '867c29dbc88042afa976b753757e93a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc0c2bb67804b5683c3ad270d4d6811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:00.048421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6d1d4b8-05fb-4b41-839b-0f6308c8d488 tempest-ServicesAdminNegativeTestJSON-996481978 tempest-ServicesAdminNegativeTestJSON-996481978-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:00.049261 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6d1d4b8-05fb-4b41-839b-0f6308c8d488 tempest-ServicesAdminNegativeTestJSON-996481978 tempest-ServicesAdminNegativeTestJSON-996481978-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.188085 Apr 09 20:56:00.049787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 179/371] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:00.060886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-319ae942-0553-4fff-9f62-caf5c41d380a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.070100 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-319ae942-0553-4fff-9f62-caf5c41d380a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/187430697" status: 200 len: 411 microversion: 2.1 time: 0.019235 Apr 09 20:56:00.076900 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 180/372] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/flavors/187430697 => generated 411 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:00.082668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Calling method '.version_select at 0x7fb08f467820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.083887 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:00.083887 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:00.085251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.085701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.106195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.106876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.114422 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd16f6e5-1900-44b2-af81-4ff200de39a1 tempest-HypervisorAdminV253TestBase-1946992951 tempest-HypervisorAdminV253TestBase-1946992951-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/495ef405-89a6-4dc0-8aa4-e2eecbae0c8d" status: 200 len: 792 microversion: 2.53 time: 0.036055 Apr 09 20:56:00.123204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 181/373] 10.222.0.30 () {60 vars in 1297 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/os-hypervisors/495ef405-89a6-4dc0-8aa4-e2eecbae0c8d => generated 792 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:00.137564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:00.153620 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b602067-e74c-4a56-8eca-1875571a195a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.568840 Apr 09 20:56:00.154183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 193/374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:55:59 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:00.237286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.238454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:00.251105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.253265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.254766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.255656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.348002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:00.356296 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-147bec87-968e-4e15-82a0-2c0b3e6293be tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1276 microversion: 2.1 time: 0.124651 Apr 09 20:56:00.356935 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 194/375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:00.566718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.568277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:00.578694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.580394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.582499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.585492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.600541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b07d7450-860c-4ed1-942d-1b244c5e999f tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.680445 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b07d7450-860c-4ed1-942d-1b244c5e999f tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.561054 Apr 09 20:56:00.693634 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 182/376] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:00.699521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7395e906-6baf-4da4-80db-3ec388e8c6d5 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.703501 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:00.703501 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:00.750288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7395e906-6baf-4da4-80db-3ec388e8c6d5 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/187430697" status: 202 len: 0 microversion: 2.1 time: 0.055219 Apr 09 20:56:00.754907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 183/377] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:56:00 2022] DELETE /compute/v2.1/flavors/187430697 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:00.761589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-923b2201-eff1-4b60-bda9-637214a01203 req-fbb0d893-8e54-4dbb-ab72-784e36cf0b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bb8bb5-bfe6-45ed-8c3e-31e7d4719680", "tag": "c8cc001c-614d-4bb1-934a-dd12049b69f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:00.785245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-923b2201-eff1-4b60-bda9-637214a01203 req-fbb0d893-8e54-4dbb-ab72-784e36cf0b67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:00.787008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-923b2201-eff1-4b60-bda9-637214a01203 req-fbb0d893-8e54-4dbb-ab72-784e36cf0b67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:00.810961 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-923b2201-eff1-4b60-bda9-637214a01203 req-fbb0d893-8e54-4dbb-ab72-784e36cf0b67 service nova] Creating event network-changed:c8cc001c-614d-4bb1-934a-dd12049b69f8 for instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 on nch1-master-1 Apr 09 20:56:00.823429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-923b2201-eff1-4b60-bda9-637214a01203 req-fbb0d893-8e54-4dbb-ab72-784e36cf0b67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062078 Apr 09 20:56:00.824728 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 184/378] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:00.856761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2858b8f8-f748-4b7f-b835-c1cae0627e66 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:00.902773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2858b8f8-f748-4b7f-b835-c1cae0627e66 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.073535 Apr 09 20:56:00.920895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 185/379] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:00.937402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2d0a20b-82b2-4a53-a69c-1a874a7e25cd tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-225650115", "id": 1761650144, "os-flavor-access:is_public": "False"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:00.939258 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:00.939258 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:00.984384 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2d0a20b-82b2-4a53-a69c-1a874a7e25cd tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.059649 Apr 09 20:56:00.994810 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 186/380] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:00 2022] POST /compute/v2.1/flavors => generated 429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.015887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6087e106-e82d-49d7-a13e-146cb3a01df2 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "1761650144"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:01.041081 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6087e106-e82d-49d7-a13e-146cb3a01df2 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] HTTP exception thrown: Flavor 1761650144 could not be found. Apr 09 20:56:01.044244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6087e106-e82d-49d7-a13e-146cb3a01df2 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] Returning 400 to user: Flavor 1761650144 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:01.045117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6087e106-e82d-49d7-a13e-146cb3a01df2 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.043116 Apr 09 20:56:01.049221 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 187/381] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:00 2022] POST /compute/v2.1/servers => generated 81 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:56:01.060858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dbcab95d-a9e9-48be-850f-f4f881a3fb18 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.063556 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:01.063556 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:01.106988 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dbcab95d-a9e9-48be-850f-f4f881a3fb18 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1761650144" status: 202 len: 0 microversion: 2.1 time: 0.050716 Apr 09 20:56:01.111559 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 188/382] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:01 2022] DELETE /compute/v2.1/flavors/1761650144 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:01.117507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7583b25f-4e72-4e9b-b6b6-fb6ec4481878 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.142747 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7583b25f-4e72-4e9b-b6b6-fb6ec4481878 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029700 Apr 09 20:56:01.155977 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 189/383] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:01.165099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54f4e7ae-7efb-4cb4-8d0a-c551ffe6de23 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-502375194", "id": 386880173, "os-flavor-access:is_public": "False"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:01.195727 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54f4e7ae-7efb-4cb4-8d0a-c551ffe6de23 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039037 Apr 09 20:56:01.199975 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 190/384] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.212642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.219807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:01.232839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:01.237477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:01.238471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:01.238710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:01.321463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:01.334311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:01.336151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:01.340963 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f2fd47c-38c9-4d45-b665-d552496931c9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.777680 Apr 09 20:56:01.341989 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 195/385] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:00 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:01.354412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-628de007-9e12-44fd-a4f4-8a410b6e715a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-719568151", "id": 1663377603, "os-flavor-access:is_public": "True"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:01.356274 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:01.356274 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:01.377890 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-628de007-9e12-44fd-a4f4-8a410b6e715a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033405 Apr 09 20:56:01.378558 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 196/386] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:01 2022] POST /compute/v2.1/flavors => generated 413 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.386481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bd7ca5da-8727-40d7-b05d-ebfb7e87754a req-dcfdd4ac-ac20-492e-b794-384529cdb76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41785a40-a163-4455-8ee5-1353161f2c3b", "name": "network-vif-plugged", "status": "completed", "tag": "969f5337-7c13-4c26-82e0-4f6bfc05cdf0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:01.413342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd7ca5da-8727-40d7-b05d-ebfb7e87754a req-dcfdd4ac-ac20-492e-b794-384529cdb76a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:01.413509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd7ca5da-8727-40d7-b05d-ebfb7e87754a req-dcfdd4ac-ac20-492e-b794-384529cdb76a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:01.441195 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bd7ca5da-8727-40d7-b05d-ebfb7e87754a req-dcfdd4ac-ac20-492e-b794-384529cdb76a service nova] Creating event network-vif-plugged:969f5337-7c13-4c26-82e0-4f6bfc05cdf0 for instance 41785a40-a163-4455-8ee5-1353161f2c3b on nch2-master-1 Apr 09 20:56:01.454938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bd7ca5da-8727-40d7-b05d-ebfb7e87754a req-dcfdd4ac-ac20-492e-b794-384529cdb76a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072929 Apr 09 20:56:01.457203 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 197/387] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.464203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.464900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:01.501105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:01.502453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:01.503527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:01.504167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:01.655076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:01.662699 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-33ad6734-b5fc-4438-b2ad-b391ebf32e86 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.453797 Apr 09 20:56:01.672108 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 191/388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:01.675404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63bd5d2e-28d2-4ba9-8cc5-8a2e8e6d0003 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.708332 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63bd5d2e-28d2-4ba9-8cc5-8a2e8e6d0003 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.036374 Apr 09 20:56:01.709171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 192/389] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.727751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8b92309-eed1-4ce8-99ee-8bbea9c3e929 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.751934 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e8b92309-eed1-4ce8-99ee-8bbea9c3e929 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.035568 Apr 09 20:56:01.754466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 193/390] 10.222.0.30 () {58 vars in 1176 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.767277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af49cc70-4118-4e77-aff1-0cf36cea6a83 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.776003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af49cc70-4118-4e77-aff1-0cf36cea6a83 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.012943 Apr 09 20:56:01.776908 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 194/391] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:01.790104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa0ffc54-1566-4ce4-9547-82cb1baf90e3 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.804632 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa0ffc54-1566-4ce4-9547-82cb1baf90e3 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.020914 Apr 09 20:56:01.810048 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 195/392] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:01.822507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e678a357-9283-49e3-97ea-165d8f24cc07 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.904268 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e678a357-9283-49e3-97ea-165d8f24cc07 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.090078 Apr 09 20:56:01.905685 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 196/393] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:01.915096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:01.927109 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b832d756-5aa3-4efb-9aff-a704e88f3246 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.465243 Apr 09 20:56:01.928157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bccc719a-314e-458b-9cda-ea3e2f77d329 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:01.930178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 198/394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:01.965259 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bccc719a-314e-458b-9cda-ea3e2f77d329 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.043593 Apr 09 20:56:01.966746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 197/395] 10.222.0.30 () {58 vars in 1174 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:01.984553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7c64574-74bb-4f37-aec5-ebfba4772807 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.017536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7c64574-74bb-4f37-aec5-ebfba4772807 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.039388 Apr 09 20:56:02.028370 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 199/396] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Apr 9 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.036992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd8246ad-b0d1-4745-9ef9-07bdac369185 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.088752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd8246ad-b0d1-4745-9ef9-07bdac369185 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.058740 Apr 09 20:56:02.093092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 198/397] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.112198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c10e6380-eb61-43f5-9af5-758a6100646d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.112198 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.112198 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:02.148094 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c10e6380-eb61-43f5-9af5-758a6100646d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1663377603" status: 202 len: 0 microversion: 2.1 time: 0.047228 Apr 09 20:56:02.148917 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 200/398] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:02 2022] DELETE /compute/v2.1/flavors/1663377603 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:02.157651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed1bcd29-af9a-40d5-9f3c-c88d4952965d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.182354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed1bcd29-af9a-40d5-9f3c-c88d4952965d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028548 Apr 09 20:56:02.192732 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 199/399] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.199002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3af753ee-e49c-443b-a4a7-c50c5debba99 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.221977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3af753ee-e49c-443b-a4a7-c50c5debba99 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/386880173" status: 202 len: 0 microversion: 2.1 time: 0.026751 Apr 09 20:56:02.226940 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 201/400] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:56:02 2022] DELETE /compute/v2.1/flavors/386880173 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:02.231275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fff0abd-1643-45c1-8ac3-aa602b9dd631 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.281681 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fff0abd-1643-45c1-8ac3-aa602b9dd631 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.038124 Apr 09 20:56:02.293136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 200/401] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.302179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2383e924-6257-462a-b6ba-c3d75d63958a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1325068135", "id": 1484431852, "os-flavor-access:is_public": "False"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:02.304921 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.304921 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:02.326080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2383e924-6257-462a-b6ba-c3d75d63958a tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.029685 Apr 09 20:56:02.327187 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 202/402] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:02.338797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71c1c680-0960-441a-99a1-444c6b22fd4e tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.371155 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-71c1c680-0960-441a-99a1-444c6b22fd4e tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.036946 Apr 09 20:56:02.371407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 201/403] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:02.376112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.376709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:02.405175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.405627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.406414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.406842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.510651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Calling method '.version_select at 0x7fb08f2d9670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.512166 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.512166 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:02.513523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.514336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.515229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.516016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.544666 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9fd7edf-8d6e-4429-bbc1-65fa5776dadd tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.192707 Apr 09 20:56:02.546072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 203/404] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:02.551844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5281cec9-c760-4ffe-b2e7-d320446e526e tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.595187 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5281cec9-c760-4ffe-b2e7-d320446e526e tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.047839 Apr 09 20:56:02.596071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 204/405] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.699209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:02.713020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:02.717553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:02.721443 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea196413-8bc9-4c47-a9eb-653ade11f21c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.349054 Apr 09 20:56:02.729350 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 202/406] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:02.734827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf35ab17-f270-49c1-8514-d3175c036e3d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.740864 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.740864 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:02.745675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1018dcaa-26d1-4bcf-83bf-797f946caf0f tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Calling method '.version_select at 0x7fb08f2d9700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.747200 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.747200 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:02.748655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1018dcaa-26d1-4bcf-83bf-797f946caf0f tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:02.749598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1018dcaa-26d1-4bcf-83bf-797f946caf0f tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:02.752365 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1018dcaa-26d1-4bcf-83bf-797f946caf0f tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.153271 Apr 09 20:56:02.753748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 205/407] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:02.762961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.764285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:02.779935 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf35ab17-f270-49c1-8514-d3175c036e3d tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1484431852" status: 202 len: 0 microversion: 2.1 time: 0.048942 Apr 09 20:56:02.780542 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 203/408] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:02 2022] DELETE /compute/v2.1/flavors/1484431852 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:02.786249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.787778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.789576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.791193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.811670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c47c8a03-ca61-47ea-969a-68d05ddd6940 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Calling method '.version_select at 0x7fb08f296ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.823200 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.823200 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:02.828522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c47c8a03-ca61-47ea-969a-68d05ddd6940 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:02.830816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c47c8a03-ca61-47ea-969a-68d05ddd6940 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:02.835476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c47c8a03-ca61-47ea-969a-68d05ddd6940 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.051917 Apr 09 20:56:02.843594 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 204/409] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:02.860225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-41bf6237-5153-4dd1-97fe-2806356334c2 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.882043 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-41bf6237-5153-4dd1-97fe-2806356334c2 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025871 Apr 09 20:56:02.894316 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 205/410] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:02.900496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1f65fcce-5bdc-4d30-85fc-4022d3780805 req-cdca6d0c-e161-41ae-90fd-b286cf66d5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674593e6-b6e7-4b13-bbc2-06fa68785ee0", "tag": "147d52be-77da-4ccb-86ad-30f4bd1a6539"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:02.911212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1f65fcce-5bdc-4d30-85fc-4022d3780805 req-cdca6d0c-e161-41ae-90fd-b286cf66d5f7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:02.912020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1f65fcce-5bdc-4d30-85fc-4022d3780805 req-cdca6d0c-e161-41ae-90fd-b286cf66d5f7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:02.925451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1f65fcce-5bdc-4d30-85fc-4022d3780805 req-cdca6d0c-e161-41ae-90fd-b286cf66d5f7 service nova] Creating event network-changed:147d52be-77da-4ccb-86ad-30f4bd1a6539 for instance 674593e6-b6e7-4b13-bbc2-06fa68785ee0 on nch2-master-1 Apr 09 20:56:02.931448 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1f65fcce-5bdc-4d30-85fc-4022d3780805 req-cdca6d0c-e161-41ae-90fd-b286cf66d5f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035593 Apr 09 20:56:02.932060 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 206/411] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:02.943730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6998431f-208d-42d4-9897-8b0f760796c3 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Calling method '.version_select at 0x7fb08f4e03a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:02.947444 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.947444 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:02.970814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6998431f-208d-42d4-9897-8b0f760796c3 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 09 20:56:02.971929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6998431f-208d-42d4-9897-8b0f760796c3 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:02.974146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6998431f-208d-42d4-9897-8b0f760796c3 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.039699 Apr 09 20:56:02.981266 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 207/412] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:02.992170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2601a28-9394-4921-905b-ed6950d99e9b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-624698291", "id": 1060840331, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:02.996450 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:02.996450 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:03.033288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2601a28-9394-4921-905b-ed6950d99e9b tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.048803 Apr 09 20:56:03.040693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 208/413] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:03.049235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.049992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:03.063400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:03.063626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:03.064408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:03.064847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:03.239507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.250295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60abb40d-c16c-4ff1-9537-21576bcc7678 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.495294 Apr 09 20:56:03.253789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 206/414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:02 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:03.275651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd7a0e9b-7f39-4ec8-9e06-673f3e7eb9a4 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Calling method '.version_select at 0x7fb08f2d9a60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.278451 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:03.278451 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:03.284773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd7a0e9b-7f39-4ec8-9e06-673f3e7eb9a4 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.285756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd7a0e9b-7f39-4ec8-9e06-673f3e7eb9a4 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.286735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd7a0e9b-7f39-4ec8-9e06-673f3e7eb9a4 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.029533 Apr 09 20:56:03.294865 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 207/415] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:03.301216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8efc20e4-8f37-4ba1-907c-3e40ed42bb88 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.350860 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8efc20e4-8f37-4ba1-907c-3e40ed42bb88 tempest-FlavorsAdminTestJSON-1250201230 tempest-FlavorsAdminTestJSON-1250201230-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.053463 Apr 09 20:56:03.360201 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 208/416] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:03.373597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42f9f4a2-7df5-4f4d-aa7c-ad6cd0509ce2 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Calling method '.version_select at 0x7fb08f2cd670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.382834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-42f9f4a2-7df5-4f4d-aa7c-ad6cd0509ce2 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 09 20:56:03.385361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42f9f4a2-7df5-4f4d-aa7c-ad6cd0509ce2 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.391133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-42f9f4a2-7df5-4f4d-aa7c-ad6cd0509ce2 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029688 Apr 09 20:56:03.391957 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 209/417] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:03.400059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e1b6fe3-c30e-444e-950d-cedb152002be tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.404597 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:03.404597 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:03.432215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e1b6fe3-c30e-444e-950d-cedb152002be tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1060840331" status: 202 len: 0 microversion: 2.1 time: 0.038983 Apr 09 20:56:03.441710 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 210/418] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:03 2022] DELETE /compute/v2.1/flavors/1060840331 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:03.461752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f57fac4-0931-485b-bec0-e55e6031b7c5 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Calling method '.version_select at 0x7fb08f47e940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.464474 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:03.464474 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:03.466939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f57fac4-0931-485b-bec0-e55e6031b7c5 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.467922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f57fac4-0931-485b-bec0-e55e6031b7c5 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.468991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f57fac4-0931-485b-bec0-e55e6031b7c5 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.025621 Apr 09 20:56:03.470913 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 211/419] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:03.477194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34b2f5ea-3157-4c4d-9f65-e2bfeccdb035 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.503872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34b2f5ea-3157-4c4d-9f65-e2bfeccdb035 tempest-FlavorsAdminTestJSON-706430040 tempest-FlavorsAdminTestJSON-706430040-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031616 Apr 09 20:56:03.504874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 212/420] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:03.510172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71084906-6613-4d12-b7e3-75e8743b0081 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Calling method '.version_select at 0x7fb08f61d9d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.522891 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-71084906-6613-4d12-b7e3-75e8743b0081 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 09 20:56:03.524179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71084906-6613-4d12-b7e3-75e8743b0081 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.525192 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71084906-6613-4d12-b7e3-75e8743b0081 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019135 Apr 09 20:56:03.526255 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 213/421] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:03.537354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a3ca276-0529-4feb-975e-adc117061fc6 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Calling method '.version_select at 0x7fb08f2d9040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.538616 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:03.538616 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:03.540240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6a3ca276-0529-4feb-975e-adc117061fc6 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.541090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a3ca276-0529-4feb-975e-adc117061fc6 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.542140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a3ca276-0529-4feb-975e-adc117061fc6 tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010492 Apr 09 20:56:03.542810 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 214/422] 10.222.0.30 () {58 vars in 1193 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:56:03.556331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63986a8d-e276-4f20-9988-11efa4113f8e tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Calling method '.version_select at 0x7fb08f2d90d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.567239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-63986a8d-e276-4f20-9988-11efa4113f8e tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 09 20:56:03.568249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63986a8d-e276-4f20-9988-11efa4113f8e tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.569314 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63986a8d-e276-4f20-9988-11efa4113f8e tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020412 Apr 09 20:56:03.570016 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 215/423] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:03.582971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7cc5272-b31e-43c8-826f-985e9821abe5 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f2cdee0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.585625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7cc5272-b31e-43c8-826f-985e9821abe5 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.586827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7cc5272-b31e-43c8-826f-985e9821abe5 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.010869 Apr 09 20:56:03.587612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 216/424] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Apr 9 20:56:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:56:03.598872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3800d9bc-dbf6-468a-bd7d-b9eb45a8c185 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f47e940>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.600823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3800d9bc-dbf6-468a-bd7d-b9eb45a8c185 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.601911 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3800d9bc-dbf6-468a-bd7d-b9eb45a8c185 tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.007809 Apr 09 20:56:03.608208 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 217/425] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Apr 9 20:56:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:56:03.614104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49a97e8d-4876-4161-b470-a8da3604a3db tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Action: 'update', calling method: .version_select at 0x7fb08f2cde50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.615895 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:03.615895 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:03.617312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49a97e8d-4876-4161-b470-a8da3604a3db tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b0e47ff2de7a47fea56890f7b4f08432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b53d8bf2b6473bbff55e2aa932a898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.618579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49a97e8d-4876-4161-b470-a8da3604a3db tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.619640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49a97e8d-4876-4161-b470-a8da3604a3db tempest-HostsAdminNegativeTestJSON-848871458 tempest-HostsAdminNegativeTestJSON-848871458-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.009514 Apr 09 20:56:03.625065 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 218/426] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Apr 9 20:56:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:03.630791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59aff0dc-d2b7-4afd-b0df-fc57313a6aca tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f2f1af0>, body: {"status": null, "maintenance_mode": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.632559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59aff0dc-d2b7-4afd-b0df-fc57313a6aca tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.633598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59aff0dc-d2b7-4afd-b0df-fc57313a6aca tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.007312 Apr 09 20:56:03.634345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 219/427] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Apr 9 20:56:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:56:03.645634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b4737e7-f818-4439-837b-25d73e63ba8b tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f2d90d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.647786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.hosts [None req-2b4737e7-f818-4439-837b-25d73e63ba8b tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Enabling host nonexistent_hostname. Apr 09 20:56:03.658881 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2b4737e7-f818-4439-837b-25d73e63ba8b tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 09 20:56:03.660011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b4737e7-f818-4439-837b-25d73e63ba8b tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:03.661129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b4737e7-f818-4439-837b-25d73e63ba8b tempest-HostsAdminNegativeTestJSON-1798078470 tempest-HostsAdminNegativeTestJSON-1798078470-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021003 Apr 09 20:56:03.667010 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 220/428] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 20:56:03 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:03.748015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:03.748832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:03.759136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:03.761094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:03.764169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:03.766305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:03.810084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:03.824215 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-07f08250-3fc3-42bd-a786-c9be96768103 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.781158 Apr 09 20:56:03.825986 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 209/429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:03.852048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6972b2a1-b3f2-457d-a16d-5b42ed310c8d req-71c211e8-c4ce-4f3d-9ec8-d562b9e4bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef417c4-dee0-46c2-a42f-dc721270cc56", "tag": "2e45c6ce-b2c0-4790-bc04-fbb033004b11"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:03.877667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6972b2a1-b3f2-457d-a16d-5b42ed310c8d req-71c211e8-c4ce-4f3d-9ec8-d562b9e4bef8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:03.879759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6972b2a1-b3f2-457d-a16d-5b42ed310c8d req-71c211e8-c4ce-4f3d-9ec8-d562b9e4bef8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:03.912085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6972b2a1-b3f2-457d-a16d-5b42ed310c8d req-71c211e8-c4ce-4f3d-9ec8-d562b9e4bef8 service nova] Creating event network-changed:2e45c6ce-b2c0-4790-bc04-fbb033004b11 for instance cef417c4-dee0-46c2-a42f-dc721270cc56 on nch2-master-1 Apr 09 20:56:03.924330 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6972b2a1-b3f2-457d-a16d-5b42ed310c8d req-71c211e8-c4ce-4f3d-9ec8-d562b9e4bef8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081644 Apr 09 20:56:03.926261 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 210/430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:04.241239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:04.250012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:04.251461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:04.253625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d57ac6ed-f113-4cd9-ae8f-39f1e0a6860c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.510111 Apr 09 20:56:04.254389 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 221/431] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:03 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:56:04.270555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:04.271241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:04.278041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:04.278764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:04.279716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:04.280513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:04.546505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:04.553868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c5b4648-e1a0-40d6-8d9c-45b9c84fbc39 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.288043 Apr 09 20:56:04.554800 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 211/432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:04 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:04.841761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:04.842396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:04.848324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:04.848771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:04.849567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:04.849994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:04.990274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:04.997938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f9875f65-2097-47ac-bfb6-62555abba10b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.160326 Apr 09 20:56:04.998509 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 222/433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:04 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:05.271861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:05.272483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:05.279806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:05.280988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:05.282119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:05.283135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:05.472008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:05.483095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:05.485132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:05.486266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac48789a-a49f-48c6-a6bf-7a1c177cae69 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.218408 Apr 09 20:56:05.496991 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 212/434] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:05 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:05.571274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:05.571835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:05.581190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:05.582047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:05.602162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:05.604572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:05.808785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:05.828097 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fed11ed4-baa7-4958-97e2-500566823fed tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.260886 Apr 09 20:56:05.829530 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 223/435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:05 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:06.015135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:06.015992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:06.023633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.024097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:06.024897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.025700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:06.193732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:06.202500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c0f757a-8f02-42f2-873f-fb3d3565406e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.191547 Apr 09 20:56:06.212032 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 213/436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:06 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:06.504678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:06.505311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:06.515197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.515651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:06.516428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.516854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:06.740525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:06.749015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:06.750904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:06.752129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91b8f454-6063-498e-bbb3-6d44fb234a26 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.251949 Apr 09 20:56:06.764801 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 224/437] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:06 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:06.847017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:06.847795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:06.855078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.855839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:06.856940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:06.857462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.025574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.034352 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0e4afac-7f10-486e-b454-422955de6b22 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.192205 Apr 09 20:56:07.050252 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 225/438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:06 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:07.078035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4e537a8-606f-42b1-8112-75b29c5e87d8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Calling method '.version_select at 0x7fb08f2bdd30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.078964 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.078964 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:07.080069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d4e537a8-606f-42b1-8112-75b29c5e87d8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4373f108fb0b46b0b66e010d5396a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b52aef2f7124bfa8343992aa5f1101b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.080910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4e537a8-606f-42b1-8112-75b29c5e87d8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.081754 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4e537a8-606f-42b1-8112-75b29c5e87d8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.304098 Apr 09 20:56:07.082443 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 214/439] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 20:56:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 305 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:07.091991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-662b5106-ee54-43ca-80b3-a4bbd7e0b2fd tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Calling method '.version_select at 0x7fb08f27b940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.092970 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.092970 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:07.094367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-662b5106-ee54-43ca-80b3-a4bbd7e0b2fd tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4373f108fb0b46b0b66e010d5396a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b52aef2f7124bfa8343992aa5f1101b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.095201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-662b5106-ee54-43ca-80b3-a4bbd7e0b2fd tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.096215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-662b5106-ee54-43ca-80b3-a4bbd7e0b2fd tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008152 Apr 09 20:56:07.096958 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 226/440] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:56:07.105653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5435677d-991c-48b7-87c7-db3a0b27e3a3 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Calling method '.version_select at 0x7fb08f467dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.106970 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.106970 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:07.107735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5435677d-991c-48b7-87c7-db3a0b27e3a3 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4373f108fb0b46b0b66e010d5396a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b52aef2f7124bfa8343992aa5f1101b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.108382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5435677d-991c-48b7-87c7-db3a0b27e3a3 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.109568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5435677d-991c-48b7-87c7-db3a0b27e3a3 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007470 Apr 09 20:56:07.110249 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 215/441] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:56:07.219763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.220552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:07.226642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.227442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.228350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.228919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.367254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.375661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4eba572e-6baa-41b9-920b-ba11d1da7a8f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.160459 Apr 09 20:56:07.376238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 216/442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:07.390795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Calling method '.version_select at 0x7fb08f47e040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.394425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.394568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.411465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.412087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.424579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.425373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.441889 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76299b59-bfac-4540-84a8-882e7bf0b2d4 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.318517 Apr 09 20:56:07.442736 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 227/443] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:07.453415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2041c481-17c7-4d86-acc5-b29ea3bb1283 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Calling method '.version_select at 0x7fb08f2b9430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.454690 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.454690 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:07.456208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2041c481-17c7-4d86-acc5-b29ea3bb1283 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4373f108fb0b46b0b66e010d5396a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b52aef2f7124bfa8343992aa5f1101b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.457150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2041c481-17c7-4d86-acc5-b29ea3bb1283 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.458197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2041c481-17c7-4d86-acc5-b29ea3bb1283 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009428 Apr 09 20:56:07.459233 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 217/444] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:07.469327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-efb03ea0-eef8-475b-b531-14bdf644aba5 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Calling method '.version_select at 0x7fb08f47ed30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.470128 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.470128 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:07.471356 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-efb03ea0-eef8-475b-b531-14bdf644aba5 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] HTTP exception thrown: Hypervisor with ID '1e847eea-634a-44bc-8ae4-c1dc248022be' could not be found. Apr 09 20:56:07.472083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-efb03ea0-eef8-475b-b531-14bdf644aba5 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Returning 404 to user: Hypervisor with ID '1e847eea-634a-44bc-8ae4-c1dc248022be' could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.473096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-efb03ea0-eef8-475b-b531-14bdf644aba5 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1e847eea-634a-44bc-8ae4-c1dc248022be/uptime" status: 404 len: 123 microversion: 2.1 time: 0.008204 Apr 09 20:56:07.473782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 228/445] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors/1e847eea-634a-44bc-8ae4-c1dc248022be/uptime => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:07.482781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Calling method '.version_select at 0x7fb08f2bdca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.483592 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.483592 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:07.485366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.485822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.501125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.501859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.513282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.513996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.521254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56a0a63e-daed-4d16-b83e-5d984d810935 tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041713 Apr 09 20:56:07.522631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 218/446] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:07.534791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04ab09f6-c51f-481c-bb7d-b1640d70afe8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Calling method '.version_select at 0x7fb08f27ba60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.536016 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.536016 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:07.537497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04ab09f6-c51f-481c-bb7d-b1640d70afe8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4373f108fb0b46b0b66e010d5396a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b52aef2f7124bfa8343992aa5f1101b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.538601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04ab09f6-c51f-481c-bb7d-b1640d70afe8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.539626 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04ab09f6-c51f-481c-bb7d-b1640d70afe8 tempest-HypervisorAdminNegativeTestJSON-1221299449 tempest-HypervisorAdminNegativeTestJSON-1221299449-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010721 Apr 09 20:56:07.541467 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 229/447] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:07.549989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ba6ba4f-9ffe-411e-9290-c632e950bf6f tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Calling method '.version_select at 0x7fb0940710d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.550813 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:07.550813 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:07.551701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6ba6ba4f-9ffe-411e-9290-c632e950bf6f tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] HTTP exception thrown: Hypervisor with ID 'cda14eb7-bc38-4c3b-8597-b38111ce06c8' could not be found. Apr 09 20:56:07.552266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ba6ba4f-9ffe-411e-9290-c632e950bf6f tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] Returning 404 to user: Hypervisor with ID 'cda14eb7-bc38-4c3b-8597-b38111ce06c8' could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:07.553328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ba6ba4f-9ffe-411e-9290-c632e950bf6f tempest-HypervisorAdminNegativeTestJSON-1961497040 tempest-HypervisorAdminNegativeTestJSON-1961497040-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/cda14eb7-bc38-4c3b-8597-b38111ce06c8" status: 404 len: 123 microversion: 2.1 time: 0.007083 Apr 09 20:56:07.554172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 219/448] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/os-hypervisors/cda14eb7-bc38-4c3b-8597-b38111ce06c8 => generated 123 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:07.774373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:07.775905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:07.784934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.785958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.787823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:07.788540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:07.958170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.969854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.971784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:07.973930 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-55da06bc-b803-4b9f-a9f6-042a7fefa9c7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.207266 Apr 09 20:56:07.975023 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 230/449] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:07 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:08.059012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:08.059957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:08.071380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:08.072099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:08.074062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:08.075449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:08.242553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:08.252937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d59f9400-7963-4e2d-9557-303dd96182b9 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.200354 Apr 09 20:56:08.253943 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 220/450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:08 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:08.400673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:08.401390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:08.410093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:08.410535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:08.415212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:08.415888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:08.759533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:08.776751 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a73529ba-750b-405c-ab76-ddd390528895 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.387999 Apr 09 20:56:08.788081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 231/451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:08 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:09.114817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Calling method '.version_select at 0x7fb08f2af700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:09.116427 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:09.116427 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:09.118252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.118932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.154888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.157378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.182410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.184224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.201243 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d9756c79-df69-4727-9147-fa6a4abc9b70 tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.448541 Apr 09 20:56:09.202787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 221/452] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:56:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:09.213553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:09.218089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:09.235014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.235958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.237326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.237842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.464126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-875d224b-ab36-413f-9d04-d2049b3af835 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f27bf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:09.498590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:09.508084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:09.509649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:09.511890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-51cd1ef7-8e85-478e-82de-6f5237899a85 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1567 microversion: 2.25 time: 0.307905 Apr 09 20:56:09.512597 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 222/453] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:09 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:09.517231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Calling method '.version_select at 0x7fb08f2968b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:09.518423 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:09.518423 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:09.520003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.520840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.534670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.535398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.543028 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f918a58-ca68-4033-9462-40a3d971211b tempest-HypervisorAdminV228Test-599191933 tempest-HypervisorAdminV228Test-599191933-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.028928 Apr 09 20:56:09.544238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 223/454] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Apr 9 20:56:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:09.550063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:09.550983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:09.557890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.558577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.559600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:09.560901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:09.741384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:09.751141 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a280fa29-36e9-4e83-9e63-63cd289c7408 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.205094 Apr 09 20:56:09.761813 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 224/455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:09 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:10.038125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2053977824", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "d177c046-7535-4c7b-b618-98d558de5c88"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:10.049788 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-875d224b-ab36-413f-9d04-d2049b3af835 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049" status: 200 len: 371 microversion: 2.1 time: 1.164278 Apr 09 20:56:10.061249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 232/456] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 20:56:08 2022] GET /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049 => generated 371 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:10.067617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:10.071424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:10.107457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.107971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:10.108808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.109627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:10.127646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] validate_networks() for [('d177c046-7535-4c7b-b618-98d558de5c88', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:10.680904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:10.688840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6738b212-0014-4e43-bf6d-a0dc3416c941 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.626337 Apr 09 20:56:10.689556 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 233/457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:10 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:10.694232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f206550>, body: {"quota_set": {"ram": "5120"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:10.769683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.770367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:10.771603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.772167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:10.832590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63aab24d-4a11-4c35-880e-4ad315de1088 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049" status: 200 len: 328 microversion: 2.1 time: 0.141761 Apr 09 20:56:10.838121 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 234/458] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:56:10 2022] PUT /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049 => generated 328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:10.838748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:10.840039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:10.846830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.847534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:10.848258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:10.848689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.127539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:11.142303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:11.147052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:11.148457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-689804d3-de6b-4805-a288-ff729b195bde tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1557 microversion: 2.25 time: 0.313664 Apr 09 20:56:11.149414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:11.149869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:11.150290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:11.150413 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 235/459] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:10 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:11.163034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:11.163483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:11.166911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.168027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:11.174051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.174705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.175953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.176647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.184957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.196598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.197503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.197940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.230897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Getting quotas for project 847209629f944fd98aec4c4bbe9a2bd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:11.241006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Getting quotas for user ae8571042b5f47eea035c6f126d4e641 and project 847209629f944fd98aec4c4bbe9a2bd8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:11.263736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:11.267083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:11.344888 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a101fa88-e098-41d7-94ba-c9bd2eb71db9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580333 Apr 09 20:56:11.352652 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 225/460] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:11.365190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-642644b6-155d-4eb9-b5c3-97c58caaa7fc tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.379158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-642644b6-155d-4eb9-b5c3-97c58caaa7fc tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049" status: 202 len: 0 microversion: 2.1 time: 0.025001 Apr 09 20:56:11.383652 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 226/461] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 20:56:11 2022] DELETE /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:11.392332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c49b6b30-1380-4f7c-be1c-e08764f134da tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '.version_select at 0x7fb08f2af0d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.395349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c49b6b30-1380-4f7c-be1c-e08764f134da tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.395904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c49b6b30-1380-4f7c-be1c-e08764f134da tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.413581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c49b6b30-1380-4f7c-be1c-e08764f134da tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.028328 Apr 09 20:56:11.424543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 227/462] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:11.430857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdf86cca-e4e5-43ef-a33e-e28b0ae88fd2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.431719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cdf86cca-e4e5-43ef-a33e-e28b0ae88fd2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:11.434540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:11.447144 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ebf637c-4a0b-4282-8806-97defb0b80d1 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.294156 Apr 09 20:56:11.458276 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 236/463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:11.480646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-919fb716-ed64-41d5-95bf-68684e70f650 req-935f7bda-6976-4d8d-a448-f4d8f95bb624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674593e6-b6e7-4b13-bbc2-06fa68785ee0", "name": "network-vif-plugged", "status": "completed", "tag": "147d52be-77da-4ccb-86ad-30f4bd1a6539"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:11.501887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-919fb716-ed64-41d5-95bf-68684e70f650 req-935f7bda-6976-4d8d-a448-f4d8f95bb624 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.502380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-919fb716-ed64-41d5-95bf-68684e70f650 req-935f7bda-6976-4d8d-a448-f4d8f95bb624 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.518607 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-919fb716-ed64-41d5-95bf-68684e70f650 req-935f7bda-6976-4d8d-a448-f4d8f95bb624 service nova] Creating event network-vif-plugged:147d52be-77da-4ccb-86ad-30f4bd1a6539 for instance 674593e6-b6e7-4b13-bbc2-06fa68785ee0 on nch2-master-1 Apr 09 20:56:11.528914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-919fb716-ed64-41d5-95bf-68684e70f650 req-935f7bda-6976-4d8d-a448-f4d8f95bb624 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066615 Apr 09 20:56:11.530514 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 237/464] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:11.536980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b73afde-78b4-4055-844b-03b07be1b4ca tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f20cf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.560176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cdf86cca-e4e5-43ef-a33e-e28b0ae88fd2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:11.571911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdf86cca-e4e5-43ef-a33e-e28b0ae88fd2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1218 microversion: 2.1 time: 0.145514 Apr 09 20:56:11.574451 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 228/465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:11.581060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.582118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:11.630461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.632914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.635443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.637315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.917884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:11.947577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03e2c3e9-7511-404e-bb15-62272906bee5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 2049 microversion: 2.25 time: 0.367558 Apr 09 20:56:11.953549 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 229/466] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 2049 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:11.958847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:11.962237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:11.976311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.977062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:11.978003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:11.978570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.029174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b73afde-78b4-4055-844b-03b07be1b4ca tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049" status: 200 len: 371 microversion: 2.1 time: 0.497251 Apr 09 20:56:12.033965 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 238/467] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/os-quota-sets/fcfa475ab3b948348477ccb0a44ea049 => generated 371 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:12.120582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-325586540", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6f2c6748-eb93-475b-8e01-8a36bd1222c2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:12.210870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] validate_networks() for [('6f2c6748-eb93-475b-8e01-8a36bd1222c2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:12.228752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:12.239159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b602975d-9376-4362-a6f2-3626a530c1a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.284050 Apr 09 20:56:12.241334 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 230/468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:11 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:12.274149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-359de6fa-c1d0-4625-a6f5-9b9f961ab19b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f25f820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:12.643678 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-359de6fa-c1d0-4625-a6f5-9b9f961ab19b tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.375135 Apr 09 20:56:12.652092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 231/469] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 20:56:12 2022] GET /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4/defaults => generated 371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:12.652092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:12.657834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:12.674249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.675002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.677739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.679454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.706311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:12.706920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:12.707555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:12.708273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:12.708845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:12.721525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.722155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.723394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.723971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.747611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:12.764316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for user 9c775742dfc04cec8559f9e4d13239b0 and project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:12.787653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:12.790895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:12.878200 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b0f34e3-48e2-4fe1-a095-aa79bbc4858d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.760728 Apr 09 20:56:12.885563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 239/470] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 20:56:12.912359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:12.916365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:12.933381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.933951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.937839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:12.938809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:12.940194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:12.959344 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f71efc5-0238-4c86-b9f5-dd06883d9f09 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.310616 Apr 09 20:56:12.968738 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 232/471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:12 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:12.969611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:12.978763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:13.143565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:13.152193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4da3544a-9333-4025-b4a7-b407becbae20 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1278 microversion: 2.1 time: 0.263942 Apr 09 20:56:13.161534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:13.162050 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 240/472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:12 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:13.175353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:13.181961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:13.185992 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a401e7fd-a559-4838-8a7d-a702050de0b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1261 microversion: 2.25 time: 0.224048 Apr 09 20:56:13.188139 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 233/473] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:12 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:13.257177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:13.257848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:13.266677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f2b9820>, body: {"quota_set": {"ram": "5120"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:13.281235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.281688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.282487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.282928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.514850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.515309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.516122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.520738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.574525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:13.584721 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e4411be-aecd-43e1-8908-55797438fdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68" status: 200 len: 328 microversion: 2.1 time: 0.321966 Apr 09 20:56:13.586083 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 234/474] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 20:56:13 2022] PUT /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68 => generated 328 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:13.596151 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e39f3ea-d40b-4f6a-9cab-2f7ece83d075 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.342809 Apr 09 20:56:13.598740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 241/475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:13 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:13.602328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f50cd30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:13.671563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5b5fb632-cd3b-4e6c-82e5-5b681abbc2e9 req-d7dd7996-0c5e-41db-93fc-7d2c39a278a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef417c4-dee0-46c2-a42f-dc721270cc56", "name": "network-vif-plugged", "status": "completed", "tag": "2e45c6ce-b2c0-4790-bc04-fbb033004b11"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:13.703143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5b5fb632-cd3b-4e6c-82e5-5b681abbc2e9 req-d7dd7996-0c5e-41db-93fc-7d2c39a278a2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.713320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5b5fb632-cd3b-4e6c-82e5-5b681abbc2e9 req-d7dd7996-0c5e-41db-93fc-7d2c39a278a2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.746968 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5b5fb632-cd3b-4e6c-82e5-5b681abbc2e9 req-d7dd7996-0c5e-41db-93fc-7d2c39a278a2 service nova] Creating event network-vif-plugged:2e45c6ce-b2c0-4790-bc04-fbb033004b11 for instance cef417c4-dee0-46c2-a42f-dc721270cc56 on nch2-master-1 Apr 09 20:56:13.770868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5b5fb632-cd3b-4e6c-82e5-5b681abbc2e9 req-d7dd7996-0c5e-41db-93fc-7d2c39a278a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103652 Apr 09 20:56:13.772060 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 242/476] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:13.851249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.852708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.853979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.854571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.879463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbccfda5-ba87-4e5c-b79a-601cc20a71d8 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68/detail" status: 200 len: 916 microversion: 2.1 time: 0.285985 Apr 09 20:56:13.880663 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 235/477] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:56:13 2022] GET /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68/detail => generated 916 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:13.977775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:13.978943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:13.993878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.995481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:13.997510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:13.999854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.177740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:14.178347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:14.191341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.191776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.192534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.192966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.384762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.396048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a207fab5-afe4-4517-8786-4397151e5689 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1320 microversion: 2.1 time: 0.422458 Apr 09 20:56:14.398689 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 243/478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:13 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:14.412804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:14.414341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:14.427343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.429618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.430773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.434525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.484601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.495787 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99578d70-6bd8-4c96-b135-a83fae2b39f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.321815 Apr 09 20:56:14.497019 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 236/479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:14 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:14.505859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f27daf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:14.562742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.573505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.575437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.577528 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a00eda3a-3f77-4885-93fc-07cc05bb086e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1321 microversion: 2.25 time: 0.176140 Apr 09 20:56:14.580485 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 244/480] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:14 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:14.615017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:14.615922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:14.625144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.625754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.626718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.627421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.811055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:14.822672 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-84efbdee-40db-4d92-80fa-304e2bff5af6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1318 microversion: 2.1 time: 0.212086 Apr 09 20:56:14.823999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 245/481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:14 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:14.901175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.901976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.906048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.906651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.959553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.960340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.961460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.961973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:14.981412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Calling method '.version_select at 0x7fb08f2063a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:14.982618 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:14.982618 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:14.984500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:14.985061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.003223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.004085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.017549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.018154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.026106 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-066f348b-d1e6-4009-a84d-721ab9cc7d2d tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.121146 Apr 09 20:56:15.032545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 246/482] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:15.055322 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-838ccd07-f55c-46d0-9a27-c56186b93143 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68?user_id=af6d82e9148a46379ed5fd54103884db" status: 200 len: 328 microversion: 2.1 time: 0.553211 Apr 09 20:56:15.057369 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 237/483] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:56:14 2022] PUT /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68?user_id=af6d82e9148a46379ed5fd54103884db => generated 328 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:15.067511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-62b47da4-735a-4cc6-9b57-13f5f47ecdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f2bd430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.268508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73876cb5-bcae-4508-ac13-1ed816fa9068 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Calling method '.version_select at 0x7fb08f2cd670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.269707 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:15.269707 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:15.271638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73876cb5-bcae-4508-ac13-1ed816fa9068 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f18e2c79b059495c9b530a096f6f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda79d5ce0bc4d7d8c01457fe5872545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.272529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73876cb5-bcae-4508-ac13-1ed816fa9068 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:15.273796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73876cb5-bcae-4508-ac13-1ed816fa9068 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.239928 Apr 09 20:56:15.282796 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 247/484] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 249 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:15.288686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Calling method '.version_select at 0x7fb08f47e9d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.292416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.293060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.310623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Apr 09 20:56:15.311785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:15.313843 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a1ceb2f-d263-44bd-89c6-bd5574b27e69 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029004 Apr 09 20:56:15.314747 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 248/485] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:15.324777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Calling method '.version_select at 0x7fb08f47ec10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.325865 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:15.325865 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:15.327058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.327522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.343374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.343822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.355935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.357887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.367893 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc28706c-f286-4f08-a7a4-ccdd1a42e0dc tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045976 Apr 09 20:56:15.368665 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 249/486] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:15.382373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d866c39-0e40-40c5-973d-9ab7e7204f16 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Calling method '.version_select at 0x7fb08f47e700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.383518 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:15.383518 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:15.385351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d866c39-0e40-40c5-973d-9ab7e7204f16 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f18e2c79b059495c9b530a096f6f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda79d5ce0bc4d7d8c01457fe5872545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.387923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d866c39-0e40-40c5-973d-9ab7e7204f16 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:15.389617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d866c39-0e40-40c5-973d-9ab7e7204f16 tempest-HypervisorAdminNegativeUnderV252Test-2027867906 tempest-HypervisorAdminNegativeUnderV252Test-2027867906-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013587 Apr 09 20:56:15.390358 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 250/487] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:15.401877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Calling method '.version_select at 0x7fb08f27b1f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.405304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.406006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.425723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] HTTP exception thrown: No hypervisor matching '83ce9377-3fd0-4208-960b-f1acf234ab77' could be found. Apr 09 20:56:15.426691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] Returning 404 to user: No hypervisor matching '83ce9377-3fd0-4208-960b-f1acf234ab77' could be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:15.427695 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd20ed56-9577-479b-bb26-9a0698dc9767 tempest-HypervisorAdminNegativeUnderV252Test-1445636407 tempest-HypervisorAdminNegativeUnderV252Test-1445636407-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/83ce9377-3fd0-4208-960b-f1acf234ab77/servers" status: 404 len: 123 microversion: 2.1 time: 0.030733 Apr 09 20:56:15.440890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-62b47da4-735a-4cc6-9b57-13f5f47ecdea tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68?user_id=af6d82e9148a46379ed5fd54103884db" status: 200 len: 370 microversion: 2.1 time: 0.374754 Apr 09 20:56:15.440890 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 238/488] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-quota-sets/15bf4b994960491bbd8b8e0341131e68?user_id=af6d82e9148a46379ed5fd54103884db => generated 370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:15.444208 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 251/489] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/os-hypervisors/83ce9377-3fd0-4208-960b-f1acf234ab77/servers => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:15.446457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.447189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:15.454037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.454774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.455932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.456565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.521265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.521917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:15.529231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.534530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.536273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.536727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.740539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.748784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9cee6437-4c89-42ef-a17f-c3229d17085c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1469 microversion: 2.1 time: 0.308368 Apr 09 20:56:15.757861 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 239/490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:15.773262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.773871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:15.788143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.788588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.789572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.790933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.866878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.874596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-16152b60-63ab-47be-9f33-6e6a6ae83e4a tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.362311 Apr 09 20:56:15.875181 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 252/491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:15.890324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:15.891361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:15.900030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.900494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.901312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.901747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.914519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.925164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.927285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:15.928687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02cc06e0-6c52-40f5-ac18-f118c1b4b227 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1319 microversion: 2.25 time: 0.169511 Apr 09 20:56:15.929973 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 240/492] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:15.934760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:15.935851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:15.942261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.943437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:15.944615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:15.945167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.032446 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8eeff47b-538b-4c84-a132-3460bc1ba7e4 tempest-DeleteServersAdminTestJSON-463370993 tempest-DeleteServersAdminTestJSON-463370993-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b/action" status: 202 len: 0 microversion: 2.1 time: 0.155896 Apr 09 20:56:16.033007 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 253/493] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:56:15 2022] POST /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:16.042298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-392ff676-d9df-41c3-8489-9c4498fd63f0 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Calling method '.version_select at 0x7fb08f20c940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.129666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:16.137285 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4aed9a50-f80c-4fcb-93c0-a769a854875b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1467 microversion: 2.1 time: 0.206012 Apr 09 20:56:16.137885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 241/494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:15 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1467 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:16.154551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.157067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:16.166828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.167283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.168067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.168536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.223078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.223876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.224539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lazy-loading 'fault' on Instance uuid 41785a40-a163-4455-8ee5-1353161f2c3b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:16.296137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-392ff676-d9df-41c3-8489-9c4498fd63f0 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.259351 Apr 09 20:56:16.297300 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 254/495] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 20:56:16 2022] GET /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4/defaults => generated 371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:16.302885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.303802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:16.310466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.310997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.311858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.312535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.362465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:16.370074 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d20a273-5944-4013-aca4-28c7a6d1c851 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1452 microversion: 2.1 time: 0.231237 Apr 09 20:56:16.370795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 242/496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:16 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:16.375605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-be7b4d2e-ae6f-4547-8ad1-8d08b1d4dcf7 req-3e118a80-ad15-4893-a3d9-cdb2bc99a20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0598b5e7-4a10-4476-a5e7-ff280805e29a", "tag": "521e5c23-21e4-4583-a60e-4f4a5fc9cff7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:16.384274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be7b4d2e-ae6f-4547-8ad1-8d08b1d4dcf7 req-3e118a80-ad15-4893-a3d9-cdb2bc99a20f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.384797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be7b4d2e-ae6f-4547-8ad1-8d08b1d4dcf7 req-3e118a80-ad15-4893-a3d9-cdb2bc99a20f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.397434 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-be7b4d2e-ae6f-4547-8ad1-8d08b1d4dcf7 req-3e118a80-ad15-4893-a3d9-cdb2bc99a20f service nova] Creating event network-changed:521e5c23-21e4-4583-a60e-4f4a5fc9cff7 for instance 0598b5e7-4a10-4476-a5e7-ff280805e29a on nch1-master-1 Apr 09 20:56:16.403314 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-be7b4d2e-ae6f-4547-8ad1-8d08b1d4dcf7 req-3e118a80-ad15-4893-a3d9-cdb2bc99a20f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Apr 09 20:56:16.404232 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 243/497] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:16.410382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f3dcc10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:16.482562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:16.491986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b2ff09f-43cc-423e-bc4c-a715e73420db tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1318 microversion: 2.1 time: 0.193342 Apr 09 20:56:16.492923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 255/498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:16 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:16.494433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.495089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.496138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.496797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.497965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.498457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:16.508110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.508559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.509552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.509982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.539936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:56:16.640735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dac3ee6a-22f4-4b0d-9b14-e11c06b91cb7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 204 len: 0 microversion: 2.1 time: 0.146441 Apr 09 20:56:16.641567 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 256/499] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:16 2022] DELETE /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:16.651518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.652842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:16.660928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.661608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.662568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.663003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.695686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.696131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.696759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lazy-loading 'fault' on Instance uuid 41785a40-a163-4455-8ee5-1353161f2c3b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:16.723706 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6545196-8008-4d44-95c5-3b250171f791 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4" status: 200 len: 329 microversion: 2.1 time: 0.318008 Apr 09 20:56:16.724366 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 244/500] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Apr 9 20:56:16 2022] PUT /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:16.735361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f50c8b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:16.812242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.812944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.813832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.814353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.831459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:16.840015 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-acba6345-234d-404f-836b-ba4d4d05ad9e tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1458 microversion: 2.1 time: 0.193561 Apr 09 20:56:16.841019 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 257/501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:16 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1458 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:16.892454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:16.893519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:16.901487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.901938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:16.902804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:16.903424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.071735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.079678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37fd7e41-9475-4791-b90d-2c379caaa41f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.191735 Apr 09 20:56:17.085597 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 258/502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:16 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:17.090715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:17.091520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:17.103211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.104088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.105140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.105813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.283671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a8b16ba4-800e-4040-8eaa-3a9c605db843 tempest-QuotasAdminTestJSON-911242062 tempest-QuotasAdminTestJSON-911242062-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4" status: 200 len: 329 microversion: 2.1 time: 0.552449 Apr 09 20:56:17.284104 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 245/503] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Apr 9 20:56:16 2022] PUT /compute/v2.1/os-quota-sets/7d8327eac92d4e15ba65e4b37d8b39d4 => generated 329 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:17.327285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.349889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.351644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.353417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-091d3170-d217-466b-a223-5188ddceaa91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.266557 Apr 09 20:56:17.364862 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 259/504] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:17 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:17.517840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:17.518821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:17.531936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.532392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.538652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.539176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.765962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.773349 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbc25715-a882-4b27-8259-35af4fa0eb1a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1468 microversion: 2.1 time: 0.267606 Apr 09 20:56:17.774117 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 246/505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:17 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1468 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:17.789998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:17.793864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:17.794760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Searching by: {'reservation_id': 'r-mdxfv05w', 'deleted': False, 'project_id': 'b21b82d625c249269c02db9bbe700c7c'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 20:56:17.802461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.803182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.804314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.805095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.858546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:17.860177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:17.867383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.868234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.869953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.870599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.931237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:17.932079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:17.932979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lazy-loading 'fault' on Instance uuid 41785a40-a163-4455-8ee5-1353161f2c3b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:17.981847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 20:56:18.091697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.099238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.099958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.122490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.130866 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e13b463-b916-471c-ade4-996b47327a43 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1458 microversion: 2.1 time: 0.276285 Apr 09 20:56:18.131571 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 247/506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:17 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1458 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:18.143866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:18.144564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:18.150893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.151437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.152251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.152781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.332570 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4f53909-ffca-4343-8f7f-c3537bfce8a6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-mdxfv05w" status: 200 len: 2928 microversion: 2.1 time: 0.546417 Apr 09 20:56:18.347226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 260/507] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Apr 9 20:56:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mdxfv05w => generated 2928 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:18.353820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2173615d-cfe8-4145-b84c-5284675c922c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:18.375268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.376351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_groups [None req-2173615d-cfe8-4145-b84c-5284675c922c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Querying cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) for 2 instances {{(pid=141818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 09 20:56:18.378405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2173615d-cfe8-4145-b84c-5284675c922c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.378987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2173615d-cfe8-4145-b84c-5284675c922c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.384940 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-01e9622b-9846-4648-95ee-76355fbee8e9 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.252097 Apr 09 20:56:18.395493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 248/508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:18 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:18.400518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:18.402541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:18.410104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.410785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.413015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.414115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.426370 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2173615d-cfe8-4145-b84c-5284675c922c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/426161ce-ad7e-4226-af71-00baafd1ea21" status: 200 len: 266 microversion: 2.1 time: 0.076571 Apr 09 20:56:18.427447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 261/509] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:56:18 2022] GET /compute/v2.1/os-server-groups/426161ce-ad7e-4226-af71-00baafd1ea21 => generated 266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:18.438724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6845c9ce-97ad-46a6-9d60-17b223d9edaf req-c894e949-e86d-41de-b099-984f2f3c182c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082a1f8a-dbf4-4bc4-8773-874a5d0f41d0", "tag": "bda24322-5977-4986-922a-0fbb3eec9523"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:18.449606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6845c9ce-97ad-46a6-9d60-17b223d9edaf req-c894e949-e86d-41de-b099-984f2f3c182c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.450338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6845c9ce-97ad-46a6-9d60-17b223d9edaf req-c894e949-e86d-41de-b099-984f2f3c182c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.463001 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6845c9ce-97ad-46a6-9d60-17b223d9edaf req-c894e949-e86d-41de-b099-984f2f3c182c service nova] Creating event network-changed:bda24322-5977-4986-922a-0fbb3eec9523 for instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 on nch1-master-1 Apr 09 20:56:18.469461 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6845c9ce-97ad-46a6-9d60-17b223d9edaf req-c894e949-e86d-41de-b099-984f2f3c182c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034965 Apr 09 20:56:18.470646 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 262/510] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:18.476306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:18.477005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:18.487355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.488456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.489976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.490594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.678383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.718413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.720062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:18.721605 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e08fee2e-aecf-4535-ba06-d913b23a3d4a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.324773 Apr 09 20:56:18.734512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 249/511] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:18 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:18.741937 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cefa8da9-1896-4402-9bfa-d4e8b152d652 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 200 len: 1618 microversion: 2.1 time: 0.269407 Apr 09 20:56:18.754077 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 263/512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:18 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 1618 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:18.758169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:18.759627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:18.769954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.770416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:18.773627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:18.774095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.083251 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5dbf74b-c49f-4432-bce0-6c2e6d59e32a tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1619 microversion: 2.1 time: 0.329007 Apr 09 20:56:19.100503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 250/513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:18 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1619 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:19.111084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: .version_select at 0x7fb08f1f1700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-3697497", "policies": ["anti-affinity"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:19.147614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:19.148240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:19.161500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.161980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.162812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.163361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.168541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:19.180017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:19.242957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.243879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.245123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lazy-loading 'fault' on Instance uuid 41785a40-a163-4455-8ee5-1353161f2c3b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:19.283069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:19.289274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:19.302404 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06c858d0-112b-442d-915a-13ffb5d148c1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 190 microversion: 2.1 time: 0.195336 Apr 09 20:56:19.303809 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 264/514] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 20:56:19 2022] POST /compute/v2.1/os-server-groups => generated 190 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:19.404101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:19.405144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:19.419547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.420044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.421013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.421590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.766658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:19.791471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c255c2e-4224-4fe4-adf4-c6ca8211ffa2 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.393455 Apr 09 20:56:19.794960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 265/515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:19 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:19.800747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-767394919", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e008c1d0-8970-4031-b5df-777088fcff3c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:19.806099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111ebd03dde445c99b447894d3ad03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c5c17262b94d898c4aaa03102b4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:19.818549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fd1f2fe-eef3-4d24-a1cd-a2d84453e6aa tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 200 len: 1458 microversion: 2.1 time: 0.674714 Apr 09 20:56:19.821334 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 251/516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:19 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 1458 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:19.830909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:19.834103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:19.853193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.854031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.855042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:19.855582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:19.935098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:20.236852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:20.252002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:20.257825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:20.262228 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec79e279-610d-4c2c-bca0-94b114191244 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.438060 Apr 09 20:56:20.265537 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 252/517] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:19 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:20.289382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:20.294481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:20.317326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:20.323577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:20.324699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:20.325336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:20.385812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:56:20.541440 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb692dab-a961-4252-b43a-a42e06fc374a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 204 len: 0 microversion: 2.1 time: 0.273962 Apr 09 20:56:20.549260 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 253/518] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:20 2022] DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:20.624219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:20.624758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:20.625102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:20.625503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:20.625910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:20.642094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:20.642612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:20.643512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:20.644006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:20.661614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:20.665687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:20.678617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 2 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:20.681233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:20.746835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:20.756241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:20.805573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:20.811422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:20.832330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=27fb7b9d-0282-4585-8686-d923c5652c49,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:20.917517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:20.921963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:20.964423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:20.968545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:21.004207 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d8fc59b-d791-42fe-8b28-bb06b76a972b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.207343 Apr 09 20:56:21.004820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 266/519] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 09 20:56:21.010074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0747b503-6b2e-44f2-a06f-cd20dca4ac43 req-b623a2b7-198f-4b40-a952-98e44bf7ae78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41785a40-a163-4455-8ee5-1353161f2c3b", "name": "network-vif-deleted", "tag": "969f5337-7c13-4c26-82e0-4f6bfc05cdf0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:21.019799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0747b503-6b2e-44f2-a06f-cd20dca4ac43 req-b623a2b7-198f-4b40-a952-98e44bf7ae78 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.020240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0747b503-6b2e-44f2-a06f-cd20dca4ac43 req-b623a2b7-198f-4b40-a952-98e44bf7ae78 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.032190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Action: 'create', calling method: .version_select at 0x7fb08f1c2700>, body: {"keypair": {"name": "tempest-keypair-61839832", "type": "ssh", "user_id": "725920d013a74f9c80e0c1398964d248"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:21.047142 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0747b503-6b2e-44f2-a06f-cd20dca4ac43 req-b623a2b7-198f-4b40-a952-98e44bf7ae78 service nova] Creating event network-vif-deleted:969f5337-7c13-4c26-82e0-4f6bfc05cdf0 for instance 41785a40-a163-4455-8ee5-1353161f2c3b on nch2-master-1 Apr 09 20:56:21.056902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:21.058638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0747b503-6b2e-44f2-a06f-cd20dca4ac43 req-b623a2b7-198f-4b40-a952-98e44bf7ae78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052108 Apr 09 20:56:21.060696 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 267/520] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:21.069124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:21.069827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:21.072353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:21.077927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.079165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.080203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.080899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.292054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:21.301391 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6206930-6309-4e8a-b2b1-188812a615c5 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.237859 Apr 09 20:56:21.302044 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 268/521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:21 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:21.316637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:21.317437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:21.324285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.324991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.326687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.327191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.374987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. Apr 09 20:56:21.375521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:21.376442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-70f9aa84-65a0-43be-a6e9-336c4b88f4a7 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 404 len: 111 microversion: 2.1 time: 0.063817 Apr 09 20:56:21.377280 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 269/522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:21 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:21.398631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-536602182", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "1004132164", "adminPass": "***", "networks": [{"uuid": "fd4e1e04-2e4f-4f58-a730-1ef6a5f38dba"}], "security_groups": [{"name": "tempest-securitygroup--1301942103"}], "key_name": "tempest-keypair-1795275409", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:21.482754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:21.489823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:21.517640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3591523-2042-4b81-8a56-0e52043f9f42 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.10 time: 0.932441 Apr 09 20:56:21.517640 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 254/523] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Apr 9 20:56:20 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 934 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:21.517640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:21.520265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:21.521068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Searching by: {'deleted': False, 'project_id': 'b21b82d625c249269c02db9bbe700c7c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 20:56:21.558303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.558821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.559669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.560183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.586729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] validate_networks() for [('fd4e1e04-2e4f-4f58-a730-1ef6a5f38dba', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:21.606556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 20:56:21.646647 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4751ec2-b5f9-46c7-ad3a-ac2cbd5c9fa3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.134426 Apr 09 20:56:21.647523 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 255/524] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 20:56:21 2022] GET /compute/v2.1/servers => generated 1662 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:21.655001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:21.656156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:21.664010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.664475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.665495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.667730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.932158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:21.944785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:21.946331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:21.952883 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63092e74-88bb-4410-887c-390ef86cbbb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.301372 Apr 09 20:56:21.953983 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 256/525] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:21 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:21.962287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:21.962807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:21.971420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.972216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.974204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:21.975024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:21.999855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. Apr 09 20:56:22.000488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:22.001325 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c202524-a051-4a93-8c57-afe2c82a16c0 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 404 len: 111 microversion: 2.1 time: 0.043085 Apr 09 20:56:22.002377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 257/526] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:21 2022] DELETE /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:22.007267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Action: 'create', calling method: .version_select at 0x7fb08f244b80>, body: {"keypair": {"name": "tempest-keypair-1322701456", "type": "ssh", "user_id": "725920d013a74f9c80e0c1398964d248"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:22.022002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:22.030365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:22.290069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:22.295356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:22.310090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:22.310556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:22.310963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:22.311602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:22.312444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:22.319343 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df9e1ed9-cba1-4e2c-98ff-2091ada91f66 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 0.315659 Apr 09 20:56:22.321175 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 258/527] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Apr 9 20:56:22 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:22.343623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.345602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.346739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:22.347639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.348974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.352810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.362537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.365994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.366902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.367401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.380381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for project 430f19ffcb28429189b8c76282d2077b. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:22.387023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Getting quotas for user 2d51c9bfc0124777b559e1d2cd1e2d50 and project 430f19ffcb28429189b8c76282d2077b. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:22.401264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:22.404122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:22.490698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:22.507046 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bda7446a-23bc-4c26-91ed-57fa2b3fec07 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1214 microversion: 2.1 time: 0.177011 Apr 09 20:56:22.507749 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 259/528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:22 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:22.524608 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c792792-9e87-4f8d-a7f4-053479ecaa2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.130721 Apr 09 20:56:22.532874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 270/529] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:22.538037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.538860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 41785a40-a163-4455-8ee5-1353161f2c3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:22.547412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.549639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.550732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.551569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.567940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. Apr 09 20:56:22.568645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 41785a40-a163-4455-8ee5-1353161f2c3b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:22.569704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-148580c6-8a02-4746-ae7f-b613756ef87c tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b" status: 404 len: 111 microversion: 2.1 time: 0.035630 Apr 09 20:56:22.570773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 271/530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:22 2022] GET /compute/v2.1/servers/41785a40-a163-4455-8ee5-1353161f2c3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:22.578038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.578950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:22.594833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.594833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.594833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.595226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.818926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45e3c015-945d-4c16-9b4d-9534f8fc1800 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.308558 Apr 09 20:56:22.819613 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 260/531] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Apr 9 20:56:22 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 20:56:22.831767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f8190cf-ec7f-4458-b8ab-15749878e27f tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Calling method '.version_select at 0x7fb08f244af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.847793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f8190cf-ec7f-4458-b8ab-15749878e27f tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-61839832?user_id=725920d013a74f9c80e0c1398964d248" status: 200 len: 704 microversion: 2.10 time: 0.026944 Apr 09 20:56:22.850297 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 261/532] 10.222.0.30 () {60 vars in 1333 bytes} [Sat Apr 9 20:56:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-61839832?user_id=725920d013a74f9c80e0c1398964d248 => generated 704 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:22.856936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9960e62d-6468-40b3-8f7c-ded94300549f req-e4347ac4-d08b-4b60-9d94-b7fe435355c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0598b5e7-4a10-4476-a5e7-ff280805e29a", "name": "network-vif-plugged", "status": "completed", "tag": "521e5c23-21e4-4583-a60e-4f4a5fc9cff7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:22.866185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:22.875910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a6a6a4ab-5997-4aa5-bb72-06c094d9070f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.303460 Apr 09 20:56:22.881446 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 272/533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:22 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:22.905136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9960e62d-6468-40b3-8f7c-ded94300549f req-e4347ac4-d08b-4b60-9d94-b7fe435355c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.905585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9960e62d-6468-40b3-8f7c-ded94300549f req-e4347ac4-d08b-4b60-9d94-b7fe435355c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.906738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14ca4f01-ba86-4317-8d7e-64633d0c1d59 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.912064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-14ca4f01-ba86-4317-8d7e-64633d0c1d59 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:22.919258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9960e62d-6468-40b3-8f7c-ded94300549f req-e4347ac4-d08b-4b60-9d94-b7fe435355c1 service nova] Creating event network-vif-plugged:521e5c23-21e4-4583-a60e-4f4a5fc9cff7 for instance 0598b5e7-4a10-4476-a5e7-ff280805e29a on nch1-master-1 Apr 09 20:56:22.924658 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9960e62d-6468-40b3-8f7c-ded94300549f req-e4347ac4-d08b-4b60-9d94-b7fe435355c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071873 Apr 09 20:56:22.925629 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 262/534] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:22.931017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:22.932047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:22.939865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.940643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.942570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:22.943272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:22.959496 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. Apr 09 20:56:22.960470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:22.961588 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4287fd53-a676-463c-8c61-58a16aa9a69a tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 404 len: 111 microversion: 2.1 time: 0.034710 Apr 09 20:56:22.962490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 263/535] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:22 2022] DELETE /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:22.969487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a6f5e0a-4f9d-46ef-bf60-71e81944ad73 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Calling method '.version_select at 0x7fb08f1c2ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:23.036387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14ca4f01-ba86-4317-8d7e-64633d0c1d59 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:23.044202 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14ca4f01-ba86-4317-8d7e-64633d0c1d59 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1264 microversion: 2.1 time: 0.152784 Apr 09 20:56:23.047615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1a6f5e0a-4f9d-46ef-bf60-71e81944ad73 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] HTTP exception thrown: Image not found. Apr 09 20:56:23.048333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a6f5e0a-4f9d-46ef-bf60-71e81944ad73 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:23.049423 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a6f5e0a-4f9d-46ef-bf60-71e81944ad73 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.085704 Apr 09 20:56:23.050333 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 264/536] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 20:56:22 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:23.056369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 273/537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:22 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:23.066258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Action: 'create', calling method: .version_select at 0x7fb08f27dc10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-274197488", "type": "ssh"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:23.079668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:23.080503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] [instance: 2c79f229-9d8b-4e20-b53c-684f5b9afd1f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:23.099526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.100280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:23.101302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.102480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:23.107339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:23.118031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:23.153976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] HTTP exception thrown: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. Apr 09 20:56:23.156376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] Returning 404 to user: Instance 2c79f229-9d8b-4e20-b53c-684f5b9afd1f could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:23.160624 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31810051-f6b9-438f-8e13-40ebcbcfc6d3 tempest-DeleteServersAdminTestJSON-2016667769 tempest-DeleteServersAdminTestJSON-2016667769-project] 10.222.0.30 "GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f" status: 404 len: 111 microversion: 2.1 time: 0.092266 Apr 09 20:56:23.162317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 274/538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:23 2022] GET /compute/v2.1/servers/2c79f229-9d8b-4e20-b53c-684f5b9afd1f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:23.179670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:23.187931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:23.210689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.212939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:23.213907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.216138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:23.479283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:23.483508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Getting quotas for user 0d951617d369462aa17e9b118747131d and project 1eabd8a6f93e416b9084ba5979bcb069. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:23.507562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34e0d79f-cb91-494a-9197-efcc2cffd7a6 tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 0.456031 Apr 09 20:56:23.515930 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 265/539] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 20:56:23 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 465 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:23.522893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d32a3fac-35ef-44cf-abc0-0dc8890d22df tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Calling method '.version_select at 0x7fb08f27d820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:23.560530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d32a3fac-35ef-44cf-abc0-0dc8890d22df tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] HTTP exception thrown: Image not found. Apr 09 20:56:23.561148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d32a3fac-35ef-44cf-abc0-0dc8890d22df tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:23.561971 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d32a3fac-35ef-44cf-abc0-0dc8890d22df tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/0438775c-edb4-49d0-b219-6128be95898j" status: 404 len: 62 microversion: 2.1 time: 0.044782 Apr 09 20:56:23.567199 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 266/540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:23 2022] DELETE /compute/v2.1/images/0438775c-edb4-49d0-b219-6128be95898j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:23.575689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:23.578776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:23.597989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.598814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:23.599616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:23.600059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.013227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.021294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45418b7a-0d2d-4123-a391-a8a8e62ec089 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1276 microversion: 2.1 time: 0.452510 Apr 09 20:56:24.021881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 267/541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:23 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1276 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:24.026227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bdb0a732-1fe3-45b2-84fa-343e0b5c2fef tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Calling method '.version_select at 0x7fb08f27d160>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.028997 ncdv-master-1 devstack@n-api.service[141819]: WARNING oslo_db.sqlalchemy.utils [None req-bdb0a732-1fe3-45b2-84fa-343e0b5c2fef tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 20:56:24.046670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bdb0a732-1fe3-45b2-84fa-343e0b5c2fef tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=725920d013a74f9c80e0c1398964d248" status: 200 len: 1112 microversion: 2.10 time: 0.023705 Apr 09 20:56:24.047913 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 268/542] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Apr 9 20:56:24 2022] GET /compute/v2.1/os-keypairs?user_id=725920d013a74f9c80e0c1398964d248 => generated 1112 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:24.064173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d945f19e-a950-4ca0-bafd-bcd9080c45b0 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Calling method '.version_select at 0x7fb08f2444c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.106414 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d945f19e-a950-4ca0-bafd-bcd9080c45b0 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] HTTP exception thrown: Image not found. Apr 09 20:56:24.107557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d945f19e-a950-4ca0-bafd-bcd9080c45b0 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:24.110874 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d945f19e-a950-4ca0-bafd-bcd9080c45b0 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/1e80c0d7-bae2-479d-af46-74ca772d0ea11" status: 404 len: 62 microversion: 2.1 time: 0.061675 Apr 09 20:56:24.112586 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 269/543] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/images/1e80c0d7-bae2-479d-af46-74ca772d0ea11 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:24.125417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.128159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:24.138247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.139116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.140328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.140988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.148652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.173561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.175547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.176874 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2ddbbba-9c27-4072-b04b-8c11e5e681c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 1.009425 Apr 09 20:56:24.177865 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 275/544] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:23 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:24.558323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.573705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f068820>, body: {"quota_set": {"ram": "5120"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:24.578943 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af469bc9-c620-4e6d-9350-c6cdd829e1f3 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1318 microversion: 2.1 time: 0.463542 Apr 09 20:56:24.581506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 270/545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:24 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:24.594552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42b74057-70bc-44f8-9ad9-d0d950fc6e6a tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Calling method '.version_select at 0x7fb08f27d9d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.624868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42b74057-70bc-44f8-9ad9-d0d950fc6e6a tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-274197488" status: 204 len: 0 microversion: 2.10 time: 0.041479 Apr 09 20:56:24.625734 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 271/546] 10.222.0.30 () {60 vars in 1321 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-274197488 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:24.634944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.635710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:24.644043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.644323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.645382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.645881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.688657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.689335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.691657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:24.692774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:24.795077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b69b76e-fb62-4c59-aecc-82ddd0aaca41 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2" status: 200 len: 240 microversion: 2.36 time: 0.615943 Apr 09 20:56:24.795733 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 276/547] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Apr 9 20:56:24 2022] PUT /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2 => generated 240 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:24.800257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb9ab41c-658d-4933-ba14-df54fe6b54a7 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Calling method '.version_select at 0x7fb08f008e50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.830759 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-fb9ab41c-658d-4933-ba14-df54fe6b54a7 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] HTTP exception thrown: Image not found. Apr 09 20:56:24.831360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb9ab41c-658d-4933-ba14-df54fe6b54a7 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:24.832208 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb9ab41c-658d-4933-ba14-df54fe6b54a7 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-300810451" status: 404 len: 62 microversion: 2.1 time: 0.035542 Apr 09 20:56:24.832739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 277/548] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/images/tempest-invalid-300810451 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:24.841641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38961496-b846-48e6-91fd-c245a3fb332b tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Calling method '.version_select at 0x7fb08f27b280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.860597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:24.874782 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-931d3d98-9315-4cac-9a48-bf2719b90bab tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1322 microversion: 2.1 time: 0.242669 Apr 09 20:56:24.875952 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 272/549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:24 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:24.890567 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38961496-b846-48e6-91fd-c245a3fb332b tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322701456?user_id=725920d013a74f9c80e0c1398964d248" status: 204 len: 0 microversion: 2.10 time: 0.056679 Apr 09 20:56:24.891455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 278/550] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322701456?user_id=725920d013a74f9c80e0c1398964d248 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:24.898432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8c71d62-4f53-4b99-9050-911529cb02a1 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Calling method '.version_select at 0x7fb08f27b550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.901744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Calling method '.version_select at 0x7fb08f1c25e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:24.929302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a8c71d62-4f53-4b99-9050-911529cb02a1 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] HTTP exception thrown: Image not found. Apr 09 20:56:24.930046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8c71d62-4f53-4b99-9050-911529cb02a1 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:24.930886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8c71d62-4f53-4b99-9050-911529cb02a1 tempest-ImagesDeleteNegativeTestJSON-154470374 tempest-ImagesDeleteNegativeTestJSON-154470374-project] 10.222.0.30 "DELETE /compute/v2.1/images/2d2e069a-5c7d-412c-b32f-361eee56e5d2" status: 404 len: 62 microversion: 2.1 time: 0.038509 Apr 09 20:56:24.935332 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 279/551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/images/2d2e069a-5c7d-412c-b32f-361eee56e5d2 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:24.948215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d70a0bd-fc20-4887-a32a-cdfd13f6ca4e tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] Calling method '.version_select at 0x7fb08f008d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:25.002051 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d70a0bd-fc20-4887-a32a-cdfd13f6ca4e tempest-KeyPairsV210TestJSON-1625976139 tempest-KeyPairsV210TestJSON-1625976139-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61839832?user_id=725920d013a74f9c80e0c1398964d248" status: 204 len: 0 microversion: 2.10 time: 0.068914 Apr 09 20:56:25.002957 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 280/552] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Apr 9 20:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61839832?user_id=725920d013a74f9c80e0c1398964d248 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:56:25.039419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:25.040035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:25.055858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.056652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.060991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.067306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.090513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.093494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.095820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.096431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.159710 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fcd2fa4c-f3b6-4367-9b55-753ca2c482e7 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2/detail" status: 200 len: 672 microversion: 2.36 time: 0.279935 Apr 09 20:56:25.162623 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 273/553] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Apr 9 20:56:24 2022] GET /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2/detail => generated 672 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:25.203862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:25.204742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:25.212647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.214651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.215720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.217522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.370987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:25.386778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf50656a-e11a-4649-843d-e9d7bd53b4fb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1276 microversion: 2.1 time: 0.351263 Apr 09 20:56:25.397648 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 281/554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:25 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1276 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:25.404828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a618bcd8-07b3-42eb-92c4-219de5ea74cb req-9b813444-8939-4789-be87-41f84b35d6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3765143e-2819-46e6-94ae-6d26f95a5ef4", "name": "network-vif-deleted", "tag": "5fceff8c-349f-449f-affd-fa4876c4f5d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:25.427561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a618bcd8-07b3-42eb-92c4-219de5ea74cb req-9b813444-8939-4789-be87-41f84b35d6b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.428730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a618bcd8-07b3-42eb-92c4-219de5ea74cb req-9b813444-8939-4789-be87-41f84b35d6b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.466380 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a618bcd8-07b3-42eb-92c4-219de5ea74cb req-9b813444-8939-4789-be87-41f84b35d6b9 service nova] Creating event network-vif-deleted:5fceff8c-349f-449f-affd-fa4876c4f5d7 for instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 on nch1-master-1 Apr 09 20:56:25.473193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a618bcd8-07b3-42eb-92c4-219de5ea74cb req-9b813444-8939-4789-be87-41f84b35d6b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074023 Apr 09 20:56:25.474458 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 282/555] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:25.598676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:25.599483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:25.609324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.613167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.615948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:25.616505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:25.974389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:25.989419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:25.995854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:25.998201 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ee4b4ef-e495-42a7-8b19-bd478bcb8b45 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.806946 Apr 09 20:56:26.000282 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 274/556] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:25 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:26.005973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:26.006978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:26.020277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.020914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.022190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.022984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.239407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:26.252140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-971593cf-bd5f-4920-8c99-06ca8261e6a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1507 microversion: 2.1 time: 0.657596 Apr 09 20:56:26.252801 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 283/557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:25 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:26.279469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f008b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:26.292004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:26.314068 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9dc22db8-cebe-445b-9cc0-9d2ec9e7840e tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1322 microversion: 2.1 time: 0.311289 Apr 09 20:56:26.317144 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 275/558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:26 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:26.390090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-df08f2df-ac9d-4286-9147-bbba9a0dc124 req-5f1dc6e2-d5f9-4127-838e-f4db5f27b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082a1f8a-dbf4-4bc4-8773-874a5d0f41d0", "name": "network-vif-plugged", "status": "completed", "tag": "bda24322-5977-4986-922a-0fbb3eec9523"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:26.415962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df08f2df-ac9d-4286-9147-bbba9a0dc124 req-5f1dc6e2-d5f9-4127-838e-f4db5f27b5d1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.418058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df08f2df-ac9d-4286-9147-bbba9a0dc124 req-5f1dc6e2-d5f9-4127-838e-f4db5f27b5d1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.461746 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-df08f2df-ac9d-4286-9147-bbba9a0dc124 req-5f1dc6e2-d5f9-4127-838e-f4db5f27b5d1 service nova] Creating event network-vif-plugged:bda24322-5977-4986-922a-0fbb3eec9523 for instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 on nch1-master-1 Apr 09 20:56:26.482735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-df08f2df-ac9d-4286-9147-bbba9a0dc124 req-5f1dc6e2-d5f9-4127-838e-f4db5f27b5d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097520 Apr 09 20:56:26.488138 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 276/559] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:26.518623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:26.520290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:26.540800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.541543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.543924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.544631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.868051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.868569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:26.869338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:26.869774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.005510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.007052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.011281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.012334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.160660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50995e3f-0bdf-491f-9753-85dd1ed24867 tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2?user_id=29a45f77c3ed4ea694ee16f6f60b3fc7" status: 200 len: 240 microversion: 2.36 time: 0.902821 Apr 09 20:56:27.164506 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 284/560] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Apr 9 20:56:26 2022] PUT /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2?user_id=29a45f77c3ed4ea694ee16f6f60b3fc7 => generated 240 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:27.176941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:27.177823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:27.192275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.193155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.194190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.195205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.532966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:27.542994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-377901e0-a37f-40d3-894a-d91f5568d61c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 1.053315 Apr 09 20:56:27.554422 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 277/561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:26 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:27.569478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-266e7df6-a28b-4d83-9849-bd24ac10425b tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] Calling method '.version_select at 0x7fb08f232790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:27.881763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-266e7df6-a28b-4d83-9849-bd24ac10425b tempest-QuotasAdminTestV236-116620230 tempest-QuotasAdminTestV236-116620230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2?user_id=29a45f77c3ed4ea694ee16f6f60b3fc7" status: 200 len: 282 microversion: 2.36 time: 0.326181 Apr 09 20:56:27.884995 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 278/562] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Apr 9 20:56:27 2022] GET /compute/v2.1/os-quota-sets/2bc34e0d748942959fc0484c9e0535b2?user_id=29a45f77c3ed4ea694ee16f6f60b3fc7 => generated 282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:27.907001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:27.911908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:27.932902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:27.939626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.949769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:27.952105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.959926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:27.960619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:27.961355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:27.963987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-518458d7-b83e-4774-9253-e23af5224a6d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1361 microversion: 2.25 time: 0.791664 Apr 09 20:56:27.965583 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 285/563] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:27 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1361 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:28.561832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:28.562467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:28.569830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:28.570292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:28.571094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:28.571535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:29.509703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:29.523604 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-924896b9-0886-4155-baf4-ad43fb6d837b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 1.637476 Apr 09 20:56:29.526603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 279/564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:27 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:29.538515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:29.543201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:29.572455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:29.574242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:29.576698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:29.577339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:29.662937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:29.678243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79d170bd-eeb0-4977-94e0-465079b4c3ec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 1.118087 Apr 09 20:56:29.680259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 286/565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:28 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:29.828087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab4ed13e-9ca2-4fa0-9398-7b772f66654f"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:29.830747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:29.843255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:29.843907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:29.844880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:29.848599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:30.290988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:30.302470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:30.304640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:30.306697 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-31b4dc95-bcef-4db8-9dfe-b6479b808a8a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1556 microversion: 2.25 time: 0.776012 Apr 09 20:56:30.307479 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 280/566] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:29 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1556 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:30.832836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd97cae5-e2da-44fa-bb3d-239253b4a3f2 tempest-ListImageFiltersNegativeTestJSON-508962007 tempest-ListImageFiltersNegativeTestJSON-508962007-project] Calling method '.version_select at 0x7fb08f1c2ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:30.891564 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-dd97cae5-e2da-44fa-bb3d-239253b4a3f2 tempest-ListImageFiltersNegativeTestJSON-508962007 tempest-ListImageFiltersNegativeTestJSON-508962007-project] HTTP exception thrown: Image not found. Apr 09 20:56:30.892483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd97cae5-e2da-44fa-bb3d-239253b4a3f2 tempest-ListImageFiltersNegativeTestJSON-508962007 tempest-ListImageFiltersNegativeTestJSON-508962007-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:30.893703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd97cae5-e2da-44fa-bb3d-239253b4a3f2 tempest-ListImageFiltersNegativeTestJSON-508962007 tempest-ListImageFiltersNegativeTestJSON-508962007-project] 10.222.0.30 "GET /compute/v2.1/images/01e3fcae-58f2-4452-bd7d-aa59e8363883" status: 404 len: 62 microversion: 2.1 time: 0.583980 Apr 09 20:56:30.894408 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 281/567] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:56:30 2022] GET /compute/v2.1/images/01e3fcae-58f2-4452-bd7d-aa59e8363883 => generated 62 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:56:30.905691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:30.907536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:30.936856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:30.937614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:30.939341 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c18ccbc-0d9d-4b10-909c-8b175ead36af tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "POST /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116239 Apr 09 20:56:30.940479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:30.941097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:30.943856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 287/568] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 20:56:29 2022] POST /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments => generated 194 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:30.959111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:30.961313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:30.978317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:30.980716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:30.983147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:30.985388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:31.641390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:31.660995 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f117b2b3-ac77-44f5-acd2-2332dd2104a0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 2048 microversion: 2.25 time: 0.765041 Apr 09 20:56:31.662270 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 282/569] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:30 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 2048 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:31.682427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:31.683348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:31.699566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:31.703179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:31.709451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:31.711180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:31.712603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:31.735776 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-09b029d7-a81e-468f-ab21-e67943476caf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.790223 Apr 09 20:56:31.744488 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 288/570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:30 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:31.764558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f5305247-9e5a-4358-8fd8-ada9309b9ae7 req-9d919e77-bb5b-4333-8a4e-bf62ae1f033f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c41e34e-8722-41ec-ae27-9cb25d4642a0", "tag": "60c84a40-994b-44d8-8a03-52559d3ae09d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:31.803201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f5305247-9e5a-4358-8fd8-ada9309b9ae7 req-9d919e77-bb5b-4333-8a4e-bf62ae1f033f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:31.806265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f5305247-9e5a-4358-8fd8-ada9309b9ae7 req-9d919e77-bb5b-4333-8a4e-bf62ae1f033f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:31.846454 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f5305247-9e5a-4358-8fd8-ada9309b9ae7 req-9d919e77-bb5b-4333-8a4e-bf62ae1f033f service nova] Creating event network-changed:60c84a40-994b-44d8-8a03-52559d3ae09d for instance 7c41e34e-8722-41ec-ae27-9cb25d4642a0 on nch1-master-1 Apr 09 20:56:31.865123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f5305247-9e5a-4358-8fd8-ada9309b9ae7 req-9d919e77-bb5b-4333-8a4e-bf62ae1f033f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118659 Apr 09 20:56:31.865844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 289/571] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:31.902233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7813b8fd-03e2-4485-a316-4717d9c52158 req-467c66ae-a040-4570-9c97-f235ba2fd06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fb7b9d-0282-4585-8686-d923c5652c49", "tag": "e8f49318-e089-4c16-97fd-0fed692d65b1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:31.926711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7813b8fd-03e2-4485-a316-4717d9c52158 req-467c66ae-a040-4570-9c97-f235ba2fd06f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:31.927557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7813b8fd-03e2-4485-a316-4717d9c52158 req-467c66ae-a040-4570-9c97-f235ba2fd06f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:31.956345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7813b8fd-03e2-4485-a316-4717d9c52158 req-467c66ae-a040-4570-9c97-f235ba2fd06f service nova] Creating event network-changed:e8f49318-e089-4c16-97fd-0fed692d65b1 for instance 27fb7b9d-0282-4585-8686-d923c5652c49 on nch2-master-1 Apr 09 20:56:31.968779 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7813b8fd-03e2-4485-a316-4717d9c52158 req-467c66ae-a040-4570-9c97-f235ba2fd06f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098488 Apr 09 20:56:31.970809 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 290/572] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:31.981480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:31.990575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:32.006558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.007333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:32.010561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.033608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:32.661146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:32.670478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-572973c8-63b6-43ba-9f1d-a56451c5033e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.998966 Apr 09 20:56:32.683213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 283/573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:31 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:32.757064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:32.757956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:32.766892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.773381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:32.774492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.775349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:32.846224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:32.876935 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-92833dad-671b-4f55-8f87-f7a76bbb9ada tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 2048 microversion: 2.25 time: 0.902026 Apr 09 20:56:32.880685 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 291/574] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:31 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 2048 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:32.898101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:32.900867 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:32.900867 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:32.902875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.903517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:32.905272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:32.905904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.016040 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d438cfc-253b-40ba-8bdb-7602b6f09c9d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.122752 Apr 09 20:56:33.017728 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 292/575] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Apr 9 20:56:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 20:56:33.034703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:33.036181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:33.059116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.061826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.063483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.079899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.205195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:33.218715 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-25f94fd4-1e27-4fa3-b87c-47f2b75ddc05 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.466244 Apr 09 20:56:33.231407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 284/576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:32 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:33.231707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a5e8330-e271-4f54-8baa-6c67a4ad7ee0 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0/action" status: 202 len: 0 microversion: 2.25 time: 0.196317 Apr 09 20:56:33.231707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 293/577] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 20:56:33 2022] POST /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:33.242926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:33.243567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:33.258482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.259011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.261291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.263595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.536081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e3c167f-0ee0-4257-a997-ef1317690e2f tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1613025209", "id": 1881698855, "os-flavor-access:is_public": "False"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:33.538363 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:33.538363 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:33.569993 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e3c167f-0ee0-4257-a997-ef1317690e2f tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.296588 Apr 09 20:56:33.577009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 294/578] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:33 2022] POST /compute/v2.1/flavors => generated 431 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:33.586915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-786d827f-5c42-49d8-a52c-ffc908cdb65d tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a232c53c55c148cd8a689714077f5b97"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:33.588285 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:33.588285 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:33.641394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:33.659120 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ed4ac72-de05-4f2d-bc00-d30cfc7607cc tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 2053 microversion: 2.25 time: 0.426308 Apr 09 20:56:33.659718 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 285/579] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:33 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 2053 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:33.691030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:33.691636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:33.698312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.698800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.699653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.700084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.838543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:33.847424 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aab2edc8-d033-46b5-89de-9b26d867c3f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.160887 Apr 09 20:56:33.848957 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 286/580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:33 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:33.916319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-585803e9-7ace-4de7-9170-830dfe50d566 req-e8e9a689-161a-4bf4-9d0b-4160a57b848c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c612ae-fb61-4249-b814-19a660bc500b", "tag": "c1403504-af69-4de2-91df-e163589ef69b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:33.924548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-585803e9-7ace-4de7-9170-830dfe50d566 req-e8e9a689-161a-4bf4-9d0b-4160a57b848c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:33.924997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-585803e9-7ace-4de7-9170-830dfe50d566 req-e8e9a689-161a-4bf4-9d0b-4160a57b848c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:33.937891 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-585803e9-7ace-4de7-9170-830dfe50d566 req-e8e9a689-161a-4bf4-9d0b-4160a57b848c service nova] Creating event network-changed:c1403504-af69-4de2-91df-e163589ef69b for instance 99c612ae-fb61-4249-b814-19a660bc500b on nch2-master-1 Apr 09 20:56:33.945154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-585803e9-7ace-4de7-9170-830dfe50d566 req-e8e9a689-161a-4bf4-9d0b-4160a57b848c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031852 Apr 09 20:56:33.945433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 287/581] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:33.954258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-786d827f-5c42-49d8-a52c-ffc908cdb65d tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1881698855/action" status: 200 len: 97 microversion: 2.1 time: 0.375832 Apr 09 20:56:33.954862 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 295/582] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Apr 9 20:56:33 2022] POST /compute/v2.1/flavors/1881698855/action => generated 97 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:56:34.240012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:34.240782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:34.250466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.250881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.252189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.252923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.316395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00b19df3-cc0a-47a0-96b2-24e15a22579f tempest-FlavorsAccessTestJSON-1480612387 tempest-FlavorsAccessTestJSON-1480612387-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:34.358846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00b19df3-cc0a-47a0-96b2-24e15a22579f tempest-FlavorsAccessTestJSON-1480612387 tempest-FlavorsAccessTestJSON-1480612387-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.397565 Apr 09 20:56:34.359489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 288/583] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:33 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:34.374173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d386aa44-f2fc-4516-b358-95fcdf2454df tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a232c53c55c148cd8a689714077f5b97"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:34.377572 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:34.377572 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:34.515752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:34.533996 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a3e7ecb8-a63b-4b1e-a4ba-541310cc5596 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.298280 Apr 09 20:56:34.544546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 296/584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:34 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:34.676669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:34.677417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:34.684666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.686012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.687010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.688020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.856928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d386aa44-f2fc-4516-b358-95fcdf2454df tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1881698855/action" status: 200 len: 21 microversion: 2.1 time: 0.486420 Apr 09 20:56:34.865722 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 289/585] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Apr 9 20:56:34 2022] POST /compute/v2.1/flavors/1881698855/action => generated 21 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:56:34.870912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:34.874025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:34.892159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.892854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.893855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:34.894653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:34.969833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:34.994619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c916d2e-c343-49c6-a9d2-1603de4b896a tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 2033 microversion: 2.25 time: 0.318403 Apr 09 20:56:34.996204 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 297/586] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:34 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 2033 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:56:35.001085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c5cc069-7e27-4e3b-bf2c-3b224b10c56e tempest-FlavorsAccessTestJSON-1480612387 tempest-FlavorsAccessTestJSON-1480612387-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.046171 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c5cc069-7e27-4e3b-bf2c-3b224b10c56e tempest-FlavorsAccessTestJSON-1480612387 tempest-FlavorsAccessTestJSON-1480612387-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048750 Apr 09 20:56:35.047611 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 298/587] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:34 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:35.054112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:35.055420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:35.062983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:35.063637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:35.064750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:35.065473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:35.099364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'flavor' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:35.115180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Going to try to live migrate instance to nch2-master-1 {{(pid=141818) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 20:56:35.134091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:35.142155 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5b58da1-b0f1-4b41-adab-15aa983f44e8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.275220 Apr 09 20:56:35.143821 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 290/588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:34 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:35.148766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdc9073b-6793-46ab-b435-2091afbaa9ff tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.149771 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:35.149771 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:35.219152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdc9073b-6793-46ab-b435-2091afbaa9ff tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1881698855" status: 202 len: 0 microversion: 2.1 time: 0.073834 Apr 09 20:56:35.223626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 291/589] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:35 2022] DELETE /compute/v2.1/flavors/1881698855 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:35.233985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43e6a9b0-a07e-463d-8c03-07a6bed97652 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.261301 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43e6a9b0-a07e-463d-8c03-07a6bed97652 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.034443 Apr 09 20:56:35.262797 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 292/590] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:35.282618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-98a645b5-d31f-4cc4-8863-5f875a008cd2 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1034541301", "id": 1313756879, "os-flavor-access:is_public": "False"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:35.284216 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:35.284216 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:35.324462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-98a645b5-d31f-4cc4-8863-5f875a008cd2 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.047640 Apr 09 20:56:35.325100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 293/591] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:35 2022] POST /compute/v2.1/flavors => generated 431 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:35.335653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e808daa-0cdb-418f-bac3-4a5f8d3e05f5 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.336732 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:35.336732 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:35.364082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e808daa-0cdb-418f-bac3-4a5f8d3e05f5 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1313756879/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028332 Apr 09 20:56:35.373921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 294/592] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 20:56:35 2022] GET /compute/v2.1/flavors/1313756879/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:56:35.379135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39824252-e8a2-46ab-a072-ac709b417145 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.420749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39824252-e8a2-46ab-a072-ac709b417145 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1313756879" status: 202 len: 0 microversion: 2.1 time: 0.044615 Apr 09 20:56:35.425621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 295/593] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:56:35 2022] DELETE /compute/v2.1/flavors/1313756879 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:35.432402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48bf35fd-e9d7-439b-a910-65149f3781b4 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.464266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48bf35fd-e9d7-439b-a910-65149f3781b4 tempest-FlavorsAccessTestJSON-1210846975 tempest-FlavorsAccessTestJSON-1210846975-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.037339 Apr 09 20:56:35.466676 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 296/594] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:56:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:35.550656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:35.551674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:35.564024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:35.564761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:35.567248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:35.567892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:35.872502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:35.882184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a3899fd7-a6ac-41ab-b485-7ab111e53856 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.335204 Apr 09 20:56:35.883791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 297/595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:35 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:36.161469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:36.162254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:36.175388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:36.176770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:36.177807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:36.179951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:36.567777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:36.582654 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5d4c85bd-95ae-4a24-82e5-0c18b92b967e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.426248 Apr 09 20:56:36.583452 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 298/596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:36 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:36.900903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:36.901595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:36.911072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:36.913884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:36.915891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:36.917736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:37.616057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:37.625270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39fbbb70-ec84-434e-a22d-a4703401a3b0 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.728830 Apr 09 20:56:37.635529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 299/597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:36 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:38.184164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Calling method '.version_select at 0x7fb08f1c23a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:38.327549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa48e817-bc99-4281-9c2b-3394f1813035 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 20:56:38.331658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Neutron security group aa48e817-bc99-4281-9c2b-3394f1813035 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 20:56:38.332447 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] HTTP exception thrown: Security group aa48e817-bc99-4281-9c2b-3394f1813035 does not exist Apr 09 20:56:38.332447 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-ed9cdcde-a7f4-4056-911f-1bc5877c0a12'] Apr 09 20:56:38.333312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Returning 404 to user: Security group aa48e817-bc99-4281-9c2b-3394f1813035 does not exist Apr 09 20:56:38.333312 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-ed9cdcde-a7f4-4056-911f-1bc5877c0a12'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:38.334395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84685a17-17b0-4318-b809-d6eb4ff347ff tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/aa48e817-bc99-4281-9c2b-3394f1813035" status: 404 len: 194 microversion: 2.1 time: 0.697340 Apr 09 20:56:38.335106 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 300/598] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:56:37 2022] DELETE /compute/v2.1/os-security-groups/aa48e817-bc99-4281-9c2b-3394f1813035 => generated 194 bytes in 699 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:38.341954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:38.343237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:38.362733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:38.363187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:38.367595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:38.368102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:38.709108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:38.717953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f2d0a67-677a-422e-8373-4c6ef7ff7b83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.381663 Apr 09 20:56:38.730150 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 301/599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:38 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:39.065785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d6749498-a0fa-43cf-9611-b4ab03ac0a82"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:39.067421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:39.074629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:39.075431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:39.076423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:39.077060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:39.474377 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] HTTP exception thrown: Volume d6749498-a0fa-43cf-9611-b4ab03ac0a82 could not be found. Apr 09 20:56:39.475835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Returning 400 to user: Volume d6749498-a0fa-43cf-9611-b4ab03ac0a82 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:39.476975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd368895-1f62-40fb-b3e0-087d897914e6 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/ab4ed13e-9ca2-4fa0-9398-7b772f66654f" status: 400 len: 107 microversion: 2.1 time: 0.745408 Apr 09 20:56:39.477863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 302/600] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Apr 9 20:56:38 2022] PUT /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/ab4ed13e-9ca2-4fa0-9398-7b772f66654f => generated 107 bytes in 747 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:56:39.511281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f599160-7828-424b-829b-55d7844e0418 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.029676 Apr 09 20:56:39.514009 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 303/601] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Apr 9 20:56:39 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 20:56:39.920645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2113021154", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6e4c0a84-06ca-42fe-9656-5da4d34fcdb0"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:39.997496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] validate_networks() for [('6e4c0a84-06ca-42fe-9656-5da4d34fcdb0', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:41.306023 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06b3a684-e628-4ae7-b4f0-1836cc5e8a56 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0/action" status: 202 len: 0 microversion: 2.25 time: 6.257038 Apr 09 20:56:41.307333 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 299/602] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 20:56:35 2022] POST /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0/action => generated 0 bytes in 6259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:41.314452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:41.315494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:41.330489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.330489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.330705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.331293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.396330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:41.396913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:41.397529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:41.397967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:41.398381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:41.422353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.422803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.423821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.424259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.450911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:41.457137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for user ceba42e80d7746e4897669084c078c09 and project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:41.476131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:41.479289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:41.539750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd515d9f-af09-4889-90b0-0498ca72eff4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021913 Apr 09 20:56:41.541117 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 304/603] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:41.546688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-35acd8c4-b32d-4c6f-872b-52588b4ff3b8 req-9d3c540d-7bee-48ce-8a98-66b470d77f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c41e34e-8722-41ec-ae27-9cb25d4642a0", "name": "network-vif-plugged", "status": "completed", "tag": "60c84a40-994b-44d8-8a03-52559d3ae09d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:41.561968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-35acd8c4-b32d-4c6f-872b-52588b4ff3b8 req-9d3c540d-7bee-48ce-8a98-66b470d77f3a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.562411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-35acd8c4-b32d-4c6f-872b-52588b4ff3b8 req-9d3c540d-7bee-48ce-8a98-66b470d77f3a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.575710 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-35acd8c4-b32d-4c6f-872b-52588b4ff3b8 req-9d3c540d-7bee-48ce-8a98-66b470d77f3a service nova] Creating event network-vif-plugged:60c84a40-994b-44d8-8a03-52559d3ae09d for instance 7c41e34e-8722-41ec-ae27-9cb25d4642a0 on nch1-master-1 Apr 09 20:56:41.580860 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-35acd8c4-b32d-4c6f-872b-52588b4ff3b8 req-9d3c540d-7bee-48ce-8a98-66b470d77f3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038377 Apr 09 20:56:41.581484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 305/604] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:41.590078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff4428b7-b6f1-4297-8550-983f53e60591 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Calling method '.version_select at 0x7fb08f142e50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:41.757849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:41.772261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee1a0409-0bde-410e-a573-9ff47e190a4d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.463432 Apr 09 20:56:41.773018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 300/605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:41 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:41.782647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:41.790639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:41.805759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.806462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:41.807596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:41.808274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.010208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lazy-loading 'services' on Instance uuid 0598b5e7-4a10-4476-a5e7-ff280805e29a {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:56:42.218552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45487212-d207-4aad-87bd-48652d1a694e tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/ab4ed13e-9ca2-4fa0-9398-7b772f66654f" status: 202 len: 0 microversion: 2.1 time: 0.443981 Apr 09 20:56:42.219521 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 301/606] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 20:56:41 2022] DELETE /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/ab4ed13e-9ca2-4fa0-9398-7b772f66654f => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:56:42.240485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:42.241641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:42.249155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.249856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.251043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.251709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.285173 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff4428b7-b6f1-4297-8550-983f53e60591 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.697060 Apr 09 20:56:42.288251 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 306/607] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 20:56:41 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:42.447400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efc6a501-1bbf-4cdf-b713-f978aceb8601 tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1858830506", "id": 1870531500, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:42.450307 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:42.450307 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:56:42.473537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efc6a501-1bbf-4cdf-b713-f978aceb8601 tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.183778 Apr 09 20:56:42.480603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 307/608] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:56:42 2022] POST /compute/v2.1/flavors => generated 449 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:42.486260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:42.487531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:42.494299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.495046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.496108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.496749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.700975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:42.709660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e5cf647-c2c2-4d71-91b0-31f3583b7fb6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1318 microversion: 2.1 time: 0.488769 Apr 09 20:56:42.710924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 302/609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:42 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:42.726212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:42.727892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:42.742341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.742892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.743911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.744717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.859726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:42.867581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4ba1cc6-c254-4d43-b865-3a5f2e86969a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1207 microversion: 2.1 time: 0.155288 Apr 09 20:56:42.868421 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 303/610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:42 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1207 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:42.873474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:42.874684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:42.890838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.892018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.893067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:42.893660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:42.950125 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0188650e-5204-4f42-b7c9-e979705ad216 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080306 Apr 09 20:56:42.951240 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 304/611] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 20:56:42 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:42.960023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e77c2b8-d83d-41e0-a2c9-22b3445f0b1d tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Calling method '.version_select at 0x7fb08f2cd8b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:42.994310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:43.002620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:43.004324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:43.005694 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-790d0fb8-abd4-45c8-bdd1-2932b5b981f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.523758 Apr 09 20:56:43.006465 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 308/612] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:42 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:43.134549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9d10724-9cca-47d0-afb5-8b703482ccb5 tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.143965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9d10724-9cca-47d0-afb5-8b703482ccb5 tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] 10.222.0.30 "GET /compute/v2.1/flavors/1870531500" status: 200 len: 449 microversion: 2.55 time: 0.136090 Apr 09 20:56:43.144569 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 309/613] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/flavors/1870531500 => generated 449 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:43.150757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.150757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:43.155861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.156309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.157278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.157715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.310145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-5e77c2b8-d83d-41e0-a2c9-22b3445f0b1d tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 20:56:43.311144 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5e77c2b8-d83d-41e0-a2c9-22b3445f0b1d tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] HTTP exception thrown: Insufficient rights for removing default security group. Apr 09 20:56:43.311144 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-03c473a7-8fd7-407d-ab8f-575eb2a63ef9'] Apr 09 20:56:43.311797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e77c2b8-d83d-41e0-a2c9-22b3445f0b1d tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Returning 400 to user: Insufficient rights for removing default security group. Apr 09 20:56:43.311797 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-03c473a7-8fd7-407d-ab8f-575eb2a63ef9'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:43.312897 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e77c2b8-d83d-41e0-a2c9-22b3445f0b1d tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1a287b8c-a72c-4222-b1db-150ca160cff2" status: 400 len: 182 microversion: 2.1 time: 0.357016 Apr 09 20:56:43.313617 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 305/614] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 20:56:42 2022] DELETE /compute/v2.1/os-security-groups/1a287b8c-a72c-4222-b1db-150ca160cff2 => generated 182 bytes in 358 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:56:43.329814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b04e619-8da1-480d-93ef-dbc9006f7ef7 tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] Action: 'update', calling method: .version_select at 0x7fb09581c430>, body: {"flavor": {"description": "new"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:43.350828 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:43.350828 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:43.379308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b04e619-8da1-480d-93ef-dbc9006f7ef7 tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1870531500" status: 200 len: 450 microversion: 2.55 time: 0.055098 Apr 09 20:56:43.380092 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 306/615] 10.222.0.30 () {62 vars in 1218 bytes} [Sat Apr 9 20:56:43 2022] PUT /compute/v2.1/flavors/1870531500 => generated 450 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:56:43.384964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Calling method '.version_select at 0x7fb08f068ca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.691186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b254f64-27e0-499c-a474-9a5c82abd1c5 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 20:56:43.692722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Neutron security group 8b254f64-27e0-499c-a474-9a5c82abd1c5 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 20:56:43.693834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] HTTP exception thrown: Security group 8b254f64-27e0-499c-a474-9a5c82abd1c5 does not exist Apr 09 20:56:43.693834 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-e850f4dc-279d-44e0-b67e-94144c67636f'] Apr 09 20:56:43.694737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Returning 404 to user: Security group 8b254f64-27e0-499c-a474-9a5c82abd1c5 does not exist Apr 09 20:56:43.694737 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-e850f4dc-279d-44e0-b67e-94144c67636f'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:43.697286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ee63b01-655c-4d8d-8737-b10efd7ef5de tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/8b254f64-27e0-499c-a474-9a5c82abd1c5" status: 404 len: 194 microversion: 2.1 time: 0.315688 Apr 09 20:56:43.697892 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 307/616] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/os-security-groups/8b254f64-27e0-499c-a474-9a5c82abd1c5 => generated 194 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:43.710211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e439182e-b497-4e2f-a7c1-164031a0d58f tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.739186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:43.748258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a783b04c-6a9d-455f-b973-5e9d9f1be5b5 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.602600 Apr 09 20:56:43.749134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e439182e-b497-4e2f-a7c1-164031a0d58f tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6596 microversion: 2.55 time: 0.049824 Apr 09 20:56:43.754034 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 310/617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:43.758999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5b126bb1-9bec-4159-a826-47bc3deb0364 req-3c4d184a-1328-4f08-b1d7-38d3a3851291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb7b9d-0282-4585-8686-d923c5652c49", "name": "network-vif-plugged", "status": "completed", "tag": "e8f49318-e089-4c16-97fd-0fed692d65b1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:43.765380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 308/618] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/flavors/detail => generated 6596 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:43.774277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Action: 'update', calling method: .version_select at 0x7fb08efe8d30>, body: {"security_group": {"name": "tempest-sg-698396145", "description": "tempest-description-1404135855"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:43.781090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b126bb1-9bec-4159-a826-47bc3deb0364 req-3c4d184a-1328-4f08-b1d7-38d3a3851291 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.781539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b126bb1-9bec-4159-a826-47bc3deb0364 req-3c4d184a-1328-4f08-b1d7-38d3a3851291 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.805699 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5b126bb1-9bec-4159-a826-47bc3deb0364 req-3c4d184a-1328-4f08-b1d7-38d3a3851291 service nova] Creating event network-vif-plugged:e8f49318-e089-4c16-97fd-0fed692d65b1 for instance 27fb7b9d-0282-4585-8686-d923c5652c49 on nch2-master-1 Apr 09 20:56:43.814052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5b126bb1-9bec-4159-a826-47bc3deb0364 req-3c4d184a-1328-4f08-b1d7-38d3a3851291 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055392 Apr 09 20:56:43.815825 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 311/619] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:43.830251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.835253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:43.843541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0536ac3f-a079-48d7-a45a-7278d1991ea6 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 20:56:43.844338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Neutron security group 0536ac3f-a079-48d7-a45a-7278d1991ea6 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 20:56:43.845168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] HTTP exception thrown: Security group 0536ac3f-a079-48d7-a45a-7278d1991ea6 does not exist Apr 09 20:56:43.845168 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-f0bf148a-45c0-4449-b098-e6978388d335'] Apr 09 20:56:43.846002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] Returning 404 to user: Security group 0536ac3f-a079-48d7-a45a-7278d1991ea6 does not exist Apr 09 20:56:43.846002 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-f0bf148a-45c0-4449-b098-e6978388d335'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:43.847467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-56ea5800-f90c-4bc2-9e1e-3185feab1cd5 tempest-SecurityGroupsNegativeTestJSON-2145183262 tempest-SecurityGroupsNegativeTestJSON-2145183262-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/0536ac3f-a079-48d7-a45a-7278d1991ea6" status: 404 len: 194 microversion: 2.1 time: 0.080552 Apr 09 20:56:43.848258 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 309/620] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Apr 9 20:56:43 2022] PUT /compute/v2.1/os-security-groups/0536ac3f-a079-48d7-a45a-7278d1991ea6 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:43.857823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-923a3498-de51-40a2-9c97-845123514e39 tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.857966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.858846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.859831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.860466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.898247 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-923a3498-de51-40a2-9c97-845123514e39 tempest-FlavorsV255TestJSON-524397545 tempest-FlavorsV255TestJSON-524397545-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.55 time: 0.048674 Apr 09 20:56:43.898881 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 310/621] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:43.907871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:43.907871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:43.933325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.934106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:43.936292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:43.937527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.107419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:44.116787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab7ce4b8-26e0-465e-a91c-809bd36cb10f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1281 microversion: 2.1 time: 0.216825 Apr 09 20:56:44.119666 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 311/622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:44.131279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0adb4544-cf80-40ca-9f3f-b4e3beba177d tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.136318 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:56:44.136318 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:56:44.162704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0adb4544-cf80-40ca-9f3f-b4e3beba177d tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1870531500" status: 202 len: 0 microversion: 2.55 time: 0.040018 Apr 09 20:56:44.163607 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 312/623] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Apr 9 20:56:44 2022] DELETE /compute/v2.1/flavors/1870531500 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:44.170294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.171436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:44.179593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.180154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.181342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.181928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.238742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb759b68-1342-4fbb-aecb-d3c0ed6b80a8 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073885 Apr 09 20:56:44.239544 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 313/624] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 20:56:44 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:56:44.244376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.245282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:44.252553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.253516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.254386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.254971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.285988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:44.297532 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e07eadb6-d26b-4572-90ae-d692a54ad1d5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1467 microversion: 2.1 time: 0.478301 Apr 09 20:56:44.298363 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 312/625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:43 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1467 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:44.314255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38a74943-622d-4a99-a2f4-09fd4879cf4c tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.538358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:44.554746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:44.556293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:44.557817 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17aad031-da9a-4484-8f10-6a14b6529f7b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.316933 Apr 09 20:56:44.558184 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 314/626] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:44 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:44.571297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.590608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:44.600755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.601241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.602048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.602483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.671269 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38a74943-622d-4a99-a2f4-09fd4879cf4c tempest-FlavorsV255TestJSON-1791969896 tempest-FlavorsV255TestJSON-1791969896-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.371605 Apr 09 20:56:44.672229 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 313/627] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:56:44 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:44.678105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7e421a01-c3a7-42fe-aa7d-7704c4feaa0f req-b1472bb6-5365-4e02-a35f-cda09b69b296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082a1f8a-dbf4-4bc4-8773-874a5d0f41d0", "name": "network-vif-unplugged", "status": "completed", "tag": "bda24322-5977-4986-922a-0fbb3eec9523"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:44.697709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7e421a01-c3a7-42fe-aa7d-7704c4feaa0f req-b1472bb6-5365-4e02-a35f-cda09b69b296 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.698661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7e421a01-c3a7-42fe-aa7d-7704c4feaa0f req-b1472bb6-5365-4e02-a35f-cda09b69b296 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.720001 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7e421a01-c3a7-42fe-aa7d-7704c4feaa0f req-b1472bb6-5365-4e02-a35f-cda09b69b296 service nova] Creating event network-vif-unplugged:bda24322-5977-4986-922a-0fbb3eec9523 for instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 on nch1-master-1 Apr 09 20:56:44.728560 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7e421a01-c3a7-42fe-aa7d-7704c4feaa0f req-b1472bb6-5365-4e02-a35f-cda09b69b296 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054515 Apr 09 20:56:44.729807 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 314/628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:44.772908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:44.774207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:44.783664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.785698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:44.787338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:44.789416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.067705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.078210 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f5dcb321-33fa-4c3c-9777-fe0e94bd084b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1318 microversion: 2.1 time: 0.518935 Apr 09 20:56:45.078806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 315/629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:44 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:45.136092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:45.136595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:45.150138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:45.150587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.151388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:45.151867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.317630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.322103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.335037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-32443dfc-91c0-474a-a2fc-fd384030b6bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1269 microversion: 2.1 time: 0.200974 Apr 09 20:56:45.348435 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 316/630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:45 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:45.353611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2c86caf-f8c6-4d62-ab88-1baf068d5a01 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.586189 Apr 09 20:56:45.354373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 315/631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:44 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:45.578090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:45.579001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:45.596985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:45.599320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.600701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:45.601423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.898707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d4133830-e258-4025-ac00-4d7c1e37f40b req-d40bbddc-5244-47d2-8ee9-b52a750c4ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c612ae-fb61-4249-b814-19a660bc500b", "name": "network-vif-plugged", "status": "completed", "tag": "c1403504-af69-4de2-91df-e163589ef69b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:45.908797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d4133830-e258-4025-ac00-4d7c1e37f40b req-d40bbddc-5244-47d2-8ee9-b52a750c4ec4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:45.909620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d4133830-e258-4025-ac00-4d7c1e37f40b req-d40bbddc-5244-47d2-8ee9-b52a750c4ec4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:45.918701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.921859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d4133830-e258-4025-ac00-4d7c1e37f40b req-d40bbddc-5244-47d2-8ee9-b52a750c4ec4 service nova] Creating event network-vif-plugged:c1403504-af69-4de2-91df-e163589ef69b for instance 99c612ae-fb61-4249-b814-19a660bc500b on nch2-master-1 Apr 09 20:56:45.927755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d4133830-e258-4025-ac00-4d7c1e37f40b req-d40bbddc-5244-47d2-8ee9-b52a750c4ec4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033474 Apr 09 20:56:45.929064 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 316/632] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:45.929958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.931619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:45.933004 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76deeccb-3ebd-4388-bd04-0d025508be19 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.360836 Apr 09 20:56:45.933587 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 317/633] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:45 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:46.093503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "46b573ec-b98f-425e-98d5-553e470a3bd5"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:46.095329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:46.102155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.103369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:46.104501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.105136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:46.196534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-467372547", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "1da05a8f-ebf3-4e45-9d7a-9cef918d235f"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:46.203023 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] HTTP exception thrown: Volume 20c79e0c-9a6f-4d67-90b0-17cf422913cc could not be found. Apr 09 20:56:46.203754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] Returning 404 to user: Volume 20c79e0c-9a6f-4d67-90b0-17cf422913cc could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:46.204954 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-885392d5-991b-451c-b442-21e3e43a0c32 tempest-VolumesAdminNegativeTest-1003604384 tempest-VolumesAdminNegativeTest-1003604384-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/20c79e0c-9a6f-4d67-90b0-17cf422913cc" status: 404 len: 109 microversion: 2.1 time: 0.116605 Apr 09 20:56:46.206055 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 318/634] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Apr 9 20:56:46 2022] PUT /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a/os-volume_attachments/20c79e0c-9a6f-4d67-90b0-17cf422913cc => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:46.216866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:46.218211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:46.226515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.227682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:46.228794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.230311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:46.302256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] validate_networks() for [('1da05a8f-ebf3-4e45-9d7a-9cef918d235f', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:46.633077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:46.649453 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69abdf10-c317-4f56-b2a2-6a72a086b2f1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1468 microversion: 2.1 time: 0.441492 Apr 09 20:56:46.651811 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 319/635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:46 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:46.664099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:46.665919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:46.687684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.692402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:46.693748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:46.694566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.043091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:47.052691 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfc52a4c-47b5-45fe-bf7a-24fa994de793 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.398545 Apr 09 20:56:47.064120 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 320/636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:46 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:47.071869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:47.072781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:47.079883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.080580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.081649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.082300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.360382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:47.376781 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7442a064-7636-4c17-9560-c94e1dfa4329 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.310907 Apr 09 20:56:47.380274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 321/637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:47 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:47.390577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:47.390577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:47.390577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:47.391151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:47.392607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:47.400456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:47.407407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:47.408386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Searching by: {'reservation_id': 'r-i9r03z3v', 'deleted': False, 'project_id': 'b21b82d625c249269c02db9bbe700c7c'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 20:56:47.413504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.415681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.416133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.416940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.419454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.420804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.420804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.421105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.493256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Getting quotas for project 66f36ce90faf42d0b8a5ab4024bd3db8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:47.514060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Getting quotas for user d415747d240d49d89c65e45cc3fc810b and project 66f36ce90faf42d0b8a5ab4024bd3db8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:47.557447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:47.563715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:47.579929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 20:56:47.690312 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30b45058-4bde-4086-94b6-e60d199bd99a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759740 Apr 09 20:56:47.695393 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 317/638] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:47.702431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-332bfd0b-e865-43e4-b154-33cd713935d6 req-39697059-a50d-44df-bb09-ec2f65734605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082a1f8a-dbf4-4bc4-8773-874a5d0f41d0", "tag": "bda24322-5977-4986-922a-0fbb3eec9523"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:47.731627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-332bfd0b-e865-43e4-b154-33cd713935d6 req-39697059-a50d-44df-bb09-ec2f65734605 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.732254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-332bfd0b-e865-43e4-b154-33cd713935d6 req-39697059-a50d-44df-bb09-ec2f65734605 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.748555 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-332bfd0b-e865-43e4-b154-33cd713935d6 req-39697059-a50d-44df-bb09-ec2f65734605 service nova] Creating event network-changed:bda24322-5977-4986-922a-0fbb3eec9523 for instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 on nch1-master-1 Apr 09 20:56:47.748871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:47.759506 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-332bfd0b-e865-43e4-b154-33cd713935d6 req-39697059-a50d-44df-bb09-ec2f65734605 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060992 Apr 09 20:56:47.760475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 318/639] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:47.783928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:47.784836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.785307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:47.794649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.795106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.796100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:47.796594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:47.796706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.262282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:48.271405 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11684f11-bd27-4317-bfa4-aa424d5633ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-i9r03z3v" status: 200 len: 2928 microversion: 2.1 time: 0.888463 Apr 09 20:56:48.272239 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 322/640] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Apr 9 20:56:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-i9r03z3v => generated 2928 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:48.277853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fcdfff18-4895-487c-90ee-483b8b76f5ad tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:48.278639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fcdfff18-4895-487c-90ee-483b8b76f5ad tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:48.287611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:48.297266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:48.303117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-19ced0d4-69a9-4f1d-bbb4-c9df9897ea22 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.538609 Apr 09 20:56:48.306204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 319/641] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:47 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:48.333455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-dc7900fb-1862-45f9-9430-e9c3be5760c6 req-6961db47-232c-4c75-9cd5-f1a5b5cb4d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7669d40f-e600-49f8-af5a-b0927eae1fde", "tag": "5a70f221-9817-486d-a4b4-02f831c18d28"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:48.364659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dc7900fb-1862-45f9-9430-e9c3be5760c6 req-6961db47-232c-4c75-9cd5-f1a5b5cb4d60 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.365641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dc7900fb-1862-45f9-9430-e9c3be5760c6 req-6961db47-232c-4c75-9cd5-f1a5b5cb4d60 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.399742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fcdfff18-4895-487c-90ee-483b8b76f5ad tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:48.411006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fcdfff18-4895-487c-90ee-483b8b76f5ad tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1231 microversion: 2.1 time: 0.135769 Apr 09 20:56:48.413360 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-dc7900fb-1862-45f9-9430-e9c3be5760c6 req-6961db47-232c-4c75-9cd5-f1a5b5cb4d60 service nova] Creating event network-changed:5a70f221-9817-486d-a4b4-02f831c18d28 for instance 7669d40f-e600-49f8-af5a-b0927eae1fde on nch1-master-1 Apr 09 20:56:48.421928 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 323/642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:48 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1231 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:48.432112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-dc7900fb-1862-45f9-9430-e9c3be5760c6 req-6961db47-232c-4c75-9cd5-f1a5b5cb4d60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119409 Apr 09 20:56:48.435398 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 320/643] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:48.451400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:48.452173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:48.472080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.476088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.480025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.481540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.705250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:48.706514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.706961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.707774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.708365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.751616 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6509452-76b8-4f1a-bfa0-a0b99733c0e8 tempest-AZV2TestJSON-1485059667 tempest-AZV2TestJSON-1485059667-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.327461 Apr 09 20:56:48.753146 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 324/644] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Apr 9 20:56:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:56:48.769870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b14ab20-5e4c-4e43-8777-c8a841e915dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:48.818471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_groups [None req-2b14ab20-5e4c-4e43-8777-c8a841e915dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Querying cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) for 2 instances {{(pid=141818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 09 20:56:48.819585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b14ab20-5e4c-4e43-8777-c8a841e915dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.820353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b14ab20-5e4c-4e43-8777-c8a841e915dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.856602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b14ab20-5e4c-4e43-8777-c8a841e915dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/e008c1d0-8970-4031-b5df-777088fcff3c" status: 200 len: 268 microversion: 2.1 time: 0.101908 Apr 09 20:56:48.857382 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 325/645] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:56:48 2022] GET /compute/v2.1/os-server-groups/e008c1d0-8970-4031-b5df-777088fcff3c => generated 268 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:48.864034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:48.871222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:48.881249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.881715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.882527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:48.882961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:48.959751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:48.968924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3168e50-e5c1-4a8f-9700-a645582a459f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.531758 Apr 09 20:56:48.981988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 321/646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:48 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:49.026285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.028997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.042153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.042704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.043496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.043928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.102214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:56:49.170969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:49.179687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f99c98c-a00e-421d-9f18-eab99782f6cf tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1390 microversion: 2.1 time: 0.320692 Apr 09 20:56:49.180486 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 326/647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:48 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:49.196470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.197393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.207094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.207851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.208810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.209438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.229719 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f5d242e-9bb3-4920-8f02-69cb0dd76677 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 204 len: 0 microversion: 2.1 time: 0.241404 Apr 09 20:56:49.230238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 322/648] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:56:48 2022] DELETE /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:56:49.240628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.243784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.264140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.264597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.268100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.269156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.431514 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a57d9619-d915-4f91-b8ad-30e6fc243af0 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1619 microversion: 2.1 time: 0.249701 Apr 09 20:56:49.432142 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 327/649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:49 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1619 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:49.444547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.446991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.463981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.464435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.465263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.466985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.501656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:49.513599 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea113237-6a0a-4d4f-9f3d-0d6193c6a33f tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1513 microversion: 2.1 time: 0.278068 Apr 09 20:56:49.514403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 323/650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:49 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:49.532572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.533691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.544289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.545183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.549506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.550113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.693656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:49.703838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dfaa1bb-21db-40a1-9e69-b572793f711c tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1283 microversion: 2.1 time: 0.187940 Apr 09 20:56:49.704441 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 324/651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:49 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:49.717894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:49.718980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:49.729845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.730357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:49.731185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:49.731625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.284788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.300559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.306257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.311323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff9bdad9-a865-4600-851f-feb6cb1c5a48 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.870905 Apr 09 20:56:50.312113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 328/652] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:49 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:50.338637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:50.339312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:50.349467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.349817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.350611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.351046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.363810 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e185595e-c765-40a1-bb76-729716e74707 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1618 microversion: 2.1 time: 0.657691 Apr 09 20:56:50.365081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 325/653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:49 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1618 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:50.370993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:50.371810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:50.378352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.379430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.380406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.381015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.651322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.660685 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-abc63616-fde8-4540-913a-ab66c7c48e76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.333187 Apr 09 20:56:50.662372 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 329/654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:50 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:50.669464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.677665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:50.678287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:50.680552 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-98d7579d-92bc-4f04-bdbd-e7a8137e67cb tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1590 microversion: 2.1 time: 0.313988 Apr 09 20:56:50.682576 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 326/655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:50 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1590 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:50.692764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-567300494", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "acad92b7-b70e-44e1-9c3d-2938f626d037"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:50.695198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.695594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.696457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.696892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.762291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:50.930479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:50.939152 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fac05683-a1a8-427d-8312-8312f91f79a6 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1513 microversion: 2.1 time: 0.275612 Apr 09 20:56:50.939750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 330/656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:50 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:50.948659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:50.948659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:50.951797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.952247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:50.953164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:50.953476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.068579 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40f1757f-82fc-4aed-9923-e8ee9149745a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127245 Apr 09 20:56:51.069312 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 331/657] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 20:56:50 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:51.076526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:51.077574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:51.078648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:51.079072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:51.079508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:51.080064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:51.080634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:51.085250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.085814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.088001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.088735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.092495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.093203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.094816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.098292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.118496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:51.122748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:51.147662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:51.151027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:51.158825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:51.166434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95b15ddc-9350-45d4-933c-b1a4c8fe8621 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1283 microversion: 2.1 time: 0.095328 Apr 09 20:56:51.167215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 332/658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:51 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:51.200074 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9517d4bb-1a0c-4a8c-9db3-5eee547c438b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513901 Apr 09 20:56:51.201360 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 327/659] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:51.212469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05f70ee5-8e61-4a2f-a048-135fd2bc7308 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:51.214335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05f70ee5-8e61-4a2f-a048-135fd2bc7308 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:51.276053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05f70ee5-8e61-4a2f-a048-135fd2bc7308 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:51.284486 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05f70ee5-8e61-4a2f-a048-135fd2bc7308 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1216 microversion: 2.1 time: 0.076537 Apr 09 20:56:51.289204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 328/660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:51 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:51.332119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:51.333075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:51.341351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.342017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.342905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.343454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.391040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-444399477", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:51.455318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:56:51.692887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:51.705547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:51.708222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:51.710077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6df49a4-63f5-4651-bd11-816177343401 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.384336 Apr 09 20:56:51.721288 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 329/661] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:51 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:51.729470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:51.730220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:51.737229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.737945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.739134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.739996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.851613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:56:51.852110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:56:51.852612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:56:51.853125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:56:51.855580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:56:51.878173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.879914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.881266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:51.881933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:51.920383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:56:51.925068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for user 5ab294d1890047aababb87b3a865a14c and project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:56:51.943360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:56:51.948282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:56:52.019624 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b5ae89a-a17e-456c-84f6-fc89b5a48e5d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851179 Apr 09 20:56:52.025697 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 333/662] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:56:52.032791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:52.037485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:52.049725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.050242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.051038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.052561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.053338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.072502 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fccf2ff7-a873-49d9-844c-e31baafa558c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.351422 Apr 09 20:56:52.080311 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 330/663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:51 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:52.085486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7fab077-1161-42f7-b153-5bdbecafc0e5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:52.092579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7fab077-1161-42f7-b153-5bdbecafc0e5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:52.234687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7fab077-1161-42f7-b153-5bdbecafc0e5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.242253 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7fab077-1161-42f7-b153-5bdbecafc0e5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1212 microversion: 2.1 time: 0.160872 Apr 09 20:56:52.252052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 331/664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:52 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:52.257325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:52.258004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:52.265465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.265912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.266698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.267131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.364649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.375677 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8bf3d11-54bc-4389-82da-2685c2df7524 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1289 microversion: 2.1 time: 0.122016 Apr 09 20:56:52.377084 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 332/665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:52 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:52.387811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.395975 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-afd003b5-d612-490b-9ac7-bf3f27c8d315 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1513 microversion: 2.1 time: 0.368596 Apr 09 20:56:52.396872 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 334/666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:52 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:52.399971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:52.401299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:52.415378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.416261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.417675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.418543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.556972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.571162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b8eec02-3b29-4d7a-a026-73d2f6d5f61a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1268 microversion: 2.1 time: 0.189528 Apr 09 20:56:52.571943 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 333/667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:52 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:52.730152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:52.730759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:52.738463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.739302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.740267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:52.740848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:52.980535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.989164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.990882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:52.992024 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e920dc2-284d-47e5-a53a-0afabfc5e43a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.266943 Apr 09 20:56:53.003664 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 335/668] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:52 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:53.097981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:53.098603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:53.105731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.106193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.106984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.107602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.259140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:53.260029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:53.269102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.269842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.271238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.272342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.300583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:53.308988 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-083e6ea5-0f2c-4bf2-9b9c-9857e1fc8d6e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.216506 Apr 09 20:56:53.311659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 334/669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:53 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:53.370303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:53.388091 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8bfae2a-b12b-4e88-98f9-374e8e7822aa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1264 microversion: 2.1 time: 0.131906 Apr 09 20:56:53.388695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 336/670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:53 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:53.397660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:53.397660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:53.409585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.413419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.414765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.415470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:53.415780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.416278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:53.425585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.426082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.426963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.430590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.584686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:53.593858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fea1d5df-ecde-4ca0-a67d-b42504c4c601 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1289 microversion: 2.1 time: 0.204806 Apr 09 20:56:53.594758 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 335/671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:53 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1289 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:53.599563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:53.600164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:53.607454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.609076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.609408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:53.609977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:53.711148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:53.723294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8e53389-f188-4665-bb48-67701418bc83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1274 microversion: 2.1 time: 0.127538 Apr 09 20:56:53.733304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 336/672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:53 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:53.816977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8571042b5f47eea035c6f126d4e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847209629f944fd98aec4c4bbe9a2bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:53.829143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd82d5d8-a43b-48f3-9e69-3419a6981215 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 200 len: 1513 microversion: 2.1 time: 0.418762 Apr 09 20:56:53.830057 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 337/673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:53 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 1513 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:54.011337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:54.015418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:54.041194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.041945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.044690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.047940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.075390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bd1e9517-3de9-4435-ac23-88e4e38ee38b req-d5d2a57e-4f8e-4469-b8f7-cae254e86d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0598b5e7-4a10-4476-a5e7-ff280805e29a", "name": "network-vif-deleted", "tag": "521e5c23-21e4-4583-a60e-4f4a5fc9cff7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:54.101759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd1e9517-3de9-4435-ac23-88e4e38ee38b req-d5d2a57e-4f8e-4469-b8f7-cae254e86d11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.104340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd1e9517-3de9-4435-ac23-88e4e38ee38b req-d5d2a57e-4f8e-4469-b8f7-cae254e86d11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.159551 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bd1e9517-3de9-4435-ac23-88e4e38ee38b req-d5d2a57e-4f8e-4469-b8f7-cae254e86d11 service nova] Creating event network-vif-deleted:521e5c23-21e4-4583-a60e-4f4a5fc9cff7 for instance 0598b5e7-4a10-4476-a5e7-ff280805e29a on nch1-master-1 Apr 09 20:56:54.195379 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bd1e9517-3de9-4435-ac23-88e4e38ee38b req-d5d2a57e-4f8e-4469-b8f7-cae254e86d11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123706 Apr 09 20:56:54.199117 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 338/674] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:54.215065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:54.216098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:54.228079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.237385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.238576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.239180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.631148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:54.651314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:54.660009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:54.661739 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-541faee2-de89-4669-a0f9-9f87ba714d01 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.655397 Apr 09 20:56:54.662344 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 337/675] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:54 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:56:54.673720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:54.677571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:54.693436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.696098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.697004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.697486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.817139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:54.827150 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa9fde97-80f9-4cfb-9636-0444d4f70f40 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1590 microversion: 2.1 time: 0.625753 Apr 09 20:56:54.833961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 339/676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:54 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1590 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:54.843411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:54.844388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:54.862164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.862965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:54.863983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:54.864619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.325306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:55.341445 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0ab854b-8d40-44d7-8f7c-e135f510216a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1270 microversion: 2.1 time: 0.505538 Apr 09 20:56:55.342721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 340/677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:54 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1270 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:55.352377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:55.353389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:55.368671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.371854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.372940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.375588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.523677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:55.535158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fd5f35b-6fd5-459d-82ea-0ec4105fb4d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.871539 Apr 09 20:56:55.538032 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 338/678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:54 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:55.560965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:55.562042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:55.574771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.576334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.581262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.581929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.808388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:55.817098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a6c43b5-cb7a-4b2d-81c8-95cd7e4366c0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.472984 Apr 09 20:56:55.833650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 341/679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:55 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:55.850408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:55.851219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] [instance: 0598b5e7-4a10-4476-a5e7-ff280805e29a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:55.864322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.864981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.868395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.869127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.907102 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] HTTP exception thrown: Instance 0598b5e7-4a10-4476-a5e7-ff280805e29a could not be found. Apr 09 20:56:55.908067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] Returning 404 to user: Instance 0598b5e7-4a10-4476-a5e7-ff280805e29a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:56:55.909188 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-548f9cc0-85be-4863-81a4-ec73f4d313f0 tempest-VolumesAdminNegativeTest-332816096 tempest-VolumesAdminNegativeTest-332816096-project] 10.222.0.30 "GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a" status: 404 len: 111 microversion: 2.1 time: 0.074334 Apr 09 20:56:55.910812 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 342/680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:55 2022] GET /compute/v2.1/servers/0598b5e7-4a10-4476-a5e7-ff280805e29a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:56:55.929348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:55.932595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:55.951651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.952388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:55.954501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:55.956902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.195118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.211643 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5d98d60e-906c-4188-9f9e-b6cf042813bc tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.654810 Apr 09 20:56:56.221116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 339/681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:55 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:56.226354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3b6f12c7-271e-4fb0-9bd9-fc09184abb63 req-35205e70-0eee-4fe0-8cff-a55915bcef73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7669d40f-e600-49f8-af5a-b0927eae1fde", "name": "network-vif-plugged", "status": "completed", "tag": "5a70f221-9817-486d-a4b4-02f831c18d28"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:56.250649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3b6f12c7-271e-4fb0-9bd9-fc09184abb63 req-35205e70-0eee-4fe0-8cff-a55915bcef73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.251090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3b6f12c7-271e-4fb0-9bd9-fc09184abb63 req-35205e70-0eee-4fe0-8cff-a55915bcef73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.279814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3b6f12c7-271e-4fb0-9bd9-fc09184abb63 req-35205e70-0eee-4fe0-8cff-a55915bcef73 service nova] Creating event network-vif-plugged:5a70f221-9817-486d-a4b4-02f831c18d28 for instance 7669d40f-e600-49f8-af5a-b0927eae1fde on nch1-master-1 Apr 09 20:56:56.316015 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3b6f12c7-271e-4fb0-9bd9-fc09184abb63 req-35205e70-0eee-4fe0-8cff-a55915bcef73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090113 Apr 09 20:56:56.320674 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 340/682] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:56.362534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:56.364831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:56.376270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.377024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.379220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.380819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.504846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.514584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.516397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.517671 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3019987a-32ee-43e5-aba0-61fda3588313 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.605685 Apr 09 20:56:56.518311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 343/683] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:55 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:56.523789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4bbbbd21-c83c-4e2b-9fd4-6b089eedbf41 req-9b2e6950-2304-49fd-8d15-5ffb9a6ad5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c612ae-fb61-4249-b814-19a660bc500b", "tag": "c1403504-af69-4de2-91df-e163589ef69b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:56.533674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4bbbbd21-c83c-4e2b-9fd4-6b089eedbf41 req-9b2e6950-2304-49fd-8d15-5ffb9a6ad5c0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.534174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4bbbbd21-c83c-4e2b-9fd4-6b089eedbf41 req-9b2e6950-2304-49fd-8d15-5ffb9a6ad5c0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.546064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.546354 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4bbbbd21-c83c-4e2b-9fd4-6b089eedbf41 req-9b2e6950-2304-49fd-8d15-5ffb9a6ad5c0 service nova] Creating event network-changed:c1403504-af69-4de2-91df-e163589ef69b for instance 99c612ae-fb61-4249-b814-19a660bc500b on nch2-master-1 Apr 09 20:56:56.552208 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4bbbbd21-c83c-4e2b-9fd4-6b089eedbf41 req-9b2e6950-2304-49fd-8d15-5ffb9a6ad5c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032393 Apr 09 20:56:56.553414 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 344/684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:56.561720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:56.562734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:56.566945 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fce21934-752f-403b-95ce-0fac23f1be3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1270 microversion: 2.1 time: 0.211086 Apr 09 20:56:56.569240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 341/685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:56 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:56.583512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.585253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.590105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.594118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.800457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ad373704-1d79-4661-9608-02a2f9cf9a84 req-0fdb3b6c-58f9-4601-8385-51bd6308b418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b1c719-b621-4ea4-a81a-06a089ad7a11", "tag": "2907881a-378f-4e16-ba12-6884a79f972c"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:56.813115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ad373704-1d79-4661-9608-02a2f9cf9a84 req-0fdb3b6c-58f9-4601-8385-51bd6308b418 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.817768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ad373704-1d79-4661-9608-02a2f9cf9a84 req-0fdb3b6c-58f9-4601-8385-51bd6308b418 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.872319 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ad373704-1d79-4661-9608-02a2f9cf9a84 req-0fdb3b6c-58f9-4601-8385-51bd6308b418 service nova] Creating event network-changed:2907881a-378f-4e16-ba12-6884a79f972c for instance b3b1c719-b621-4ea4-a81a-06a089ad7a11 on nch2-master-1 Apr 09 20:56:56.878522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ad373704-1d79-4661-9608-02a2f9cf9a84 req-0fdb3b6c-58f9-4601-8385-51bd6308b418 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081567 Apr 09 20:56:56.879724 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 342/686] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:56:56.890682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:56.892823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:56.910400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.911235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.912545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:56.913212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:56.914036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:56.926430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-988a7d7b-07d1-4336-92b4-1b68b75f06cb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.369236 Apr 09 20:56:56.927307 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 345/687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:56 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:57.227837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:57.228781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:57.235754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.236800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:57.238137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.238772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:57.511033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:57.520759 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48d9c7bb-29e9-467c-9700-3dfdbb93fb77 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.639761 Apr 09 20:56:57.530664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 343/688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:56 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:57.536037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:57.536921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:57.543438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.544167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:57.545401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.546024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:57.667654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:57.683578 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-05ca9ac8-6bd7-4032-be75-077723e5b156 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.457093 Apr 09 20:56:57.695424 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 346/689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:57 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:57.700824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:57.701715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:57.712893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.713810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:57.715220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:57.716426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.163883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:58.175313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:58.191623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:58.192872 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6e97c64-f165-4e33-80b9-1bb6ada99c2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.660901 Apr 09 20:56:58.193484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 344/690] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:57 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:58.198269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:58.200605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:58.208188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.208768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.210736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.211265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.318664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:58.328422 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c5f8753-2fb2-487d-a091-55e4d5b3df25 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.631628 Apr 09 20:56:58.329539 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 347/691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:57 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:58.538078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:58.538953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:58.545607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.546137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.547003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.547656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.802934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:58.811716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d2ef19d-17e6-47e6-b7c1-3cd6d7cbb860 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1311 microversion: 2.1 time: 0.616879 Apr 09 20:56:58.812298 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 345/692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:58 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1311 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:58.825616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f9be3a81-6f25-48a3-9fc0-1f7522516ebc req-85b6cafa-ff49-4b07-b6fc-a98a7a02f260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e790127e-f0b8-47d7-aaf1-1f74b46ecb12", "tag": "ac60c733-ea67-43a5-8253-5a8a19668a37"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:56:58.837692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f9be3a81-6f25-48a3-9fc0-1f7522516ebc req-85b6cafa-ff49-4b07-b6fc-a98a7a02f260 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.838096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f9be3a81-6f25-48a3-9fc0-1f7522516ebc req-85b6cafa-ff49-4b07-b6fc-a98a7a02f260 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.851540 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f9be3a81-6f25-48a3-9fc0-1f7522516ebc req-85b6cafa-ff49-4b07-b6fc-a98a7a02f260 service nova] Creating event network-changed:ac60c733-ea67-43a5-8253-5a8a19668a37 for instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 on nch1-master-1 Apr 09 20:56:58.857424 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f9be3a81-6f25-48a3-9fc0-1f7522516ebc req-85b6cafa-ff49-4b07-b6fc-a98a7a02f260 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043596 Apr 09 20:56:58.858510 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 346/693] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:56:58.864366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:58.865209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:58.872231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.872941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:58.873906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:58.874421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.233471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.243681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65b225e4-fd48-4b50-974c-0aadcb7c3983 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.709488 Apr 09 20:56:59.255106 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 348/694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:58 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:59.264282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:59.265445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:59.269540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.276016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.276769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.277826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.278441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.295363 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d52797f-5ce7-4c0c-b260-b7ccc903b73b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.435326 Apr 09 20:56:59.298207 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 347/695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:58 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:56:59.347192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:59.348178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:59.355798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.356589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.358131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.358567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.718580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.730975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.732403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.733942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48fe4db3-b3ae-49a3-b562-7c05c60c3656 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.477166 Apr 09 20:56:59.734518 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 349/696] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:56:59 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:56:59.776333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:56:59.785834 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-735e28ad-37bc-4745-b41b-7792a5a3efae tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.443501 Apr 09 20:56:59.787501 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 348/697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:59 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:56:59.833268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:56:59.834114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:56:59.843619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.844264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:56:59.845891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:56:59.846519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.126220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:00.139845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a4127675-5c28-4a16-a9b3-9970052798d7 req-d80ce950-d5f3-4ac5-9e81-124978c867bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:00.142679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-718a69d6-237b-4adb-ba44-83d6afc9ed3f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1494 microversion: 2.1 time: 0.316894 Apr 09 20:57:00.145697 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 350/698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:56:59 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1494 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:00.159197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a4127675-5c28-4a16-a9b3-9970052798d7 req-d80ce950-d5f3-4ac5-9e81-124978c867bc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.159644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a4127675-5c28-4a16-a9b3-9970052798d7 req-d80ce950-d5f3-4ac5-9e81-124978c867bc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.177888 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a4127675-5c28-4a16-a9b3-9970052798d7 req-d80ce950-d5f3-4ac5-9e81-124978c867bc service nova] Creating event network-changed:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch1-master-1 Apr 09 20:57:00.183471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a4127675-5c28-4a16-a9b3-9970052798d7 req-d80ce950-d5f3-4ac5-9e81-124978c867bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049506 Apr 09 20:57:00.184664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 349/699] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:00.261980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:00.262678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:00.280264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.280379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.281136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.283584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.357114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:00.358780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:00.372147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.377466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.379343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.382549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.716160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:00.723713 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e49231c9-5583-4715-81e4-5e16fa8dc3ed tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.466304 Apr 09 20:57:00.733921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 350/700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:00 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:00.739373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:00.740347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:00.747701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.748408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.749470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.750110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.907120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-588847d2-6391-4f7d-a2f8-e7464a8b73dc tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1645 microversion: 2.1 time: 0.747815 Apr 09 20:57:00.910599 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 351/701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:00 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1645 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:00.918136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:00.919111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:00.930724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.932440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:00.934540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:00.935235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.217607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:01.234153 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53557ef3-24fd-4fad-b251-d8eab0dccefd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.498621 Apr 09 20:57:01.237312 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 351/702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:00 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:01.244419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:01.257627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:01.260141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:01.260767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:01.262738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:01.263949 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed872352-5768-41b2-9e95-dc41d9a4cfa4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.351487 Apr 09 20:57:01.268137 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 352/703] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:00 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:01.278736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.279472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.281482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:01.281600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.282743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:01.283270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.296260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.297004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.303713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.304982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.790579 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1dff6f3-4738-41db-a1f9-36bdb6778ce3 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1645 microversion: 2.1 time: 0.521107 Apr 09 20:57:01.802792 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 353/704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:01 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1645 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:01.806894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:01.808812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:01.809712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:01.816259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.817125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.818166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.818814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.821064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b337353-99b4-4d69-afcc-fa12b5ddff4c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.581432 Apr 09 20:57:01.821807 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 352/705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:01 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:01.837191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:01.839244 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:57:01.839244 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:57:01.842103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.842788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.843806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.844433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.891947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-44b0b639-ddde-4d69-ba14-67f8dc8e5a13 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.058869 Apr 09 20:57:01.893460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 353/706] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 20:57:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:01.905276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:01.906853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:01.913815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.914566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:01.915599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:01.916252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.008826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lazy-loading 'flavor' on Instance uuid 7669d40f-e600-49f8-af5a-b0927eae1fde {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:02.063594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Going to try to live migrate instance to nch2-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 20:57:02.127816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:02.136023 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23b31db7-ee9a-43d6-b2ba-0f43c50b0567 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.331576 Apr 09 20:57:02.139865 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 354/707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:01 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:02.254616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:02.257593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:02.273837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.276300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.280175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.280718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.477634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:02.488879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ada3c942-ccaa-4447-9db4-d01cc80bd0c4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.239264 Apr 09 20:57:02.489922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 355/708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:02 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:02.495618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:02.496281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:02.503595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.504480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.505649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.506327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.817216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:02.833817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:02.841584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:02.844573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86087f13-0d2d-46d6-88c5-11e9d9462179 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.353456 Apr 09 20:57:02.847206 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 356/709] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:02 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:02.869948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:02.876702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:02.912276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.912982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:02.917504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:02.919472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:03.328460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:03.339130 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89f5ea83-4b03-4ebb-ab48-9bc0ef3b85f9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.489899 Apr 09 20:57:03.339732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 357/710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:02 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:03.353063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:03.353775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:03.394008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:03.394568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:03.395415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:03.395852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:03.782355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:03.797492 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e133647f-65d1-4aeb-9518-b2ffa7ed553a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.453043 Apr 09 20:57:03.798268 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 358/711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:03 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:03.813489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:03.814110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:03.824101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:03.825424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:03.834835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:03.835318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:04.411625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:04.420641 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb7f2620-1699-428d-b3ef-824f7c0fa5bb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.620704 Apr 09 20:57:04.421317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 359/712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:03 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:04.427635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:04.428417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:04.434775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:04.435230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:04.436737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:04.437401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:04.600013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:04.615553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:04.619616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:04.621989 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30c82317-c6f1-4991-b5d1-5be8c0e3e2ed tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1566 microversion: 2.25 time: 0.199180 Apr 09 20:57:04.623854 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 360/713] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:04 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:04.700769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1db49408-4634-468b-a2d5-57e5143d70fc tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:04.710880 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1db49408-4634-468b-a2d5-57e5143d70fc tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.085749 Apr 09 20:57:04.712250 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 361/714] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:57:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:04.718503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:04.719354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:04.744970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:04.749317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:04.755005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:04.756281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:04.986830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b20ec9a-7794-4e85-b53b-f16dae008247 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde/action" status: 202 len: 0 microversion: 2.1 time: 3.085986 Apr 09 20:57:04.991077 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 354/715] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:01 2022] POST /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde/action => generated 0 bytes in 3091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 20:57:04.996493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:04.997137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:05.013686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.015638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.016558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.016993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.153380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:05.162210 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3331e93e-20fa-41e8-a553-54334ace554d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.448506 Apr 09 20:57:05.166352 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 362/716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:04 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:05.174774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:05.175425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:05.190371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.190879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.191623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.192058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.411117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:05.422394 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ebfa2524-ef54-4a48-8b77-88bf4ab173b0 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.430163 Apr 09 20:57:05.432021 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 355/717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:04 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:05.439617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:05.440247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:05.452111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.452727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.454319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.455327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.498081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:05.510309 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f92392e-4754-4523-8617-a9f3f333254c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.341651 Apr 09 20:57:05.511183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 363/718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:05 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:05.634125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-690b3796-ddff-400d-912b-f8d8a12baa0e tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1072429783", "imageRef": "e0105a6d-d098-42d9-876a-4c6594cefd70", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:05.701916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-690b3796-ddff-400d-912b-f8d8a12baa0e tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:05.755606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:05.765984 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c8ae614-9d3b-42d2-83ef-17603f784425 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.331983 Apr 09 20:57:05.766974 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 356/719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:05 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:05.772799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:05.774473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:05.782402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.783330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:05.784437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:05.785182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.091111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:06.100522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:06.102378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:06.103848 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e7c6242-f357-4cd9-9b7f-00d57d115c7e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1541 microversion: 2.25 time: 0.335260 Apr 09 20:57:06.104937 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 357/720] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:05 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1541 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:06.115250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6c97c884-2287-4fe3-982d-5b22906d80d7 req-04ef98d5-33e3-4894-a969-aad875d7e185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e790127e-f0b8-47d7-aaf1-1f74b46ecb12", "name": "network-vif-plugged", "status": "completed", "tag": "ac60c733-ea67-43a5-8253-5a8a19668a37"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:06.138826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6c97c884-2287-4fe3-982d-5b22906d80d7 req-04ef98d5-33e3-4894-a969-aad875d7e185 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.139501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6c97c884-2287-4fe3-982d-5b22906d80d7 req-04ef98d5-33e3-4894-a969-aad875d7e185 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.151523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6c97c884-2287-4fe3-982d-5b22906d80d7 req-04ef98d5-33e3-4894-a969-aad875d7e185 service nova] Creating event network-vif-plugged:ac60c733-ea67-43a5-8253-5a8a19668a37 for instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 on nch1-master-1 Apr 09 20:57:06.161750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6c97c884-2287-4fe3-982d-5b22906d80d7 req-04ef98d5-33e3-4894-a969-aad875d7e185 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055327 Apr 09 20:57:06.162937 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 358/721] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:06.168226 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-690b3796-ddff-400d-912b-f8d8a12baa0e tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] HTTP exception thrown: Flavor's memory is too small for requested image. Apr 09 20:57:06.168852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f36eba5-7348-4a58-b58e-064e032f0a6f tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '.version_select at 0x7fb08f27dc10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:06.171503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f36eba5-7348-4a58-b58e-064e032f0a6f tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.172151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f36eba5-7348-4a58-b58e-064e032f0a6f tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.174464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-690b3796-ddff-400d-912b-f8d8a12baa0e tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:06.175602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-690b3796-ddff-400d-912b-f8d8a12baa0e tempest-FlavorsV2NegativeTest-674741446 tempest-FlavorsV2NegativeTest-674741446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.545435 Apr 09 20:57:06.176209 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 364/722] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:57:05 2022] POST /compute/v2.1/servers => generated 93 bytes in 547 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 20:57:06.183999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f36eba5-7348-4a58-b58e-064e032f0a6f tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1522 microversion: 2.25 time: 0.019485 Apr 09 20:57:06.185374 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 359/723] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Apr 9 20:57:06 2022] GET /compute/v2.1/os-migrations => generated 1522 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:06.194126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:06.196024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:06.200094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:06.202842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:06.213351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.213819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.214626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.215066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.223033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.227828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.229481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.229943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.534134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:06.547155 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-060fa19a-0ac6-4541-8de1-d9c3fcd107de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.366287 Apr 09 20:57:06.560945 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 365/724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:06 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:06.564399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:06.567353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:06.568152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:06.575361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.576123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.577191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.577866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.592380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34d150b2-c0e7-4c05-b539-327cc05f3139 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 2033 microversion: 2.25 time: 0.399071 Apr 09 20:57:06.596476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 360/725] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:06 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 2033 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:06.610310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1917528012", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ecdbeb25-e486-48df-bf84-0d48a4911a8a"}, {"uuid": "be265ed6-bafe-4cf8-b76d-58ec43c2b275"}, {"uuid": "ecdbeb25-e486-48df-bf84-0d48a4911a8a"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:06.716729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] validate_networks() for [('ecdbeb25-e486-48df-bf84-0d48a4911a8a', None, None, None, None, None), ('be265ed6-bafe-4cf8-b76d-58ec43c2b275', None, None, None, None, None), ('ecdbeb25-e486-48df-bf84-0d48a4911a8a', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:06.866553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:06.878483 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60701f66-ff32-4427-b8b0-c9df935d8dcf tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1331 microversion: 2.1 time: 0.314954 Apr 09 20:57:06.880825 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 366/726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:06 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1331 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:06.897990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:06.899907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:06.924928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.925236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:06.926035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:06.926464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:07.278903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:07.306016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e093382a-01c8-4f5a-9e3f-ec252e816263 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.423398 Apr 09 20:57:07.306668 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 367/727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:06 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:07.312209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-166655256", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6f2c6748-eb93-475b-8e01-8a36bd1222c2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:07.380447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] validate_networks() for [('6f2c6748-eb93-475b-8e01-8a36bd1222c2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:08.909265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:57:08.909265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:57:08.909265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:57:08.909265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:57:08.909265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:57:08.920424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:08.921226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:08.922228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:08.922828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:08.946509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:57:08.953323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for user 9c775742dfc04cec8559f9e4d13239b0 and project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:57:08.967891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:57:08.971228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:57:09.059357 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-405b063b-5ce6-430c-ad16-04056a2c3147 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.751443 Apr 09 20:57:09.065706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 368/728] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 20:57:09.073267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:09.074155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:09.084036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.084471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.085707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.086305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.788630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:57:09.789225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:57:09.789825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:57:09.790245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:57:09.790660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:57:09.812059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.812889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.814391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.814996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.880485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Getting quotas for project bf4fe086a6e94378997756b1fc02a6c7. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:57:09.890669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Getting quotas for user 730fd7f2ff9e4e96be5e412ad86bb0d8 and project bf4fe086a6e94378997756b1fc02a6c7. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:57:09.902171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:09.912276 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da9cb93d-81b1-4c29-b188-ca0630056a75 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.843114 Apr 09 20:57:09.912894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:57:09.914556 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 369/729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:09 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:09.915104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:57:09.928151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:09.928768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:09.944194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.945456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.946846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:09.949120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:09.992117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdd1f8b8-2745-42a1-a1d8-fcfd82f710fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.394105 Apr 09 20:57:09.994880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 361/730] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:57:10.006585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:10.008456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:10.024399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.030668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.031948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.032654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.410295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:10.419552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3386eab5-b7ab-4c43-aac2-65dca4da1f34 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.495859 Apr 09 20:57:10.433028 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 370/731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:09 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:10.449535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:10.451591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:10.466454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:10.467637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.468158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.469083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.469581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.477836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-312d8f4e-0e97-4be5-8c3c-c95dcb19b191 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1534 microversion: 2.1 time: 0.479379 Apr 09 20:57:10.480059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 362/732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:09 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1534 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:10.486814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c31017a5-5d14-4d32-b409-40f899d5bf50 req-21cf3717-10f8-4ceb-9285-0814123bbb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b1c719-b621-4ea4-a81a-06a089ad7a11", "name": "network-vif-plugged", "status": "completed", "tag": "2907881a-378f-4e16-ba12-6884a79f972c"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:10.496767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c31017a5-5d14-4d32-b409-40f899d5bf50 req-21cf3717-10f8-4ceb-9285-0814123bbb87 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.498190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c31017a5-5d14-4d32-b409-40f899d5bf50 req-21cf3717-10f8-4ceb-9285-0814123bbb87 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.511071 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c31017a5-5d14-4d32-b409-40f899d5bf50 req-21cf3717-10f8-4ceb-9285-0814123bbb87 service nova] Creating event network-vif-plugged:2907881a-378f-4e16-ba12-6884a79f972c for instance b3b1c719-b621-4ea4-a81a-06a089ad7a11 on nch2-master-1 Apr 09 20:57:10.517147 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c31017a5-5d14-4d32-b409-40f899d5bf50 req-21cf3717-10f8-4ceb-9285-0814123bbb87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034367 Apr 09 20:57:10.518404 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 363/733] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:10.524641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b00dfc28-3bba-47f7-b64b-14277a7aee60 req-6e347a35-69a6-4ca7-b279-92022a7595ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7669d40f-e600-49f8-af5a-b0927eae1fde", "name": "network-vif-unplugged", "status": "completed", "tag": "5a70f221-9817-486d-a4b4-02f831c18d28"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:10.535059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b00dfc28-3bba-47f7-b64b-14277a7aee60 req-6e347a35-69a6-4ca7-b279-92022a7595ad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.536670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b00dfc28-3bba-47f7-b64b-14277a7aee60 req-6e347a35-69a6-4ca7-b279-92022a7595ad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.553498 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b00dfc28-3bba-47f7-b64b-14277a7aee60 req-6e347a35-69a6-4ca7-b279-92022a7595ad service nova] Creating event network-vif-unplugged:5a70f221-9817-486d-a4b4-02f831c18d28 for instance 7669d40f-e600-49f8-af5a-b0927eae1fde on nch1-master-1 Apr 09 20:57:10.560414 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b00dfc28-3bba-47f7-b64b-14277a7aee60 req-6e347a35-69a6-4ca7-b279-92022a7595ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040431 Apr 09 20:57:10.561832 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 364/734] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:10.569647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:10.570622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:10.578537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.579477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.580566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:10.582503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:10.744253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:10.759569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:10.762137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:10.763893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe47dff4-818e-4b3d-b737-cd873e050cbc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1313 microversion: 2.25 time: 0.200606 Apr 09 20:57:10.775459 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 365/735] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:10 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:10.788137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5f9311a-e9e0-4245-b67a-125f4949fd69 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:10.790789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5f9311a-e9e0-4245-b67a-125f4949fd69 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:11.042536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5f9311a-e9e0-4245-b67a-125f4949fd69 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:11.054014 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5f9311a-e9e0-4245-b67a-125f4949fd69 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1213 microversion: 2.1 time: 0.278493 Apr 09 20:57:11.055120 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 366/736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:10 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:11.061295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73be080d-2b4c-47b6-b017-4e3256faaf43 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'create', calling method: .version_select at 0x7fb08f5aa160>, body: {"pool": "bae95fbb-2739-43fa-b1ef-385638f6c878"} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:11.084983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:11.115615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e20eb68-530d-45fd-95df-0fa1444eaee4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.679382 Apr 09 20:57:11.122163 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 371/737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:10 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:11.144588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:11.145340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:11.163826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:11.165513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:11.166858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:11.168606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:11.529009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:11.540308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41bb9cf5-c3c7-4f29-9338-00539c78653c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.412304 Apr 09 20:57:11.542488 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 372/738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:11 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:11.550861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:11.552607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:11.559594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:11.560947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:11.562849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:11.564254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:11.815215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:11.826219 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1c35139-1067-425f-a7bd-a0db31a0ca63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.282392 Apr 09 20:57:11.827447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 373/739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:11 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:12.003614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-410456308", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "78a6d2d3-bb80-48c0-a446-3fd1d832ea3c"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:12.094323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] validate_networks() for [('78a6d2d3-bb80-48c0-a446-3fd1d832ea3c', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:12.762566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:57:12.763233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:57:12.764882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:57:12.770926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:57:12.772499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:57:12.786729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:12.787553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:12.788645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:12.789308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:12.826728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:57:12.833900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for user 33746e27054c4f1db976d4a4ae44e073 and project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:57:12.851705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:57:12.855862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:57:12.933676 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-47042d93-06b0-4d27-afa5-d499d21a0c89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104195 Apr 09 20:57:12.936320 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 374/740] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:57:12.963841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:12.966174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:12.983824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:12.984291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:12.985087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:12.985674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.263619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:13.272724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:13.274259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:13.275439 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49b74316-c335-48f7-90d4-8c9a31e03fe1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.334541 Apr 09 20:57:13.280487 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 375/741] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:12 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:13.285198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:13.285808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:13.297911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.298772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.301378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.302261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.445256 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73be080d-2b4c-47b6-b017-4e3256faaf43 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.388058 Apr 09 20:57:13.455828 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 367/742] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:57:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:13.472139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:13.473120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:13.489779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.490459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.492287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.493082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.519709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:13.530800 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ba9ecdc-fc5d-4eed-8d9f-f313c8e9a058 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1313 microversion: 2.1 time: 0.248916 Apr 09 20:57:13.532058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 376/743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:13 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:13.546856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:13.547527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:13.562611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.563101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.565645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:13.566352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:13.972824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:13.987247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e6d40a2-a343-429e-9e79-85fe57341e82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.524546 Apr 09 20:57:13.988173 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 368/744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:13 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:13.993963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-72a67302-b3e7-480d-9485-a1dbae390f17 req-40a08e68-c21c-4954-8d9c-d3eb9ea87c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7669d40f-e600-49f8-af5a-b0927eae1fde", "tag": "5a70f221-9817-486d-a4b4-02f831c18d28"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:14.002891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.004168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72a67302-b3e7-480d-9485-a1dbae390f17 req-40a08e68-c21c-4954-8d9c-d3eb9ea87c96 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.004774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72a67302-b3e7-480d-9485-a1dbae390f17 req-40a08e68-c21c-4954-8d9c-d3eb9ea87c96 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.011924 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e29577c-b5fd-44ce-8a0d-5abe40b991c7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.478656 Apr 09 20:57:14.016170 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 377/745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:13 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:14.020538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-72a67302-b3e7-480d-9485-a1dbae390f17 req-40a08e68-c21c-4954-8d9c-d3eb9ea87c96 service nova] Creating event network-changed:5a70f221-9817-486d-a4b4-02f831c18d28 for instance 7669d40f-e600-49f8-af5a-b0927eae1fde on nch1-master-1 Apr 09 20:57:14.022410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a02921a5-7090-44a3-898b-c83bfcaea8db req-1744570d-6692-4277-ac02-a8f05c3d7c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "name": "network-vif-plugged", "status": "completed", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:14.026796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-72a67302-b3e7-480d-9485-a1dbae390f17 req-40a08e68-c21c-4954-8d9c-d3eb9ea87c96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036432 Apr 09 20:57:14.027883 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 369/746] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:14.033373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a02921a5-7090-44a3-898b-c83bfcaea8db req-1744570d-6692-4277-ac02-a8f05c3d7c9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.033830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a02921a5-7090-44a3-898b-c83bfcaea8db req-1744570d-6692-4277-ac02-a8f05c3d7c9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.041849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:14.042972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:14.045696 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a02921a5-7090-44a3-898b-c83bfcaea8db req-1744570d-6692-4277-ac02-a8f05c3d7c9d service nova] Creating event network-vif-plugged:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch1-master-1 Apr 09 20:57:14.050012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.050669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.051551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.052015 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a02921a5-7090-44a3-898b-c83bfcaea8db req-1744570d-6692-4277-ac02-a8f05c3d7c9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Apr 09 20:57:14.052302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.052969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 378/747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:14.059635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:14.060526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:14.072297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.073008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.074006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.077981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.261549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.271008 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e04c73e1-90e7-4662-ba40-9cc3b0e5fdb6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1211 microversion: 2.1 time: 0.216667 Apr 09 20:57:14.272470 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 379/748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:14 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1211 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:14.277130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dee159c9-0451-4f32-b4ab-d94ed6ed4093 req-b8ae6b57-42a5-47f7-a0a5-7e16836d966d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e461201-9323-4eed-a58c-bfd395b8913f", "tag": "146c43f4-1b2c-4bf3-bc91-df1e1247e407"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:14.285279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dee159c9-0451-4f32-b4ab-d94ed6ed4093 req-b8ae6b57-42a5-47f7-a0a5-7e16836d966d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.285747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dee159c9-0451-4f32-b4ab-d94ed6ed4093 req-b8ae6b57-42a5-47f7-a0a5-7e16836d966d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.297366 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dee159c9-0451-4f32-b4ab-d94ed6ed4093 req-b8ae6b57-42a5-47f7-a0a5-7e16836d966d service nova] Creating event network-changed:146c43f4-1b2c-4bf3-bc91-df1e1247e407 for instance 6e461201-9323-4eed-a58c-bfd395b8913f on nch1-master-1 Apr 09 20:57:14.302474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dee159c9-0451-4f32-b4ab-d94ed6ed4093 req-b8ae6b57-42a5-47f7-a0a5-7e16836d966d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028771 Apr 09 20:57:14.303274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 380/749] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:14.309264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: .version_select at 0x7fb09581c8b0>, body: {"addFloatingIp": {"address": "172.35.0.59"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:14.310652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:14.316721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.317314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.318096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.318522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.385920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Acquired lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:57:14.547274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.555758 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-806b8e04-e60a-47d8-81d0-77e32742f325 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.526684 Apr 09 20:57:14.556539 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 370/750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:14 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:14.561575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:14.562339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:14.569657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.570341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.571314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.571748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.845391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.854232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.855761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:14.856876 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5bad7cc-f150-4881-949e-d90fa20dc2a4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.299194 Apr 09 20:57:14.857796 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 371/751] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:14 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:14.876793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:14.877436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:14.883464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.884153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:14.884920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:14.885386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.121242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:15.129300 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f26ba408-bb19-4d3f-8000-9f9a78b33e1e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1334 microversion: 2.1 time: 0.256249 Apr 09 20:57:15.129973 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 372/752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:14 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1334 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:15.134406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:15.135126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:15.141280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.141740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.142527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.142964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.381482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:15.389843 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-308a94a0-fca9-407b-a772-1afa8901c34a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.258858 Apr 09 20:57:15.390438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 373/753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:15 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:15.399236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:15.399236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:15.401625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.402065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.402879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.403345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.613294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:15.621186 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70cef464-0aca-425b-aff0-a97a51fc2cb9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.229730 Apr 09 20:57:15.621778 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 374/754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:15 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:15.626404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:15.627010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:15.632900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.633396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.634167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.634601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.729276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:15.738089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2279489b-7c7e-46bd-b3ee-6872ff111e8a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1211 microversion: 2.1 time: 0.115296 Apr 09 20:57:15.738697 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 375/755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:15 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:15.743218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:15.743848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:15.750185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.750639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:15.751415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:15.751836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:16.053903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:16.062723 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0687adf9-243b-4109-80b4-34e513ba05b5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1312 microversion: 2.1 time: 0.323033 Apr 09 20:57:16.073297 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 376/756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:15 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:16.079873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:16.080774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:16.088829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:16.089796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:16.091441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:16.092090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:16.444880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 20:57:16.743355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:16.754376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:16.755347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:16.765944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ade070cc-bd2e-487e-b51d-572d148f96c2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.691141 Apr 09 20:57:16.766564 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 377/757] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:16 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:16.771439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:16.772247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:16.790203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:16.790970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:16.791926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:16.792517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.342267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:17.350406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a400cbc4-fbbd-4b93-a970-52b78148121b tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.582579 Apr 09 20:57:17.351006 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 378/758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:16 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:17.367284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:17.368163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:17.388364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.389144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.390265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.390699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.739351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:17.749083 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd85230c-1df6-409c-97c7-8ed84c4f59a8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.391479 Apr 09 20:57:17.749930 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 379/759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:17 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:17.754842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5a4e0964-963f-4dd3-a3a3-0aa19821dbe7 req-3b68e51e-a85b-4f18-8975-1f0a40de3d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e790127e-f0b8-47d7-aaf1-1f74b46ecb12", "tag": "ac60c733-ea67-43a5-8253-5a8a19668a37"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:17.764726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5a4e0964-963f-4dd3-a3a3-0aa19821dbe7 req-3b68e51e-a85b-4f18-8975-1f0a40de3d4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.765292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5a4e0964-963f-4dd3-a3a3-0aa19821dbe7 req-3b68e51e-a85b-4f18-8975-1f0a40de3d4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.780594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Updating instance_info_cache with network_info: [{"id": "ac60c733-ea67-43a5-8253-5a8a19668a37", "address": "fa:16:3e:cb:02:eb", "network": {"id": "1da05a8f-ebf3-4e45-9d7a-9cef918d235f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-16454680-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "66f36ce90faf42d0b8a5ab4024bd3db8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapac60c733-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 20:57:17.784606 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5a4e0964-963f-4dd3-a3a3-0aa19821dbe7 req-3b68e51e-a85b-4f18-8975-1f0a40de3d4a service nova] Creating event network-changed:ac60c733-ea67-43a5-8253-5a8a19668a37 for instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 on nch1-master-1 Apr 09 20:57:17.789969 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5a4e0964-963f-4dd3-a3a3-0aa19821dbe7 req-3b68e51e-a85b-4f18-8975-1f0a40de3d4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Apr 09 20:57:17.790924 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 380/760] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:17.796581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:17.797766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:17.801460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Releasing lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:57:17.802966 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a08374ec-ea48-4b36-ab35-23c1c4c79b54 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 202 len: 0 microversion: 2.1 time: 3.497860 Apr 09 20:57:17.804757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.805262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.806106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.806559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.808314 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 381/761] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:14 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 0 bytes in 3504 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 20:57:17.813881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:17.820532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:17.838339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.838871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.840037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.841311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.953133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:17.961160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b915ff74-0fdb-47f1-9990-a887c5fc6be0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1211 microversion: 2.1 time: 0.151600 Apr 09 20:57:17.962036 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 382/762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:17 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:17.966906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:17.967752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:17.974118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.974582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:17.975406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:17.975849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:18.171113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:18.182287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9a989d1-58ec-4f81-9b13-ae19b31040a1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.388930 Apr 09 20:57:18.183278 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 381/763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:17 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:18.189239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9dcd51b7-01ef-47ba-9733-cfc2f16dbf72 req-f72273a8-4f95-415e-84ee-e1a1ffa1b19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "tag": "60d92665-fc5a-43fc-bc50-586bc08179bc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:18.201313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:18.202519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9dcd51b7-01ef-47ba-9733-cfc2f16dbf72 req-f72273a8-4f95-415e-84ee-e1a1ffa1b19c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:18.203094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9dcd51b7-01ef-47ba-9733-cfc2f16dbf72 req-f72273a8-4f95-415e-84ee-e1a1ffa1b19c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:18.218295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7a123e1a-770c-473d-9f8c-c4de1fcc3756 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1462 microversion: 2.1 time: 0.254996 Apr 09 20:57:18.230467 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 383/764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:17 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1462 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:18.232138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9dcd51b7-01ef-47ba-9733-cfc2f16dbf72 req-f72273a8-4f95-415e-84ee-e1a1ffa1b19c service nova] Creating event network-changed:60d92665-fc5a-43fc-bc50-586bc08179bc for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:18.238527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:18.240136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:18.246162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9dcd51b7-01ef-47ba-9733-cfc2f16dbf72 req-f72273a8-4f95-415e-84ee-e1a1ffa1b19c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060882 Apr 09 20:57:18.246785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 382/765] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:18.249913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:18.250365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:18.252037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9eb22167-2225-4588-a52d-f5eded0d0f66 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'create', calling method: .version_select at 0x7fb08f5aa700>, body: {"pool": "bae95fbb-2739-43fa-b1ef-385638f6c878"} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:18.254753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:18.258238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:18.881921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:18.905380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:18.907103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:18.908254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa430af2-b492-4859-9296-8fe695439fb9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.675863 Apr 09 20:57:18.919737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 384/766] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:18 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:19.148884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:19.149628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:19.157246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:19.157790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:19.158716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:19.159217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:20.286792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8baacad3-849f-437b-b16f-814abc1ea597 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1613 microversion: 2.1 time: 1.376808 Apr 09 20:57:20.298501 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 385/767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:18 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1613 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:20.303986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:20.304109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:20.309977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:20.310406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:20.311258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:20.311686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:20.727689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:20.745079 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed755e5d-d274-4d10-b4e2-30e0652535ca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.445378 Apr 09 20:57:20.745669 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 386/768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:20 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:20.750926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:20.751601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:20.762226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:20.762816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:20.763696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:20.764260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:21.085395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:21.094513 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9dc6749-9a9e-48ae-99fa-1028d03122ec tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.347136 Apr 09 20:57:21.095104 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 387/769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:20 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:21.099593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:21.100560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:21.106165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:21.106615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:21.107737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:21.108169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:21.803962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:21.811979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-708d0b28-a11c-4afa-a4f4-f706507394cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.715874 Apr 09 20:57:21.812553 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 388/770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:21 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:21.817080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:21.817680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:21.823636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:21.824074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:21.824852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:21.825311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.225248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:22.233895 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87c16a0e-b3ae-48ae-8289-b2dd5a8a03d2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.420329 Apr 09 20:57:22.234502 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 389/771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:21 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:22.239165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:22.239770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:22.246563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.247017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.247792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.248255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.702261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:22.710849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:22.712389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:22.713475 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e8d19d14-68b3-4c38-a632-ad267c15321c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.478002 Apr 09 20:57:22.714102 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 390/772] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:22 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:22.718640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:22.719261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:22.725614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.726068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.726855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.727302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.727409 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9eb22167-2225-4588-a52d-f5eded0d0f66 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.479162 Apr 09 20:57:22.734899 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 383/773] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:57:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:22.739716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "tag": "def9022b-7d87-4418-903a-3af11e1cabd4"}, {"name": "network-changed", "server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "tag": "ab588df9-e032-4e8b-863a-e6633f9e2b3a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:22.749291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.749851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.762471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] Creating event network-changed:def9022b-7d87-4418-903a-3af11e1cabd4 for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:22.763075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] Creating event network-changed:ab588df9-e032-4e8b-863a-e6633f9e2b3a for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:22.768376 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c916e1ee-c874-4b0d-9d0d-88d455d6182c req-aecd62f9-62e5-4aab-905c-a7b76b8452e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032216 Apr 09 20:57:22.769391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 384/774] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:22.776858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3f5705d7-bcd6-4a8c-9a48-2d721347887d req-071df616-4ba4-4c76-aab8-b3684fa3f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e461201-9323-4eed-a58c-bfd395b8913f", "name": "network-vif-plugged", "status": "completed", "tag": "146c43f4-1b2c-4bf3-bc91-df1e1247e407"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:22.785320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3f5705d7-bcd6-4a8c-9a48-2d721347887d req-071df616-4ba4-4c76-aab8-b3684fa3f3f8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.785907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3f5705d7-bcd6-4a8c-9a48-2d721347887d req-071df616-4ba4-4c76-aab8-b3684fa3f3f8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.797224 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3f5705d7-bcd6-4a8c-9a48-2d721347887d req-071df616-4ba4-4c76-aab8-b3684fa3f3f8 service nova] Creating event network-vif-plugged:146c43f4-1b2c-4bf3-bc91-df1e1247e407 for instance 6e461201-9323-4eed-a58c-bfd395b8913f on nch1-master-1 Apr 09 20:57:22.800879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0997b8a27edd4cc88479af11c71e53e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2f1362b9454910aca78105376f906b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:22.801395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] flavor_id is None. Assuming migration. {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 09 20:57:22.801815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 20:57:22.802055 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3f5705d7-bcd6-4a8c-9a48-2d721347887d req-071df616-4ba4-4c76-aab8-b3684fa3f3f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 Apr 09 20:57:22.802662 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 385/775] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:22.808523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:22.809266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:22.815777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.816233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:22.817016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:22.817478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.096685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:23.104509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26881df4-bd39-4d50-926a-8a2d4282ed47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.300122 Apr 09 20:57:23.105388 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 386/776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:22 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:23.111410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:23.112598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:23.119384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.119828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.120630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.121083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.170855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d825cd3d-e67c-489c-8aed-608d2293b230 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf/action" status: 202 len: 0 microversion: 2.1 time: 0.455478 Apr 09 20:57:23.171762 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 391/777] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:22 2022] POST /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:57:23.177167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.137"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:23.178395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:23.185774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.186583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.186992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.187417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.212441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Acquired lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:57:23.397123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:23.407236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efac2443-b3c8-4a6e-9782-5d3b86fc0b76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.299630 Apr 09 20:57:23.408246 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 387/778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:23 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:23.415259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:23.416910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:23.434620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.435474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.436427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.436950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.832759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:23.841591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f81fc317-dacf-47f0-86fc-3cfab5a029cc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.431754 Apr 09 20:57:23.851305 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 388/779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:23 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:23.851305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:23.851305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:23.860973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.861460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:23.862253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:23.862695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.016537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.0.137 (9148e0c4-f1bc-43dc-b29d-bab643127ef4) with port ac60c733-ea67-43a5-8253-5a8a19668a37 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network bae95fbb-2739-43fa-b1ef-385638f6c878.", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 20:57:24.017276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Releasing lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:57:24.017926 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] HTTP exception thrown: Cannot associate floating IP 172.35.0.137 (9148e0c4-f1bc-43dc-b29d-bab643127ef4) with port ac60c733-ea67-43a5-8253-5a8a19668a37 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network bae95fbb-2739-43fa-b1ef-385638f6c878. Apr 09 20:57:24.017926 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-d94ae9cf-4c04-4562-a302-5a11cbe3f14f'] Apr 09 20:57:24.018635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Returning 400 to user: Cannot associate floating IP 172.35.0.137 (9148e0c4-f1bc-43dc-b29d-bab643127ef4) with port ac60c733-ea67-43a5-8253-5a8a19668a37 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network bae95fbb-2739-43fa-b1ef-385638f6c878. Apr 09 20:57:24.018635 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-d94ae9cf-4c04-4562-a302-5a11cbe3f14f'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:24.019715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38fe626a-5bd5-4e2e-8f8f-70873dc0b8d9 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 400 len: 382 microversion: 2.1 time: 0.846963 Apr 09 20:57:24.023752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 392/780] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:23 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 382 bytes in 851 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:57:24.032567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:24.033514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:24.041161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.041634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.042514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.042933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.145188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:24.153725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd30462e-534e-423e-afc1-3da70779bee3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1471 microversion: 2.1 time: 0.310221 Apr 09 20:57:24.154610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 389/781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:23 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:24.159403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e710c3e8-2a51-452d-a6be-1d825e5f0b87 req-685b3979-d366-489d-8868-8c21e9186f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de66be7a-97fe-4f7d-94fb-645e9b367f42", "tag": "765d63be-a291-4796-9abd-dd6dc3afb689"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:24.169286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e710c3e8-2a51-452d-a6be-1d825e5f0b87 req-685b3979-d366-489d-8868-8c21e9186f21 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.169850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e710c3e8-2a51-452d-a6be-1d825e5f0b87 req-685b3979-d366-489d-8868-8c21e9186f21 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.182736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e710c3e8-2a51-452d-a6be-1d825e5f0b87 req-685b3979-d366-489d-8868-8c21e9186f21 service nova] Creating event network-changed:765d63be-a291-4796-9abd-dd6dc3afb689 for instance de66be7a-97fe-4f7d-94fb-645e9b367f42 on nch2-master-1 Apr 09 20:57:24.188055 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e710c3e8-2a51-452d-a6be-1d825e5f0b87 req-685b3979-d366-489d-8868-8c21e9186f21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Apr 09 20:57:24.189259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 390/782] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:24.194870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:24.195610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:24.203390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.204003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.205132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.205759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.732534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:24.740381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90dc0893-6ba6-4396-bd02-6f3259cd89ce tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.715355 Apr 09 20:57:24.740936 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 393/783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:24 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:24.745575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31657d4d-4a22-4f73-b4e9-806e7aeb1da1 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '.version_select at 0x7fb08ee72940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:24.817125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:24.826011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:24.827519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:24.828634 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2dcee8c9-3504-4200-86f3-841c741d1c5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1361 microversion: 2.25 time: 0.638027 Apr 09 20:57:24.829234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 391/784] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:24 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1361 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:24.833554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:24.834139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:24.840240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.840677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:24.841490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:24.841927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.195665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:25.203393 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3a08232-cd57-4fb1-bfa8-cdb20f73cbe3 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.373191 Apr 09 20:57:25.203976 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 392/785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:24 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:25.213625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:25.213625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:25.216252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.216674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.217529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.217986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.479103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:25.487448 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64feb44a-6921-47d9-a27a-c9e61baf2a9e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.282527 Apr 09 20:57:25.488132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 393/786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:25 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:25.492720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:25.493462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:25.499294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.499739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.500539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.500969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.921947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:25.931116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1d85b4f-c2f4-4156-ab4d-fdb9b0c3de05 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.441761 Apr 09 20:57:25.931871 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 394/787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:25 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:25.936630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:25.937327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:25.946349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.947096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:25.947859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:25.948292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:26.612417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:26.636476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fae228c5-138e-489e-81dc-4a3b7258f5c3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1471 microversion: 2.1 time: 0.703548 Apr 09 20:57:26.637115 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 395/788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:25 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1471 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:26.640200 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31657d4d-4a22-4f73-b4e9-806e7aeb1da1 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/9148e0c4-f1bc-43dc-b29d-bab643127ef4" status: 202 len: 0 microversion: 2.1 time: 1.898178 Apr 09 20:57:26.644026 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 394/789] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:57:24 2022] DELETE /compute/v2.1/os-floating-ips/9148e0c4-f1bc-43dc-b29d-bab643127ef4 => generated 0 bytes in 1899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:57:26.651614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:26.653319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:26.654330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:26.657384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:26.664770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:26.664976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:26.665414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:26.666162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:26.666290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:26.666970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:26.667612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:26.668258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.000209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.010617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.011027 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b44fc538-363a-4264-8dc7-8ef531662a16 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.372831 Apr 09 20:57:27.011795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 396/790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:26 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:27.017925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:27.018615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:27.025109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.025422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.025952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.026844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.027573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.028456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.029914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b29e85d2-2fb5-46be-bff5-335d7fe31feb tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1556 microversion: 2.25 time: 0.387816 Apr 09 20:57:27.043866 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 395/791] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:26 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1556 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:27.050065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:27.051104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:27.060540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.061518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.063164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.064429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.324182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.331972 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ac923b6-1229-45b2-9bf4-ab55d50b2e47 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.318995 Apr 09 20:57:27.334239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.341848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 397/792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:27 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:27.344976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66a4a51c-90c5-45e0-b474-c9a43a2789bb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.299661 Apr 09 20:57:27.345599 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 396/793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:27 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:27.347234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: .version_select at 0x7fb0958ce040>, body: {"removeFloatingIp": {"address": "172.35.0.59"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:27.350041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:27.350649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:27.369853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.370299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.371085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.371518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.712141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:27.718594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.719047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.719866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.720352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.786000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:27.794234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa315734-2a77-44a6-93b5-7e904c8c1cdb tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.447652 Apr 09 20:57:27.803471 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 397/794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:27 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:27.803471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:27.803471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:27.806328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.806787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:27.807561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:27.808112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.133145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:28.150282 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-794a56bb-4f68-4849-a25f-1ef6f12c5daf tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 2048 microversion: 2.25 time: 0.354074 Apr 09 20:57:28.150996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 398/795] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:27 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 2048 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:28.158554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:28.159389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:28.166040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.166493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.167777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.167777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.192406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Acquired lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:57:28.495858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:28.503526 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae1ee6f3-6024-430b-82b3-a74b5cf74ad1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.351384 Apr 09 20:57:28.504102 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 399/796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:28 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:28.508579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:28.509256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:28.515544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.516006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.516773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.517250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.770966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:28.778454 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86a616e3-4a85-4769-8aea-0d9c92902beb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.273397 Apr 09 20:57:28.779008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 400/797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:28 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:28.783588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:28.784947 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:57:28.784947 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:57:28.786202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.786787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.787449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.787933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.811623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-74d598f6-6720-4908-a91c-459378e924a6 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.031573 Apr 09 20:57:28.812258 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 401/798] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Apr 9 20:57:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:57:28.816822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:28.817761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:28.824219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.824663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:28.825494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:28.825910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.342524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:29.350850 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80bca1ae-2b75-4eca-8779-1f7a97b21a42 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.537608 Apr 09 20:57:29.357633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 402/799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:28 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:29.357633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:29.357633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:29.363034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.363481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.364261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.364695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.587408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:29.594978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Building network info cache for instance {{(pid=141819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 20:57:29.595688 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98bd1a27-19e9-4dfa-bc95-4c8f1e12f1c9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.242800 Apr 09 20:57:29.605218 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 403/800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:29 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:29.610357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:29.610968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:29.617824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.618323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.619148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.621992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.818556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:29.826721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c825bbdc-a916-4e97-b352-8a999eebd0a1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.220408 Apr 09 20:57:29.828179 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 404/801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:29 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:29.832887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:29.833552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:29.840941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.841431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:29.842253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:29.842684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.062555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:30.071638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9ad75551-cf2a-404f-8aa4-6aff681e7f91 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.242110 Apr 09 20:57:30.081856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 405/802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:29 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:30.088024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b579925e-58bc-4dc3-ae2e-1a4ef64427c1 req-3b505d23-860f-436d-9294-72deff396b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e790127e-f0b8-47d7-aaf1-1f74b46ecb12", "tag": "ac60c733-ea67-43a5-8253-5a8a19668a37"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:30.096630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b579925e-58bc-4dc3-ae2e-1a4ef64427c1 req-3b505d23-860f-436d-9294-72deff396b59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.097368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b579925e-58bc-4dc3-ae2e-1a4ef64427c1 req-3b505d23-860f-436d-9294-72deff396b59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.109291 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b579925e-58bc-4dc3-ae2e-1a4ef64427c1 req-3b505d23-860f-436d-9294-72deff396b59 service nova] Creating event network-changed:ac60c733-ea67-43a5-8253-5a8a19668a37 for instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 on nch1-master-1 Apr 09 20:57:30.114865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b579925e-58bc-4dc3-ae2e-1a4ef64427c1 req-3b505d23-860f-436d-9294-72deff396b59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Apr 09 20:57:30.116143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 406/803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:30.124969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:30.125865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:30.136081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.136787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.137898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.138489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.480488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:30.492136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5177098b-4ca5-4bae-92d6-91996c068cb2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.374284 Apr 09 20:57:30.492605 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 407/804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:30 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:30.498315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6232928c-f504-45a8-a05d-80d520dcfeff req-71ab5a21-7e18-4ee8-b5c2-0e7fa0705aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-plugged", "status": "completed", "tag": "ab588df9-e032-4e8b-863a-e6633f9e2b3a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:30.506737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6232928c-f504-45a8-a05d-80d520dcfeff req-71ab5a21-7e18-4ee8-b5c2-0e7fa0705aab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.507176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6232928c-f504-45a8-a05d-80d520dcfeff req-71ab5a21-7e18-4ee8-b5c2-0e7fa0705aab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.520068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6232928c-f504-45a8-a05d-80d520dcfeff req-71ab5a21-7e18-4ee8-b5c2-0e7fa0705aab service nova] Creating event network-vif-plugged:ab588df9-e032-4e8b-863a-e6633f9e2b3a for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:30.520465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Updating instance_info_cache with network_info: [{"id": "ac60c733-ea67-43a5-8253-5a8a19668a37", "address": "fa:16:3e:cb:02:eb", "network": {"id": "1da05a8f-ebf3-4e45-9d7a-9cef918d235f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-16454680-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "66f36ce90faf42d0b8a5ab4024bd3db8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapac60c733-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 20:57:30.525607 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6232928c-f504-45a8-a05d-80d520dcfeff req-71ab5a21-7e18-4ee8-b5c2-0e7fa0705aab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Apr 09 20:57:30.526373 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 408/805] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:30.531975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fa8081f-7b54-455a-a346-4214f8f81f79", "device": "/dev/xvdb"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:30.533575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:30.535199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Releasing lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:57:30.536077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16ea4234-aab6-470f-9ae6-7409c5d59f04 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 202 len: 0 microversion: 2.1 time: 3.193179 Apr 09 20:57:30.538558 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 398/806] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:27 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 0 bytes in 3196 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 20:57:30.540896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.541521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.542284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.542783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.543796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:30.544365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:30.559805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.560264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.561102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.561537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.808318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:30.817439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a09a3fb1-6ac8-4bee-b55a-97d4c466774c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.277580 Apr 09 20:57:30.818636 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 399/807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:30 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:30.824683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c464b8da-0fec-4b4c-a8bf-04cc719aeb73 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '.version_select at 0x7fb08f0e3b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:30.863159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4165c293-e208-43ee-a364-6e90adb49658 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "POST /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.335476 Apr 09 20:57:30.864415 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 409/808] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Apr 9 20:57:30 2022] POST /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:57:30.883290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:30.884388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:30.893315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.894029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:30.894974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:30.895706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.221190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:31.234015 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f109b689-ee72-44ea-a5c3-9f0acc66d218 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.368055 Apr 09 20:57:31.245063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 410/809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:30 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:31.245063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:31.245063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:31.262931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.263381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.264177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.264608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.542395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:31.550948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57416e19-32f6-43c4-8437-eb517642d0d3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.314957 Apr 09 20:57:31.561262 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 411/810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:31 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:31.561262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:31.561262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:31.564458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.564990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.570573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.571131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.764662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:31.772589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a44466af-24f9-4796-87ea-eb8835d8d734 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.220017 Apr 09 20:57:31.773187 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 412/811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:31 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:31.777729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:31.778361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:31.785393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.785845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.786636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:31.787086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:31.973729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:31.986308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd66c1d8-aa8d-440d-ad6c-a4d0a84f0a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.212083 Apr 09 20:57:31.987113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 413/812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:31 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:31.992322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:31.993437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.001526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.002554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.003850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.004491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.151595 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c464b8da-0fec-4b4c-a8bf-04cc719aeb73 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/a5d4943d-8716-48f9-abbe-b533b2e8dc23" status: 202 len: 0 microversion: 2.1 time: 1.331703 Apr 09 20:57:32.152583 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 400/813] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:57:30 2022] DELETE /compute/v2.1/os-floating-ips/a5d4943d-8716-48f9-abbe-b533b2e8dc23 => generated 0 bytes in 1333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:57:32.161628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d4faebb-2bc5-4a25-8a08-9330a3b92650 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: .version_select at 0x7fb09581c8b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:32.163039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d4faebb-2bc5-4a25-8a08-9330a3b92650 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:32.163894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d4faebb-2bc5-4a25-8a08-9330a3b92650 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 400 len: 142 microversion: 2.1 time: 0.006251 Apr 09 20:57:32.164407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 401/814] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:32 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 142 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 20:57:32.173184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:32.174195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.180953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.181515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.182298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.182738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.190095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:32.198424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba6e055c-7dfd-48e9-9de7-fde8b6a8a4ab tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.210052 Apr 09 20:57:32.199095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 414/815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:31 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:32.206768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Acquired lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:57:32.250952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:32.251402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.257682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.258131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.259066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.259501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.314716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Releasing lock "refresh_cache-e790127e-f0b8-47d7-aaf1-1f74b46ecb12" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:57:32.315278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] HTTP exception thrown: floating IP not found Apr 09 20:57:32.315873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Returning 404 to user: floating IP not found {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:32.316826 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e13bc5ee-3399-48d7-b710-f75548b86db4 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 404 len: 67 microversion: 2.1 time: 0.147490 Apr 09 20:57:32.317514 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 402/816] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:32 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 67 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 20:57:32.326842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-713ab957-3bbe-44f0-aefb-e27183a63f84 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:32.382099 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-713ab957-3bbe-44f0-aefb-e27183a63f84 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Apr 09 20:57:32.382696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-713ab957-3bbe-44f0-aefb-e27183a63f84 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:32.383586 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-713ab957-3bbe-44f0-aefb-e27183a63f84 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action" status: 404 len: 88 microversion: 2.1 time: 0.060695 Apr 09 20:57:32.384218 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 403/817] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:32 2022] POST /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12/action => generated 88 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 09 20:57:32.392774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:32.394122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.400725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.401261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.401987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.402425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.426568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:57:32.439859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:32.450501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-888c78a5-d3f3-4828-b01f-dccd757a0407 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.203637 Apr 09 20:57:32.461059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 415/818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:32 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:32.521221 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0c6af45b-318d-435d-8c56-381bae59c985 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 204 len: 0 microversion: 2.1 time: 0.131020 Apr 09 20:57:32.522117 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 404/819] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:57:32 2022] DELETE /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:57:32.531185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:32.533554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.540381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.540838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.541661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.542093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.550261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-plugged", "status": "completed", "tag": "60d92665-fc5a-43fc-bc50-586bc08179bc"}, {"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-plugged", "status": "completed", "tag": "def9022b-7d87-4418-903a-3af11e1cabd4"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:32.559509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.560364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.580759 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] Creating event network-vif-plugged:60d92665-fc5a-43fc-bc50-586bc08179bc for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:32.580909 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] Creating event network-vif-plugged:def9022b-7d87-4418-903a-3af11e1cabd4 for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:32.588145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3941d736-84c2-4306-9e5c-9e662ea590e4 req-7184f44d-ab28-48ed-95fe-075c5a109dbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042079 Apr 09 20:57:32.589664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 405/820] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:32.596583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:32.597501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.612721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.615389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.616288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.616789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.732530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:32.741942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75786379-99f4-4afe-a4d7-89aa6d71b7c3 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1540 microversion: 2.1 time: 0.214797 Apr 09 20:57:32.742729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 416/821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:32 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1540 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:32.788717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:32.789337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:32.798938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.799397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:32.800220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:32.800658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.130967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.139337 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b214805c-1a40-4d84-96ac-ead19f41729d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.548091 Apr 09 20:57:33.139928 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 406/822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:32 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:33.144596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:33.145244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:33.151301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.151757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.152543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.152986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.175702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.183521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86b3026e-1d34-4744-a873-d6bf2b0ed9c6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.398581 Apr 09 20:57:33.184223 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 417/823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:32 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:33.215837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:33.216449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:33.222380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.222820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.223621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.224050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.333062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.342232 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8fae7b1a-546a-4766-a00e-4df1152af30a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.201278 Apr 09 20:57:33.349600 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 407/824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:33 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:33.378284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.387629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c46ec609-36af-4030-8ba6-5be129dc599e tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.175777 Apr 09 20:57:33.388188 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 418/825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:33 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:33.471206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:33.471846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:33.477953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.478462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.479226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.479637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.615751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.623518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0944de85-3850-46b8-9eb7-cf9ff8cd8625 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.156259 Apr 09 20:57:33.624090 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 408/826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:33 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:33.763724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:33.764728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:33.775253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.776092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.777457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:33.778180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:33.923018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:33.930952 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba37c37a-0a34-4d17-a400-b7036bab1808 tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1540 microversion: 2.1 time: 0.174214 Apr 09 20:57:33.931572 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 419/827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:33 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1540 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.155861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.156471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.162934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.163384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.164158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.164586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.200024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.200768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.207237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.207768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.208530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.208947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.341059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:34.348663 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14745b06-650c-44e9-ac4c-2abe9718d901 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.196612 Apr 09 20:57:34.349382 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 409/828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.359369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.360005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.365967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.366415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.367182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.367614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.371487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:34.379403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68d0aeb7-abe8-4ccb-b6e0-f31772b965c8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.183262 Apr 09 20:57:34.380059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 420/829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.404238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.404858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.411232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.411657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.412437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.412879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.559472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:34.567317 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce3a2fa9-a231-4d53-9670-a9a09e16f438 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.211989 Apr 09 20:57:34.567892 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 410/830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.584772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:34.592481 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9faa2f51-b8f7-404b-bf37-96a23933fbc7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.191988 Apr 09 20:57:34.593062 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 421/831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.607396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f236a62e-eb62-4def-bed9-6e708bcfcb85 req-93c4c350-5016-4a4b-a4ec-6f7304b796ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66be7a-97fe-4f7d-94fb-645e9b367f42", "name": "network-vif-plugged", "status": "completed", "tag": "765d63be-a291-4796-9abd-dd6dc3afb689"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:34.615927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f236a62e-eb62-4def-bed9-6e708bcfcb85 req-93c4c350-5016-4a4b-a4ec-6f7304b796ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.616366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f236a62e-eb62-4def-bed9-6e708bcfcb85 req-93c4c350-5016-4a4b-a4ec-6f7304b796ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.627226 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f236a62e-eb62-4def-bed9-6e708bcfcb85 req-93c4c350-5016-4a4b-a4ec-6f7304b796ac service nova] Creating event network-vif-plugged:765d63be-a291-4796-9abd-dd6dc3afb689 for instance de66be7a-97fe-4f7d-94fb-645e9b367f42 on nch2-master-1 Apr 09 20:57:34.632023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f236a62e-eb62-4def-bed9-6e708bcfcb85 req-93c4c350-5016-4a4b-a4ec-6f7304b796ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028755 Apr 09 20:57:34.632988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 411/832] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:57:34.639567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.640176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.646243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.646695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.647519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.648425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.849765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:34.858396 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1d5262d-d2e0-4fde-9873-1c870a9dc91a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.222523 Apr 09 20:57:34.859081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 422/833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:34.950245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:34.950958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:34.958725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.959425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:34.960485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:34.960920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.091679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:35.099703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a4e45f8-748c-4a8e-aeea-c99d3353b1bd tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1540 microversion: 2.1 time: 0.155516 Apr 09 20:57:35.100285 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 412/834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:34 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1540 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:35.367334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:35.368033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:35.374522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.374971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.375774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.376207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.396313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:35.396967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:35.405388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.405848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.406640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.407075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.671638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:35.679395 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40cc6b1b-f96a-4ec4-8065-d9b5e66f7b89 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.316031 Apr 09 20:57:35.679982 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 423/835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:35 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:35.684691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:35.685322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:35.691166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.691615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.692401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.692851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.693337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:35.701575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af066db5-ad22-46e0-bb90-a17d7aa0e35b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.309172 Apr 09 20:57:35.703769 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 413/836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:35 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:35.715122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:35.716073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:35.723102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.723893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.724936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:35.725619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:35.988239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:36.000168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fd286a2-ce8a-41df-bbed-c9682fe43838 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.318907 Apr 09 20:57:36.000752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 424/837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:35 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:36.005802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:36.006396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.012532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.012982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.013807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.014238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.033102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:36.041381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-49b1b649-d2b4-4745-97f5-bf1651339cfd tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1355 microversion: 2.1 time: 0.330604 Apr 09 20:57:36.042487 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 414/838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:35 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1355 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:36.117275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:36.117933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.124583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.125069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.125879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.126321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.200317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd415747d240d49d89c65e45cc3fc810b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f36ce90faf42d0b8a5ab4024bd3db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:36.208202 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8073d88-6ef5-43f9-a200-f33c40f8fb0e tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 200 len: 1498 microversion: 2.1 time: 0.094811 Apr 09 20:57:36.209484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 415/839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:36 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 1498 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:36.221309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8857c3dc-ece4-4316-b562-5059a0b34b77 req-00d86b00-0429-4d45-99ba-b51ce18c5196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e790127e-f0b8-47d7-aaf1-1f74b46ecb12", "name": "network-vif-deleted", "tag": "ac60c733-ea67-43a5-8253-5a8a19668a37"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:36.230717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:36.236764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8857c3dc-ece4-4316-b562-5059a0b34b77 req-00d86b00-0429-4d45-99ba-b51ce18c5196 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.237279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8857c3dc-ece4-4316-b562-5059a0b34b77 req-00d86b00-0429-4d45-99ba-b51ce18c5196 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.238743 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9ac31219-e0f0-4794-964f-c010af88191a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.236991 Apr 09 20:57:36.239615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 425/840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:36 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:36.249006 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8857c3dc-ece4-4316-b562-5059a0b34b77 req-00d86b00-0429-4d45-99ba-b51ce18c5196 service nova] Creating event network-vif-deleted:ac60c733-ea67-43a5-8253-5a8a19668a37 for instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 on nch1-master-1 Apr 09 20:57:36.253923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8857c3dc-ece4-4316-b562-5059a0b34b77 req-00d86b00-0429-4d45-99ba-b51ce18c5196 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Apr 09 20:57:36.254534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 416/841] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:36.314362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:36.315001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.321085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.321550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.322319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.322751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.450531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:36.466910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29b53ce7-c04c-45bb-859f-21e977f86285 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 2126 microversion: 2.25 time: 0.156320 Apr 09 20:57:36.467569 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 426/842] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:36 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 2126 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:36.486527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:36.487813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.494154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.494605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.495383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.495823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.520310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'flavor' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:36.533115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Going to try to live migrate instance to nch2-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 20:57:36.695703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:36.696554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.702866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.703691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.704817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.704946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.841432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:36.849686 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f225abd3-8b8f-440a-920c-74530ce3ff33 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.157705 Apr 09 20:57:36.857217 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 427/843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:36 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:36.857217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:36.857480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:36.864322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.864784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:36.865609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:36.866052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.003309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:37.013361 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b2e432d-2dba-4340-8289-c96f45f1d08b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.160923 Apr 09 20:57:37.014166 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 428/844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:36 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:37.026914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.027496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.034059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.034560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.035543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.035978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.211068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:37.220114 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9cd28edd-d0f6-4125-9ed4-7724a31dd4cf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.204834 Apr 09 20:57:37.220723 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 429/845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:37.228030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.228658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.235520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.236348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.237390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.237841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.450617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:37.458577 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72508645-1c3e-4a74-82d5-5f9955c1186c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1805 microversion: 2.1 time: 0.236803 Apr 09 20:57:37.459268 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 430/846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1805 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:37.469248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.469248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] [instance: e790127e-f0b8-47d7-aaf1-1f74b46ecb12] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.470270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.470843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.471840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.472274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.486851 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] HTTP exception thrown: Instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 could not be found. Apr 09 20:57:37.487058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] Returning 404 to user: Instance e790127e-f0b8-47d7-aaf1-1f74b46ecb12 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:37.487905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5ab0acb-897d-4f76-9e3f-63c81d65501a tempest-FloatingIPsAssociationNegativeTestJSON-718803169 tempest-FloatingIPsAssociationNegativeTestJSON-718803169-project] 10.222.0.30 "GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12" status: 404 len: 111 microversion: 2.1 time: 0.027640 Apr 09 20:57:37.488461 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 431/847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/e790127e-f0b8-47d7-aaf1-1f74b46ecb12 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:57:37.495541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.496153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.502568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.503019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.504214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.504661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.713868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:37.721654 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35879672-6ec5-4031-b352-7fe94c90b256 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.232162 Apr 09 20:57:37.722197 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 432/848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:37.733795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.734366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.740566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.740999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.741928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.742435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.766559 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-122393be-6fde-4f08-8a76-7553eda242ec tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439/ips" status: 200 len: 218 microversion: 2.1 time: 0.043132 Apr 09 20:57:37.767544 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 433/849] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439/ips => generated 218 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:37.777304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.777912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.784245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.784796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.785722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.786235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.811867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:57:37.896581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96f060a8-ac93-4d96-9735-40d3a21d4fcf tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 204 len: 0 microversion: 2.1 time: 0.122607 Apr 09 20:57:37.900549 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 434/850] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:57:37 2022] DELETE /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 20:57:37.902986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:37.903702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:37.910115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.910571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:37.911363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:37.911838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.046793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:38.054634 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b84c18c1-8d06-414d-8124-71de228011b6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.155980 Apr 09 20:57:38.055243 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 435/851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:37 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:38.059775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:38.060598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:38.066965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.067412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.068184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.068614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.212257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:38.219948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7675ddfc-0ded-4f4c-8931-6cc1a8e5660c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1811 microversion: 2.1 time: 0.163687 Apr 09 20:57:38.220707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 436/852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:38 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:38.225768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:38.226467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:38.233180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.233628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.234397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.234828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.362897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:38.370565 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53d84773-0e30-4aa3-9e91-fee3b5a2fd5e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.148955 Apr 09 20:57:38.371114 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 437/853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:38 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:38.383649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:38.384286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:38.390342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.390757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.391524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.391955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.539508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:38.549107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-740cf77d-c903-4312-bf28-f0ff9818fd5b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.176893 Apr 09 20:57:38.549969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 438/854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:38 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:38.739216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:38.739829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:38.746641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.747108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.748123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:38.748616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:38.887469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:38.895271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9854d2f-ccd7-4c45-8547-953bc262d0e2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.159935 Apr 09 20:57:38.895823 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 439/855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:38 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:39.072813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:39.073723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:39.080131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.080573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.081386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.081815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.220725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:39.228697 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3d75ff7-e8f0-413d-b103-a17b1b1f9950 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.161028 Apr 09 20:57:39.238167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 440/856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:39 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:39.251585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:39.252222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:39.258314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.258949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.259714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.260144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.416985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:39.424617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6bfbfa6-a6d0-4a32-a8a9-d5be90de9bce tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1811 microversion: 2.1 time: 0.185389 Apr 09 20:57:39.434843 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 441/857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:39 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:39.434843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:39.434843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:39.437957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.438579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.439537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.439970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.686786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:39.699307 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a91a19c-0926-4b20-87fd-5294a069b3c0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.272974 Apr 09 20:57:39.700226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 442/858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:39 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:39.712959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:39.713620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:39.721942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.722404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.723225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.723662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.942604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:39.951298 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9696bcf-7656-4a54-88c5-ec146a1d197b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.250052 Apr 09 20:57:39.961473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 443/859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:39 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:39.972505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:39.973605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:39.980238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.980794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:39.982130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:39.983088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.250294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:40.270055 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-44a2f2af-7231-489c-81c5-fb032c411bf3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.306876 Apr 09 20:57:40.270710 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 444/860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:39 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:40.275443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-85660c5c-d418-4d46-b7a9-ee776cd7cda6 req-d413273f-7bf2-459a-a251-d5f2c009df59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-deleted", "tag": "ab588df9-e032-4e8b-863a-e6633f9e2b3a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:40.292606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-85660c5c-d418-4d46-b7a9-ee776cd7cda6 req-d413273f-7bf2-459a-a251-d5f2c009df59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.296778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-85660c5c-d418-4d46-b7a9-ee776cd7cda6 req-d413273f-7bf2-459a-a251-d5f2c009df59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.319432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-85660c5c-d418-4d46-b7a9-ee776cd7cda6 req-d413273f-7bf2-459a-a251-d5f2c009df59 service nova] Creating event network-vif-deleted:ab588df9-e032-4e8b-863a-e6633f9e2b3a for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:40.331566 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-85660c5c-d418-4d46-b7a9-ee776cd7cda6 req-d413273f-7bf2-459a-a251-d5f2c009df59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058778 Apr 09 20:57:40.334462 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 445/861] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:40.351568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:40.353373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:40.365969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.369262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.372993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.374741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.651299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:40.663604 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0940d8e8-1caf-48b2-b258-d56fe7dd07ea tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.326758 Apr 09 20:57:40.664508 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 446/862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:40 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:40.669536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:40.670374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:40.676596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.677183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.678868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.679078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.927915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:40.936678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-201a729d-03a2-41db-9b34-255f85faeab0 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1675 microversion: 2.1 time: 0.270926 Apr 09 20:57:40.937436 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 447/863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:40 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1675 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:40.950168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:40.951301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:40.958361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.959070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:40.960042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:40.960636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:41.294576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:41.303304 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf68cc27-e3c3-4d43-949b-3d93687f2ebd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.364743 Apr 09 20:57:41.313345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 448/864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:40 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:41.321774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:41.322624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:41.328991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:41.329612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:41.330395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:41.330831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:41.904769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:41.912615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7bd9b40e-1fa4-472e-97de-397ffa896e31 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.598213 Apr 09 20:57:41.913274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 449/865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:41 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:41.917637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:41.918231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:41.926777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:41.927226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:41.927994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:41.928564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.223401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:42.232338 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51dd6c78-26fa-41ab-9589-511de079192c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.317743 Apr 09 20:57:42.242149 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 450/866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:41 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:42.247072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:42.247768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:42.254086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.254707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.255628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.256284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.439051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:42.447581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f20131a3-be35-4609-8a17-9c1ff776c811 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.204241 Apr 09 20:57:42.457188 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 451/867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:42 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:42.462562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:42.463438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:42.470816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.471520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.472456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.473057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.555799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:42.563174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06cb8047-b4f4-421e-8783-1e30537054e5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1612 microversion: 2.1 time: 0.104551 Apr 09 20:57:42.563983 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 452/868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:42 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:42.568674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:42.573164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:42.575118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.575572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.576345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.576775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.708648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:42.716307 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f86c603f-62a0-421d-a444-9bc06dbad94e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.151211 Apr 09 20:57:42.716970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 453/869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:42 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:42.723910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d7221552-6969-48cf-84ff-990374b215f7 req-8f4693cb-890c-45ea-a73c-8da8f85cd39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-deleted", "tag": "60d92665-fc5a-43fc-bc50-586bc08179bc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:42.732359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d7221552-6969-48cf-84ff-990374b215f7 req-8f4693cb-890c-45ea-a73c-8da8f85cd39a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.732715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d7221552-6969-48cf-84ff-990374b215f7 req-8f4693cb-890c-45ea-a73c-8da8f85cd39a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.743561 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d7221552-6969-48cf-84ff-990374b215f7 req-8f4693cb-890c-45ea-a73c-8da8f85cd39a service nova] Creating event network-vif-deleted:60d92665-fc5a-43fc-bc50-586bc08179bc for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:42.748408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d7221552-6969-48cf-84ff-990374b215f7 req-8f4693cb-890c-45ea-a73c-8da8f85cd39a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030266 Apr 09 20:57:42.748993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 454/870] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:42.929544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:42.930239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:42.936509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.936955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:42.937760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:42.938189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.071843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:43.080100 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9cd7fa5f-92d6-4d30-90ab-0c33bc7a6a98 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.155317 Apr 09 20:57:43.080677 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 455/871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:42 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:43.249356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:43.249971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:43.255974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.256424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.257252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.257710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.423532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:43.431473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5871f22-8ee2-4c2a-8795-7afd14661ddb tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.185997 Apr 09 20:57:43.432223 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 456/872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:43 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:43.464198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:43.464827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:43.472538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.472894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.473698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.474198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.782738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:43.790387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2cedd64e-a036-4a41-b179-c95387a87c75 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.330264 Apr 09 20:57:43.799968 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 457/873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:43 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:43.805480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:43.806312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:43.812779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.813615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.814676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.815268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.851674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.852653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.853307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lazy-loading 'fault' on Instance uuid 5c0bee38-b470-45a5-9253-a6a5ba25f439 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:57:43.951988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:43.968314 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f4a511f-a984-49c8-a992-dac529da3911 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 200 len: 1303 microversion: 2.1 time: 0.166410 Apr 09 20:57:43.968849 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 458/874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:43 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:43.974291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:43.975158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:43.982234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.982760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:43.983808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:43.984361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:44.464389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:44.472528 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-944181b6-8ecc-4079-a8bf-16ed30a10cf7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1476 microversion: 2.1 time: 0.502608 Apr 09 20:57:44.473382 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 459/875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:43 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1476 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:44.478239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:44.479064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:44.485390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:44.485843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:44.486636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:44.487265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:44.883515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:44.892759 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-267a7517-ab96-4c37-b0a7-77162307a8a9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.418109 Apr 09 20:57:44.902490 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 460/876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:44 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:44.906394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:44.907130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:44.915756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:44.916904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:44.917761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:44.918751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.185758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:45.197547 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fcd9fc00-3885-4aef-ae9f-03172fe5fa96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1504 microversion: 2.1 time: 0.302695 Apr 09 20:57:45.198685 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 461/877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:44 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:45.203589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-fb02b684-1001-427b-a069-ec6ab2044af1 req-39d1d75f-636e-4b19-ad10-3a35087ed36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0bee38-b470-45a5-9253-a6a5ba25f439", "name": "network-vif-deleted", "tag": "def9022b-7d87-4418-903a-3af11e1cabd4"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:45.234315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fb02b684-1001-427b-a069-ec6ab2044af1 req-39d1d75f-636e-4b19-ad10-3a35087ed36a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.235128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fb02b684-1001-427b-a069-ec6ab2044af1 req-39d1d75f-636e-4b19-ad10-3a35087ed36a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.254831 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/action" status: 202 len: 0 microversion: 2.25 time: 8.773701 Apr 09 20:57:45.255541 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 417/878] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 20:57:36 2022] POST /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/action => generated 0 bytes in 8775 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:57:45.258978 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-fb02b684-1001-427b-a069-ec6ab2044af1 req-39d1d75f-636e-4b19-ad10-3a35087ed36a service nova] Creating event network-vif-deleted:def9022b-7d87-4418-903a-3af11e1cabd4 for instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 on nch1-master-1 Apr 09 20:57:45.262946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-fb02b684-1001-427b-a069-ec6ab2044af1 req-39d1d75f-636e-4b19-ad10-3a35087ed36a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062381 Apr 09 20:57:45.265351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:45.266144 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 462/879] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:45.270448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:45.278322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:45.279037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:45.286790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.287238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.288030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.288651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.290027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.291383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.292529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.292974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.308797 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. Apr 09 20:57:45.309522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:57:45.311572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a663126-7ed0-42ce-a3ba-346b0e2ba8b6 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 404 len: 111 microversion: 2.1 time: 0.043444 Apr 09 20:57:45.312760 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 463/880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:45 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:57:45.333837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:45.360903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.361790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.376141 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] Creating event network-vif-unplugged:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch2-master-1 Apr 09 20:57:45.398725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] Instance a167d292-5835-4442-8310-bb9bf77d8eaf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 20:57:45.428587 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-60d001ad-393a-4b54-91a7-70deeaa2c8ed req-eb7064de-91e9-428a-b1b1-c5ef9346c13f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113275 Apr 09 20:57:45.431189 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 464/881] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:45.442972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:45.449771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:45.471221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.471750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.472564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.473005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.645782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:45.663633 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5b3e494a-4292-494c-b62a-7a214307d1c1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.402431 Apr 09 20:57:45.664943 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 418/882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:45 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:45.671734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:45.672959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:45.679754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.680570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.681679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:45.682661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:45.948892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:45.966494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:45.968118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:45.973970 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60563a92-dddd-4022-a3d8-10739bef02cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.540786 Apr 09 20:57:45.974511 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 465/883] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:45 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:45.988898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:45.989558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:46.002318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.002839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:46.004796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.005365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:46.121787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:46.130289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4b7ff101-4dfb-4c6b-b36f-eecd572234a5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1475 microversion: 2.1 time: 0.463667 Apr 09 20:57:46.130632 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 419/884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:45 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:46.216171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:46.217219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:46.228749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.229564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:46.234135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.234795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:46.827892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:46.839845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e99d0e9-77ec-4bec-8383-ff30b74951fa tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.864146 Apr 09 20:57:46.851241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 466/885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:45 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:46.857019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:46.857937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:46.875167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.875909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:46.879096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:46.879839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.106297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.115329 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-522ae6bc-f30c-4240-ac5f-a3e4fd503def tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1494 microversion: 2.1 time: 0.903955 Apr 09 20:57:47.116220 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 420/886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:46 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1494 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:47.124763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:47.127930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:47.141523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.142227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.143255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.143916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.423996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.433907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2e20c9b-a3c7-4e9c-8697-74f1813fb56f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.580998 Apr 09 20:57:47.437594 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 467/887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:46 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:47.446334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a061db4b-5333-4b21-ac9c-1376d6050b2a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '.version_select at 0x7fb08ed7a0d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:47.452122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a061db4b-5333-4b21-ac9c-1376d6050b2a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.457630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a061db4b-5333-4b21-ac9c-1376d6050b2a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.478300 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a061db4b-5333-4b21-ac9c-1376d6050b2a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1950 microversion: 2.1 time: 0.036073 Apr 09 20:57:47.482852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 468/888] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:57:47 2022] GET /compute/v2.1/os-migrations => generated 1950 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:47.489838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:47.490735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:47.500879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.501602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.502953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.503573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.561063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.578437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.582157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.584560 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c897fad2-d83a-402a-8a8c-c83d76ea8e0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.466431 Apr 09 20:57:47.587360 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 421/889] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:47 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:47.601948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:47.613300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.613956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.627337 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] Creating event network-changed:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch2-master-1 Apr 09 20:57:47.638007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] Instance a167d292-5835-4442-8310-bb9bf77d8eaf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 20:57:47.671622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c92c4fb2-a00e-44c2-a983-bc2c9bcdc18c req-ce8473b8-d42a-47f7-8c14-86aeb47c1fd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080775 Apr 09 20:57:47.672477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 422/890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:47.684002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:47.688173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:47.689104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:47.694252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-480aaf65-2391-45fb-9458-ac00d43d903a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1473 microversion: 2.1 time: 0.209384 Apr 09 20:57:47.695280 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 469/891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:47 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1473 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:47.698317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.699709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.701288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.701956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.862340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:47.863578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:47.898415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.899222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.901253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:47.901854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:47.940429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b7234fc-0eb4-45f2-b98e-49c7d6fe43a7 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1645 microversion: 2.1 time: 0.265691 Apr 09 20:57:47.964149 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 423/892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:47 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1645 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:48.084808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-407102410", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6e4c0a84-06ca-42fe-9656-5da4d34fcdb0"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:48.159171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] validate_networks() for [('6e4c0a84-06ca-42fe-9656-5da4d34fcdb0', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:48.300840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:48.317917 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4263e393-8cc6-4b70-949d-2943881592f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.464416 Apr 09 20:57:48.331182 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 470/893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:47 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:48.452522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:48.457929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:48.468704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.469577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.470520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.471098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.783470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:48.797153 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3f8f648-bcdd-41af-8faf-76adad479420 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.350260 Apr 09 20:57:48.798067 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 471/894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:48 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:48.811991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:48.812932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:48.821483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.822143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.824328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.824995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.951671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:57:48.952310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:57:48.952941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:57:48.953516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:57:48.954068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:57:48.963508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.964213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.965210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:48.965813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:48.989105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:57:48.993530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for user ceba42e80d7746e4897669084c078c09 and project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:57:49.005070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:57:49.007727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:57:49.060103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.067967 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-51a54795-3d11-4e0e-ba42-49864fbf16b6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.990249 Apr 09 20:57:49.069330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.071131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.072477 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a86ecc82-cf21-4024-949f-49f9d0bb5b21 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.273028 Apr 09 20:57:49.073629 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 472/895] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:48 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:49.074672 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 424/896] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:57:49.079506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:49.080361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:49.088306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.089141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:49.090650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.091437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:49.093379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8e64e70-7031-4a79-84ea-7e73411ad50e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:49.094144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8e64e70-7031-4a79-84ea-7e73411ad50e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:49.230850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8e64e70-7031-4a79-84ea-7e73411ad50e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.241363 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8e64e70-7031-4a79-84ea-7e73411ad50e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1210 microversion: 2.1 time: 0.163704 Apr 09 20:57:49.244683 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 425/897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:49 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:49.336871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:49.337823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:49.345660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.350812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.352274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:49.353861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.354588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:49.359283 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-719ca03a-1322-4e61-bc9a-0ee6bc517552 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1473 microversion: 2.1 time: 0.280400 Apr 09 20:57:49.369691 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 473/898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:49 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:49.556841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:49.567784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61d9364e-4e5d-4445-9e74-1a34dc00e604 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.235409 Apr 09 20:57:49.574892 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 426/899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:49 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:49.818092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:49.818784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:49.827767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.830230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:49.842199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:49.842951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.090798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:50.091804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:50.092283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:50.100851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.101764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.102787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.103774 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3f310dd8-5b62-42a1-9c41-798b79d2b565 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.292773 Apr 09 20:57:50.103906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.115723 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 474/900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:49 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:50.263212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:50.264096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:50.299745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.307260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.308846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.311309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.341871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:50.359622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:50.364128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:50.365585 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f31efcf3-ba26-45fa-a948-53148809025a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.278841 Apr 09 20:57:50.371727 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 427/901] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:50 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:50.376731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:50.378609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:50.386148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.386820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.387770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.388348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.508132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:50.520552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43dc04ee-e58b-41cf-8f52-42d724c9720d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1262 microversion: 2.1 time: 0.261961 Apr 09 20:57:50.521741 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 475/902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:50 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1262 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:50.589114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:50.590278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:50.632396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.635046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:50.637341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:50.638321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.013381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:51.034333 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-01ce39ba-0aa4-4b46-973a-0acf5623e26e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1473 microversion: 2.1 time: 0.660906 Apr 09 20:57:51.061373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 428/903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:50 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1473 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:51.121432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:51.122049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:51.135826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.136512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.139771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.140218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.257106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:51.272866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-269c69b9-a77a-4b9b-a68a-71c0ca4381b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.686494 Apr 09 20:57:51.274883 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 476/904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:50 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:51.399512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:51.403574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:51.419218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.419928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.420924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.429135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.821524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:51.860239 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee06578d-643a-4ccf-bff2-958f8a4d38fc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.740591 Apr 09 20:57:51.866140 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 429/905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:51 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:51.886582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:51.888045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:51.905436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.905948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:51.906780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:51.907216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:52.399300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:52.410102 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57953f44-9917-44c5-a8e1-f762f6cf45d5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1268 microversion: 2.1 time: 0.540866 Apr 09 20:57:52.410795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 430/906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:51 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1268 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:52.415635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:52.416311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:52.422672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:52.423311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:52.424260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:52.424850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:52.432397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:52.447987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:52.450368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:52.451594 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df2d29d1-b274-4045-acb6-b453ae19603f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 1.066357 Apr 09 20:57:52.461395 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 477/907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:51 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:52.611180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e62a054e-893e-490b-a992-b51440b5efb0 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Action: 'create', calling method: .version_select at 0x7fb08ec4cf70>, body: {"pool": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:53.021514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:53.037699 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e2d2502f-6930-44d8-899f-043e11be6e63 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1470 microversion: 2.1 time: 0.625591 Apr 09 20:57:53.038649 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 431/908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:52 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1470 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:53.052676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:53.053342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:53.060039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:53.061929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:53.064604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:53.066022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:53.624681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:53.638124 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8da8df8a-1f9c-4dc4-ae51-8c246f2936e0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.597647 Apr 09 20:57:53.639327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 432/909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:53 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:53.645455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:53.646076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:53.652663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:53.653156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:53.654290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:53.655168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.036307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:54.046579 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84e22924-0f00-4cdc-a303-9d5e8f52ebc3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.405888 Apr 09 20:57:54.049295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 433/910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:53 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:54.058048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:54.062823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:54.077250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.079742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.084380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.095142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.234516 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd8dd6a8-105c-491d-a108-0bcd451a50bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf/action" status: 204 len: 0 microversion: 2.1 time: 0.183298 Apr 09 20:57:54.238355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 434/911] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:57:54 2022] POST /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf/action => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:57:54.249189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:54.250430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:54.264848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.265577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.266626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.267216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.711283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:54.724355 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b3c70b4c-87e4-4349-a150-3ceb880a8fb8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1310 microversion: 2.1 time: 0.484862 Apr 09 20:57:54.725336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 435/912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:54 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1310 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:54.733495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:54.740185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:54.750956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.751696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:54.752679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:54.753307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:55.333875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:55.346712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:55.348203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:55.349533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e405c3d3-1c6e-46bd-9043-89a9e606af5a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.622715 Apr 09 20:57:55.350610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 436/913] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:54 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:55.355634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-830838998", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "c88d2a96-4eb2-43fe-ae62-c69dfec53001"}, {"uuid": "20aba05f-99d7-4207-bff8-ec112edd3dde"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:55.428357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] validate_networks() for [('c88d2a96-4eb2-43fe-ae62-c69dfec53001', None, None, None, None, None), ('20aba05f-99d7-4207-bff8-ec112edd3dde', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:57:57.519658 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e62a054e-893e-490b-a992-b51440b5efb0 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.065830 Apr 09 20:57:57.520265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 478/914] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:57:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:57.525631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:57.526520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:57.534874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.535328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.536128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.536561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.628743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:57:57.629258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:57:57.629658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:57:57.630032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:57:57.630462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:57:57.640093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.640540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.641384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.641816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.659213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Getting quotas for project bf4fe086a6e94378997756b1fc02a6c7. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:57:57.663394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Getting quotas for user 730fd7f2ff9e4e96be5e412ad86bb0d8 and project bf4fe086a6e94378997756b1fc02a6c7. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:57:57.677141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:57:57.680064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:57:57.688445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:57.696437 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e82ae8f-3e10-4efc-a5ab-c9f041a6b50c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1470 microversion: 2.1 time: 0.174801 Apr 09 20:57:57.697021 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 479/915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:57 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:57.710916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:57.711652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:57.718358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.719023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.719812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.720322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.734291 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0a64d178-03d1-4b94-8bec-fc7e04883775 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382206 Apr 09 20:57:57.735190 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 437/916] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:57:57.740178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:57.740957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:57.747841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.748671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:57.749771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:57.750355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.073842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.080160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.081177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e812e1e-dd5c-48cc-a355-46cfa22a3f6b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.344709 Apr 09 20:57:58.082028 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 438/917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:57 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:58.087137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:58.087931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:58.094342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.094993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.095933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.096522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.096909 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-400f2450-2295-4156-af70-e8876824db2e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.389543 Apr 09 20:57:58.097545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 480/918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:57 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:58.106209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-92781c56-9d40-4c1f-8ae5-7312a2bf7ae3 req-33df253b-8b60-46e0-bf05-e40b69a8a54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "name": "network-vif-plugged", "status": "completed", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:58.112470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-92781c56-9d40-4c1f-8ae5-7312a2bf7ae3 req-33df253b-8b60-46e0-bf05-e40b69a8a54f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.112915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-92781c56-9d40-4c1f-8ae5-7312a2bf7ae3 req-33df253b-8b60-46e0-bf05-e40b69a8a54f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.124919 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-92781c56-9d40-4c1f-8ae5-7312a2bf7ae3 req-33df253b-8b60-46e0-bf05-e40b69a8a54f service nova] Creating event network-vif-plugged:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch2-master-1 Apr 09 20:57:58.136070 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-92781c56-9d40-4c1f-8ae5-7312a2bf7ae3 req-33df253b-8b60-46e0-bf05-e40b69a8a54f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Apr 09 20:57:58.136702 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 481/919] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:58.142146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:58.142838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:58.149326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.149769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.150547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.150962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.307292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.315345 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df51a2dc-bb53-4bb7-9408-cc031b9424ee tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1310 microversion: 2.1 time: 0.232049 Apr 09 20:57:58.315969 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 439/920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:58 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:58.320452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-74e2369c-6b67-4220-97e1-67ba0d53ca37 req-9550b3af-4059-4060-af86-a5845e86f9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d604fb79-470d-4cc5-88e6-a68d9a19a125", "tag": "1bc4d915-ee13-4ba8-922e-b46c28ad4602"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:58.328517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-74e2369c-6b67-4220-97e1-67ba0d53ca37 req-9550b3af-4059-4060-af86-a5845e86f9ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.328965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-74e2369c-6b67-4220-97e1-67ba0d53ca37 req-9550b3af-4059-4060-af86-a5845e86f9ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.333616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.340725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-74e2369c-6b67-4220-97e1-67ba0d53ca37 req-9550b3af-4059-4060-af86-a5845e86f9ea service nova] Creating event network-changed:1bc4d915-ee13-4ba8-922e-b46c28ad4602 for instance d604fb79-470d-4cc5-88e6-a68d9a19a125 on nch1-master-1 Apr 09 20:57:58.342102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.343594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.344841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0bd9f6f-fe8f-4b9e-9276-877f14f9add8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.206998 Apr 09 20:57:58.345552 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 482/921] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:57:58 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:57:58.345811 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-74e2369c-6b67-4220-97e1-67ba0d53ca37 req-9550b3af-4059-4060-af86-a5845e86f9ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028769 Apr 09 20:57:58.346620 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 440/922] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:57:58.352748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:58.353482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:58.359662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9042b895-7201-4dfe-8982-9575cafde7b3 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Action: 'create', calling method: .version_select at 0x7fb08ebea040>, body: {"pool": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:57:58.360446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.360897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.361709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.362146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.459177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.467184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-088df699-9c97-4e3d-a8cd-766ee8e20350 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1216 microversion: 2.1 time: 0.118590 Apr 09 20:57:58.467750 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 441/923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:58 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:58.714119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:58.715049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:58.721719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.722407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.723182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.723591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.915603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:58.923398 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7e00813-f767-429e-bee6-626723d6c68e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1462 microversion: 2.1 time: 0.213192 Apr 09 20:57:58.924302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 442/924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:58 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1462 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:58.939666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:58.941178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:58.946524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.947057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:58.947933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:58.948467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:59.178200 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2cce5fa-3096-4fa9-bfd4-e9ab245a8836 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1613 microversion: 2.1 time: 0.242017 Apr 09 20:57:59.178905 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 443/925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:58 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1613 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:57:59.186388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:59.187505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:59.195172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:59.196018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:59.196859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:59.197875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:59.881224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:57:59.888808 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18627576-6a79-4f04-9707-9758c0c7e47d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.708028 Apr 09 20:57:59.889574 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 444/926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:59 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:57:59.902846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:57:59.903504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:57:59.909600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:59.910259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:57:59.910950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:57:59.911472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.334645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:00.343095 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdef5f1b-4fc9-4046-b7f4-05c709139feb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.443891 Apr 09 20:58:00.343691 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 445/927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:57:59 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:00.358113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-31248531-7181-4c6c-b794-13bec9514795 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '.version_select at 0x7fb08f0a4310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:00.360679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31248531-7181-4c6c-b794-13bec9514795 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.361209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31248531-7181-4c6c-b794-13bec9514795 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.371111 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-31248531-7181-4c6c-b794-13bec9514795 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.016916 Apr 09 20:58:00.371845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 446/928] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:58:00 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:00.390077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:00.390692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:00.396886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.397391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.398229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.398665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.791561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:00.799209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4234ad5b-4958-4f31-873a-0991264f7bb4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1310 microversion: 2.1 time: 0.412854 Apr 09 20:58:00.799768 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 447/929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:00 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1310 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:00.802652 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9042b895-7201-4dfe-8982-9575cafde7b3 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.455688 Apr 09 20:58:00.805126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:00.805859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:00.809518 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 483/930] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:57:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:00.814558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.814722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:00.815269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:00.815590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.816632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.817540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.822326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.822972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.823951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:00.824390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:00.954252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:00.962064 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-592bdb0d-3c37-40be-a776-edcb55e08805 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1270 microversion: 2.1 time: 0.151273 Apr 09 20:58:00.962629 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 484/931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:00 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:00.967143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-513510647", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:01.020453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:58:01.086292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:01.095205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:01.096961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:01.098430 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc64722e-1221-48e1-88f3-30d829471fea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.297558 Apr 09 20:58:01.109779 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 448/932] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:00 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:01.115383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d791f069-7455-477d-9347-ebab1e795dc7 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Action: 'create', calling method: .version_select at 0x7fb08efdd280>, body: {"pool": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:01.489861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:58:01.490625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:58:01.491270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:58:01.491688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:58:01.492151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:58:01.501873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.502327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:01.503545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.504176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:01.523277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:58:01.528761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for user 5ab294d1890047aababb87b3a865a14c and project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:58:01.540805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:58:01.543141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:58:01.591408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cafed396-0265-428c-87ec-98cbd45df839 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627463 Apr 09 20:58:01.596737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 485/933] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:58:01.596737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:01.597327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:01.604077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.604842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:01.605878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.606890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:01.873280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:01.883956 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e7184ea-bc02-4c24-bca6-57c0e6485883 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.290796 Apr 09 20:58:01.885923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 486/934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:01 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:01.892264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:01.893082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:01.899566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.900432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:01.901464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:01.902081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:02.509917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:02.518501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8cae5e89-443e-4c9d-8aaa-f09887a75ed4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.631235 Apr 09 20:58:02.519131 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 487/935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:01 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:02.539544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:02.540304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:02.547278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:02.547808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:02.548720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:02.549277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:02.665268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:02.675905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c8a2d3a4-fb4a-4814-a359-c22274d66c4b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1272 microversion: 2.1 time: 0.155359 Apr 09 20:58:02.677201 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 488/936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:02 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:02.682150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:02.682740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:02.697575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:02.698075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:02.698883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:02.699325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.080310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:03.089248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a711dce8-3362-4ee5-a60e-b384fca69c8c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1310 microversion: 2.1 time: 0.410725 Apr 09 20:58:03.090416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 489/937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:02 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1310 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:03.095435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:03.096251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:03.104323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.105172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.105982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.106765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.504942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:03.512522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-915b2438-c324-4872-bfdb-31624c633834 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.420868 Apr 09 20:58:03.513126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 490/938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:03 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:03.517940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:03.518781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:03.525214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.525665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.526454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.526892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.908711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:03.917624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:03.919388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:03.920630 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7e5dc70-118c-4549-b1ca-441f3bed94dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.406361 Apr 09 20:58:03.921311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 491/939] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:03 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:03.935737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:03.936442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:03.942344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.942793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:03.943561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:03.944011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.377062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:04.387719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7aac4d34-aa65-4fef-9c04-25d0dbd5c168 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.455535 Apr 09 20:58:04.388704 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 492/940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:03 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:04.393785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6a84b24d-eefa-4139-9c4b-75247d27ca21 req-aa8bc651-78b1-435f-8633-d71f2563f790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d604fb79-470d-4cc5-88e6-a68d9a19a125", "name": "network-vif-plugged", "status": "completed", "tag": "1bc4d915-ee13-4ba8-922e-b46c28ad4602"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:04.402067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6a84b24d-eefa-4139-9c4b-75247d27ca21 req-aa8bc651-78b1-435f-8633-d71f2563f790 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.402817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6a84b24d-eefa-4139-9c4b-75247d27ca21 req-aa8bc651-78b1-435f-8633-d71f2563f790 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.414709 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6a84b24d-eefa-4139-9c4b-75247d27ca21 req-aa8bc651-78b1-435f-8633-d71f2563f790 service nova] Creating event network-vif-plugged:1bc4d915-ee13-4ba8-922e-b46c28ad4602 for instance d604fb79-470d-4cc5-88e6-a68d9a19a125 on nch1-master-1 Apr 09 20:58:04.419771 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6a84b24d-eefa-4139-9c4b-75247d27ca21 req-aa8bc651-78b1-435f-8633-d71f2563f790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Apr 09 20:58:04.420370 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 493/941] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:04.425426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:04.426126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:04.432578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.433342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.434370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.435006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.601166 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d791f069-7455-477d-9347-ebab1e795dc7 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.489763 Apr 09 20:58:04.608309 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 449/942] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:58:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:04.608309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:04.608588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:04.615938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.616491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.617728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.618366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.822294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:04.833498 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4879599-0901-46fe-95bd-cc7578a992cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1316 microversion: 2.1 time: 0.411824 Apr 09 20:58:04.834203 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 494/943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:04 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:04.840469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:04.841779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:04.848556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.849138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:04.849934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:04.850371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:05.003172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:05.010784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8e88527-b336-4c5a-b96e-4ef11491f245 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.407372 Apr 09 20:58:05.011377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 450/944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:04 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:05.018468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:05.021106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:05.027553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:05.028016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:05.028804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:05.029428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:05.222117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:05.230123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-faf7dc40-1ba6-4a8d-a3fa-66a347c8489c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1310 microversion: 2.1 time: 0.393528 Apr 09 20:58:05.230719 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 495/945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:04 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1310 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:05.235502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af6774db-88a6-4c21-9d53-21a19dd525fa tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Action: 'create', calling method: .version_select at 0x7fb08ecbcee0>, body: {"pool": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:05.455402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:05.463952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce0bc183-4c3e-40e9-af17-c99558188f98 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.451326 Apr 09 20:58:05.473414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 451/946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:05 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:05.473414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:05.473414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:05.477272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:05.477765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:05.478584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:05.479018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:06.192808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:06.203716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:06.205313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:06.206470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3b907602-391c-42ca-9fff-b5b51c94c15d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.740567 Apr 09 20:58:06.207242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 452/947] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:05 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:06.212444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:06.213154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:06.220040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:06.220492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:06.221307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:06.221738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:06.640529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:06.650814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ad67139-bd49-4a6b-86a7-e8070373f243 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.442558 Apr 09 20:58:06.662600 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 453/948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:06 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:06.667589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:06.668198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:06.674183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:06.674626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:06.675383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:06.675807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.025990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:07.035555 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ec57131-ce31-440e-8b1d-2c04478a0f83 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1466 microversion: 2.1 time: 0.371734 Apr 09 20:58:07.036132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 454/949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:06 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1466 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:07.040681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5efa4542-3b75-44ce-879c-d2096331e1d0 req-c282582e-b75d-44e9-981a-d94850df8b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "tag": "2059c476-7239-469e-bc1b-235cc6bd25a2"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:07.049272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5efa4542-3b75-44ce-879c-d2096331e1d0 req-c282582e-b75d-44e9-981a-d94850df8b53 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.049754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5efa4542-3b75-44ce-879c-d2096331e1d0 req-c282582e-b75d-44e9-981a-d94850df8b53 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.060963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5efa4542-3b75-44ce-879c-d2096331e1d0 req-c282582e-b75d-44e9-981a-d94850df8b53 service nova] Creating event network-changed:2059c476-7239-469e-bc1b-235cc6bd25a2 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:07.066033 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5efa4542-3b75-44ce-879c-d2096331e1d0 req-c282582e-b75d-44e9-981a-d94850df8b53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028727 Apr 09 20:58:07.066644 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 455/950] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:07.071680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:07.072364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:07.079005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.079464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.080302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.080738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.452726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:07.476843 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-622d5e5c-423d-4b21-806f-a58c39008089 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.401716 Apr 09 20:58:07.479612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 456/951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:07 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:07.485961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:07.486980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:07.496612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.497580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.498787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.499766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.821112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:07.828610 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2faa3e90-f7ce-4b93-88cf-7ab5ef209a26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1494 microversion: 2.1 time: 0.347740 Apr 09 20:58:07.829327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 457/952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:07 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:07.834241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:07.835231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:07.841812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.842317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:07.843076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:07.843701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.085383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:08.100034 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a0c3175-92a4-4c51-bc4a-95ab1c3d7b76 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.269437 Apr 09 20:58:08.100802 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 458/953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:07 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:08.109921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:08.109921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:08.112307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.112571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.113401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.113838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.347873 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-76da91de-53a2-4819-9581-b07bae53ee15 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1617 microversion: 2.1 time: 0.245918 Apr 09 20:58:08.348458 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 459/954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:08 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1617 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:08.353027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:08.353675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:08.360952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.361425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.362204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.362661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.486166 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af6774db-88a6-4c21-9d53-21a19dd525fa tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.254014 Apr 09 20:58:08.486924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 496/955] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 20:58:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:08.495673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:08.497643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:08.504230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.504659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.505468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.505904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.526271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:08.534982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:08.536620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:08.537858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e25d4129-99d6-41e4-9cdc-4a43bba14981 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.188491 Apr 09 20:58:08.542217 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 460/956] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:08 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:08.542805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:08.543408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:08.549489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.549947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.550735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.551171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.675602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:08.684393 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-056659ae-76c7-484e-8ed2-dbb4a86699d5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.196102 Apr 09 20:58:08.684942 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 497/957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:08 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:08.689909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1076089751", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["acad92b7-b70e-44e1-9c3d-2938f626d037"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:08.710130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93cd4b04-e827-49dd-84d0-cb5d9a685a0e tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1645 microversion: 2.1 time: 0.170300 Apr 09 20:58:08.710638 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 461/958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:08 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1645 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:08.715142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:08.715884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:08.721992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.722443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.723219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:08.723651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:08.749281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:58:09.017481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:09.025352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-480db5a1-833a-4bc3-b18c-f4614735af45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.313665 Apr 09 20:58:09.025932 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 462/959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:08 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:09.039690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-157607a5-81ca-49cf-b800-d186400a64cb tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08efc24c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:09.310413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:58:09.310938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:58:09.311522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:58:09.311924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:58:09.312325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:58:09.322592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.323084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:09.323897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.324341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:09.341344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:58:09.345569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:58:09.357246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:58:09.359591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:58:09.389417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-157607a5-81ca-49cf-b800-d186400a64cb tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/bfa3320b-8a75-45ec-a5f1-7d111d47c1a7" status: 200 len: 141 microversion: 2.1 time: 0.353080 Apr 09 20:58:09.390143 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 463/960] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 20:58:09 2022] GET /compute/v2.1/os-floating-ips/bfa3320b-8a75-45ec-a5f1-7d111d47c1a7 => generated 141 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:09.394828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:09.395569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:09.402449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.402898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:09.403678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.404282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:09.407847 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd94f25d-5346-41a0-bc96-22aa62560836 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721593 Apr 09 20:58:09.415861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 498/961] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:58:09.420760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:09.421395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:09.429315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.433653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:09.435164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:09.436012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.051173 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-720e43e5-f110-48e8-88c1-9d92f3433cde tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1645 microversion: 2.1 time: 0.659954 Apr 09 20:58:10.054478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.054894 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 464/962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:09 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1645 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:10.059182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87355ccc-05d7-430d-aafc-b3bea4e08127", "tag": "cc886072-17df-443d-8237-a748bd33f221"}, {"name": "network-changed", "server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "tag": "32344bfe-ee77-4304-b233-8b85f1618023"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:10.063299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b58022f0-0d64-4164-9163-2090c2d6c4a8 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.646325 Apr 09 20:58:10.064095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 499/963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:09 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:10.070360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.070863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.076971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fc59241-fed7-4009-ba04-7645d7064239 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08ebd71f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:10.083489 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] Creating event network-changed:cc886072-17df-443d-8237-a748bd33f221 for instance 87355ccc-05d7-430d-aafc-b3bea4e08127 on nch1-master-1 Apr 09 20:58:10.083998 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] Creating event network-changed:32344bfe-ee77-4304-b233-8b85f1618023 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:10.090498 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-abd1044e-8203-4fec-ae61-1f84f56127ad req-dcde8bd5-57fe-4b67-9d46-2d54dd99134a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034806 Apr 09 20:58:10.091562 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 465/964] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:10.096920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:10.097685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:10.105264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.105714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.106850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.107300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.212340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.222391 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a2062ae-0d0a-449e-8376-1c8dfb762fe1 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1221 microversion: 2.1 time: 0.129576 Apr 09 20:58:10.222967 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 466/965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:10 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:10.229700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:10.230506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:10.239128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.239554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.240377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.240809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.567528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.576988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.578668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.579937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9dd6061e-55e5-438c-897c-271bdd669ad0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.355883 Apr 09 20:58:10.580590 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 467/966] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:10 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:10.585509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:10.586220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:10.592808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.593374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.594294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.594801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.875466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:10.883947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18d774b9-6fd5-4578-a521-7253225bd2ab tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.301891 Apr 09 20:58:10.884744 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 468/967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:10 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:10.897283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:10.898067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:10.904471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.904932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:10.905759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:10.906181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.089999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:11.098847 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6318eef4-3e04-4267-850d-9fcf40c4092d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.213140 Apr 09 20:58:11.108684 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 469/968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:10 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:11.108684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.108684 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:58:11.108684 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:58:11.108684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.109264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.109264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.109445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.133154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a2d91ff-8077-4ca1-883f-1eadc0a51801 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.031936 Apr 09 20:58:11.133498 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 470/969] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:11.138106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.138777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:11.144737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.145232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.146002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.146439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.309915 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fc59241-fed7-4009-ba04-7645d7064239 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/bfa3320b-8a75-45ec-a5f1-7d111d47c1a7" status: 202 len: 0 microversion: 2.1 time: 1.244413 Apr 09 20:58:11.310592 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 500/970] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:58:10 2022] DELETE /compute/v2.1/os-floating-ips/bfa3320b-8a75-45ec-a5f1-7d111d47c1a7 => generated 0 bytes in 1246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:11.316361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:11.317568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:11.324780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.325449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.326485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.327221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.354316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:11.362233 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ebc98f3-6fa2-424f-ad34-15ae9953b346 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.227604 Apr 09 20:58:11.363074 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 471/971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:11.367909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.368722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:11.375465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.375983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.376839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.377380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.402060 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec8d992f-6dda-4e8f-9e6f-e8b22ac9e870 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125/action" status: 202 len: 0 microversion: 2.1 time: 0.089620 Apr 09 20:58:11.402794 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 501/972] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:11 2022] POST /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:11.408164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5f071a9-be42-4147-b70c-0e5e876e5820 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08ebd7550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.467373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:11.475352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8c82b58-84a3-4893-b6bd-a73f812246e9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1221 microversion: 2.1 time: 0.111045 Apr 09 20:58:11.476040 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 472/973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:11.480496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.481461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:11.487507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.488193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.489172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.489888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.689240 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5f071a9-be42-4147-b70c-0e5e876e5820 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.284825 Apr 09 20:58:11.695661 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 502/974] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:58:11.700564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:11.701343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:11.707976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.708429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.709236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:11.709668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:11.725700 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa8df358-0655-4765-9ec7-190da3ce819d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1650 microversion: 2.1 time: 0.248590 Apr 09 20:58:11.726288 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 473/975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1650 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:11.730703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06e5e014-ab58-435a-ae17-caa8e68b9420 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08ef89c10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.089068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.098061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.099612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.100907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-56b64fd0-28f8-480e-b98e-b6af3a491bdc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.404242 Apr 09 20:58:12.101554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 503/976] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:12.115271 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06e5e014-ab58-435a-ae17-caa8e68b9420 tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.387884 Apr 09 20:58:12.116241 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 474/977] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 20:58:11 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:12.121524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.122206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:12.122800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.123443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:12.128932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.129418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.129875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.130236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.130371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.130677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.131059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.131524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.407309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.415328 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7466c775-f6d2-44b0-bf13-98e50d7957c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.302583 Apr 09 20:58:12.424792 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 504/978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:12 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:12.425168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.425295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c32de86-8c93-48e2-ae25-a193025ba70a tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08ebea3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.427221 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c47a4613-2e93-46d4-be6c-53a5e268f10e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.309901 Apr 09 20:58:12.427888 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 475/979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:12 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:12.432637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.433309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:12.442281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.442773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.443603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.444248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.775277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.783206 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c90b2b6-d35d-494b-8a18-ea4863a5dfcc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.354238 Apr 09 20:58:12.785132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 476/980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:12 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:12.788765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.789765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:12.795846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.796300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.797122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.797559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.866506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:12.875381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b99c8ac-11a5-4d44-825f-aa899eea5a6f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1221 microversion: 2.1 time: 0.090436 Apr 09 20:58:12.875989 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 477/981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:12 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:12.880483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:12.881108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:12.887530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.887985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:12.888771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:12.889237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.450202 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab4318ed-f772-45cc-8fbf-e885239778c2 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1630 microversion: 2.1 time: 0.573074 Apr 09 20:58:13.461867 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 478/982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:12 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1630 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:13.466912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:13.467575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:13.473534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.473980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.474753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.475187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.678036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:13.688674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:13.690460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:13.691643 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c8db4b3-6a36-49aa-94a0-9671f20a4afa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.228701 Apr 09 20:58:13.692211 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 479/983] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:13 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:13.702354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c32286d2-c55a-49b3-964d-22f29971748e req-0f096f39-46bc-4edb-8956-f74a32325fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87355ccc-05d7-430d-aafc-b3bea4e08127", "name": "network-vif-plugged", "status": "completed", "tag": "cc886072-17df-443d-8237-a748bd33f221"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:13.705205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c32286d2-c55a-49b3-964d-22f29971748e req-0f096f39-46bc-4edb-8956-f74a32325fae service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.705678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c32286d2-c55a-49b3-964d-22f29971748e req-0f096f39-46bc-4edb-8956-f74a32325fae service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.716673 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c32286d2-c55a-49b3-964d-22f29971748e req-0f096f39-46bc-4edb-8956-f74a32325fae service nova] Creating event network-vif-plugged:cc886072-17df-443d-8237-a748bd33f221 for instance 87355ccc-05d7-430d-aafc-b3bea4e08127 on nch1-master-1 Apr 09 20:58:13.721605 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c32286d2-c55a-49b3-964d-22f29971748e req-0f096f39-46bc-4edb-8956-f74a32325fae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028045 Apr 09 20:58:13.722179 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 480/984] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:13.727379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:13.728085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:13.735253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.735716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.736537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.736985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.930149 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c32de86-8c93-48e2-ae25-a193025ba70a tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/f35b52f2-490c-43c5-8baa-c8afb34679e2" status: 202 len: 0 microversion: 2.1 time: 1.513201 Apr 09 20:58:13.933939 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 505/985] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:58:12 2022] DELETE /compute/v2.1/os-floating-ips/f35b52f2-490c-43c5-8baa-c8afb34679e2 => generated 0 bytes in 1517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:13.938989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:13.939603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:13.946135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.946594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.947384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:13.947825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:13.983996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:13.991692 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-825eb1e2-3fd2-4192-9394-db2b2391f414 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.268308 Apr 09 20:58:13.992466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 481/986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:13 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:13.996852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:13.998070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:14.004599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.005078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.005909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.006352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.031403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lazy-loading 'flavor' on Instance uuid d604fb79-470d-4cc5-88e6-a68d9a19a125 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:58:14.043854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Going to try to live migrate instance to nch2-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 20:58:14.086588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:14.094168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-680f04eb-9e58-4aca-a6d3-6fda3c550062 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1312 microversion: 2.1 time: 0.159212 Apr 09 20:58:14.094740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 506/987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:13 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:14.099124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:14.099721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:14.105677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.106462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.107229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.107654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.251162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:14.259142 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b350a02-0b37-4f58-912c-dc8957384b6a tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.163446 Apr 09 20:58:14.259706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 507/988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:14 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:14.264214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:14.264824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:14.270900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.271353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.272132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:14.272599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:14.334549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:14.342376 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a79209e2-95c5-4730-b214-0a6ff254b217 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1221 microversion: 2.1 time: 0.081691 Apr 09 20:58:14.343055 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 508/989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:14 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:14.348159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-47327a2c-8b88-4ed6-9612-ba9952868e9c tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08eb9b3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:15.083808 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-47327a2c-8b88-4ed6-9612-ba9952868e9c tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/0f7a0864-a090-4cdb-b4fb-6a9baa603f1c" status: 202 len: 0 microversion: 2.1 time: 0.739615 Apr 09 20:58:15.084589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 509/990] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:58:14 2022] DELETE /compute/v2.1/os-floating-ips/0f7a0864-a090-4cdb-b4fb-6a9baa603f1c => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:15.089366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:15.090060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:15.098575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:15.099022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:15.099798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:15.100232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:15.234950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:15.243668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:15.245208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:15.246404 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52bfcbfd-a525-4239-b8b5-3628da7d7c31 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.160788 Apr 09 20:58:15.246947 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 510/991] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:15 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:15.251334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:15.251935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:15.258160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:15.258554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:15.259517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:15.259959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:15.392001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:15.399721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20423191-5fbb-4695-8082-9d7447c21448 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.151771 Apr 09 20:58:15.400297 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 511/992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:15 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:15.412580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66d90d4d-94cc-4cbd-9d3d-1cbe98d7ebee tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] Calling method '.version_select at 0x7fb08ebd70d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.111380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f637f26b-1358-4d41-8131-1c1ab3feda17 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125/action" status: 202 len: 0 microversion: 2.1 time: 2.117965 Apr 09 20:58:16.112192 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 482/993] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:13 2022] POST /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125/action => generated 0 bytes in 2119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:16.117318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.118291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.147787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.149619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.150661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.151558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.208320 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66d90d4d-94cc-4cbd-9d3d-1cbe98d7ebee tempest-FloatingIPDetailsTestJSON-1163293050 tempest-FloatingIPDetailsTestJSON-1163293050-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/df77258d-a6ef-46ae-a7ff-30019e75375d" status: 202 len: 0 microversion: 2.1 time: 0.806883 Apr 09 20:58:16.208931 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 512/994] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 20:58:15 2022] DELETE /compute/v2.1/os-floating-ips/df77258d-a6ef-46ae-a7ff-30019e75375d => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:16.214205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.214821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.228920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.229687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.230657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.231596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.486337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.495009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2753b9f2-33b6-4951-a3f8-9e31ad116931 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1462 microversion: 2.1 time: 0.381610 Apr 09 20:58:16.505325 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 483/995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1462 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:16.510576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.511213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.519272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.519704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.520530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.520923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.555537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.563687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc5722ce-36c9-4306-b9bf-8823118c9967 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.353247 Apr 09 20:58:16.564271 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 513/996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:16.569675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.570527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.577505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.578260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.579256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.580227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.624768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.632583 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87928ad9-5a64-4f6d-9ff0-0766a2a78b67 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1275 microversion: 2.1 time: 0.135837 Apr 09 20:58:16.633684 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 484/997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:16.639306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.640097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.647368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.647810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.648617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.649060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.834260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.842707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d5d96b4-d861-4fcc-b744-9940eeeade8f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.277018 Apr 09 20:58:16.843318 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 514/998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:16.848072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:16.849074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.856529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.856756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.857460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.857899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.880139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.909514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.911245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:16.912531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8406be28-f9a4-4b08-b90d-a577f8109cd2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.277499 Apr 09 20:58:16.913538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 485/999] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:16.918330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:16.919354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:16.926020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.926467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:16.927777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:16.927777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.038069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:17.044858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Old instance type m1.heat2, new instance type m1.heat {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 20:58:17.051853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:58:17.052263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:58:17.052733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:58:17.053178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:58:17.053649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:58:17.116981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:17.128954 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ce0b61f-6e93-461c-bfe3-54eba16459fe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.284585 Apr 09 20:58:17.130265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 515/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:16 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:17.179661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd9935b0-bb44-4157-b5f2-369d8432754d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127/action" status: 202 len: 0 microversion: 2.1 time: 0.264913 Apr 09 20:58:17.183678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 486/1001] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:16 2022] POST /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:17.192292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:17.192857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:17.199722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.200196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.201147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.201595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.430805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:17.444947 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a667f73-fcbf-404b-9a49-3cf367ddc499 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1471 microversion: 2.1 time: 0.256465 Apr 09 20:58:17.445580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 516/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:17 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:17.594055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:17.594732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:17.617370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.617820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.618616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.619054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.648833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:17.649735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:17.658168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.662093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:17.663036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:17.663493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:18.398766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:18.413450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c499f66-a111-4e0d-96d4-860f008931fc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.837431 Apr 09 20:58:18.414054 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 487/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:17 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:18.418125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:18.426557 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7adbe2c5-df95-4f9d-b708-decd4bd5c33d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.781717 Apr 09 20:58:18.426938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:18.437143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:18.437252 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 517/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:17 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:18.437686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:18.437686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:18.445585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:18.445997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:18.446543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:18.454513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:18.467953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:18.469980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:18.476203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:18.476922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:18.984804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.000260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bfc9a50e-2881-484c-867d-421dd1bd7c66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.584820 Apr 09 20:58:19.009124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.010993 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 488/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:18 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:19.014960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.016476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.025589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-700c4e52-26cf-43b5-a9e8-1a7f4bd0f81b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.593430 Apr 09 20:58:19.030724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:19.033458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:19.047894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.051060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.052876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.055406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.057781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 518/1006] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:18 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:19.063214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:19.073642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:19.108961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.117244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.119934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.120665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.401120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.410396 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a3f5c90-a794-475c-b308-275d3985140f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.391588 Apr 09 20:58:19.420410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 489/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:19 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:19.425658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-64826696-7a35-4186-9791-5d87cd94aea6 req-51dacefe-7a29-48b4-8240-fbf0c31806ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "name": "network-vif-plugged", "status": "completed", "tag": "2059c476-7239-469e-bc1b-235cc6bd25a2"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:19.434738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-64826696-7a35-4186-9791-5d87cd94aea6 req-51dacefe-7a29-48b4-8240-fbf0c31806ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.435433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-64826696-7a35-4186-9791-5d87cd94aea6 req-51dacefe-7a29-48b4-8240-fbf0c31806ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.448766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-64826696-7a35-4186-9791-5d87cd94aea6 req-51dacefe-7a29-48b4-8240-fbf0c31806ff service nova] Creating event network-vif-plugged:2059c476-7239-469e-bc1b-235cc6bd25a2 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:19.457397 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-64826696-7a35-4186-9791-5d87cd94aea6 req-51dacefe-7a29-48b4-8240-fbf0c31806ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Apr 09 20:58:19.458618 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 490/1008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:19.464182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:19.465213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:19.472389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.473237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.474440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.475607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.481767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.493084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e1fa5f7-ccb8-41a2-83d0-ceca57bd3b19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1471 microversion: 2.1 time: 0.434074 Apr 09 20:58:19.497506 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 519/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:19 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:19.506905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:19.507899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:19.517997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.519932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.521013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.521664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.938261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.941630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:19.949822 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0950215-a217-451f-bb37-203ed899a224 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.489753 Apr 09 20:58:19.950005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-411caa3c-23bf-4e08-9e55-957bbb409f91 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.450849 Apr 09 20:58:19.951057 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 520/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:19 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:19.958020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-575b6e4c-8b02-4e04-be12-d2efdef2a6c5 req-f8cf32a1-554e-4fe5-94ae-15be86524ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c0339f-48c4-473d-93ae-db67c877fb5e", "tag": "754b37cf-8904-48a6-9835-7135d3f52459"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:19.969922 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 491/1011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:19 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:19.973351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-575b6e4c-8b02-4e04-be12-d2efdef2a6c5 req-f8cf32a1-554e-4fe5-94ae-15be86524ce4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:19.973806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-575b6e4c-8b02-4e04-be12-d2efdef2a6c5 req-f8cf32a1-554e-4fe5-94ae-15be86524ce4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:19.988239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-575b6e4c-8b02-4e04-be12-d2efdef2a6c5 req-f8cf32a1-554e-4fe5-94ae-15be86524ce4 service nova] Creating event network-changed:754b37cf-8904-48a6-9835-7135d3f52459 for instance e5c0339f-48c4-473d-93ae-db67c877fb5e on nch2-master-1 Apr 09 20:58:19.993948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-575b6e4c-8b02-4e04-be12-d2efdef2a6c5 req-f8cf32a1-554e-4fe5-94ae-15be86524ce4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041103 Apr 09 20:58:19.995018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 521/1012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:20.017928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.018562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.024980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.025763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.026770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.027412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.045093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.045817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.052899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.053484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.054786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.055241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.368866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.373673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.380014 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e26d7866-4f7a-40f4-b6e3-429c1971fb26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.365388 Apr 09 20:58:20.381223 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 492/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:20.392652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.394652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.396120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d3e47f5-8d7f-4072-958f-e6ed64f578c1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.355885 Apr 09 20:58:20.407656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 522/1014] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:58:20.430754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.431382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.438877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.439323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.440646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.441121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.516473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.517128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.523251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.523708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.525321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.525767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.683379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.697166 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-be31a5c9-3b02-4964-98ef-c1588e2cb76f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.272692 Apr 09 20:58:20.706786 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 493/1015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:20.736646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:20.747407 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22157d66-7a8c-450c-8365-6f5ca7da2c12 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1471 microversion: 2.1 time: 0.239853 Apr 09 20:58:20.752492 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 523/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:20.984581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.985087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:20.985687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.986604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:20.997944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:20.998395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:20.999763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.000207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.000995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.002029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.002447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.006963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.225261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.228516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.237505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8af710dc-9c04-4b7c-9f94-91f055a8dc38 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.262674 Apr 09 20:58:21.237505 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 494/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:21.237667 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3203486-a043-4d34-aef4-0855f965b7b7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.261045 Apr 09 20:58:21.246887 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 524/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:20 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:21.269426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.269925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.276158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.276605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.277444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.277870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.301818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:58:21.377948 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e36b67b2-28b0-412c-8975-3347d6f207ff tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 204 len: 0 microversion: 2.1 time: 0.112181 Apr 09 20:58:21.378611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 495/1019] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:21 2022] DELETE /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:58:21.387085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.387813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.394927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.395473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.396312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.396995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.399323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.400000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.405901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.406350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.407122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.407556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.599201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.607077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.608595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6a46cdc-ee16-4ab0-94e6-85327d4bcea7 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.225623 Apr 09 20:58:21.609325 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 525/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:21 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:21.615963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc7fcc69-824c-409e-be4c-d0815c1eab66 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.221394 Apr 09 20:58:21.625429 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 496/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:21 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:21.625429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-badb475a-4e1c-4ded-a50a-21e90726a28f req-92b386e9-b0a4-440f-b3ca-191e2aa3accd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "name": "network-vif-plugged", "status": "completed", "tag": "32344bfe-ee77-4304-b233-8b85f1618023"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:21.627536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.628333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.634998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-badb475a-4e1c-4ded-a50a-21e90726a28f req-92b386e9-b0a4-440f-b3ca-191e2aa3accd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.635530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-badb475a-4e1c-4ded-a50a-21e90726a28f req-92b386e9-b0a4-440f-b3ca-191e2aa3accd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.635852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.636335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.637377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.637811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.649682 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-badb475a-4e1c-4ded-a50a-21e90726a28f req-92b386e9-b0a4-440f-b3ca-191e2aa3accd service nova] Creating event network-vif-plugged:32344bfe-ee77-4304-b233-8b85f1618023 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:21.654768 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-badb475a-4e1c-4ded-a50a-21e90726a28f req-92b386e9-b0a4-440f-b3ca-191e2aa3accd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036806 Apr 09 20:58:21.655625 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 497/1022] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:21.715535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.716435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.722873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.723446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.724416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.724974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.847592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.858662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.860614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.862419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-77ad60b5-3ad4-4b25-9c10-8c70d648180a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.251995 Apr 09 20:58:21.863717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 526/1023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:21 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:21.869550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:21.870401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:21.877784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.879116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.880246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:21.881345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:21.943665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:21.952030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-98532cee-bf23-4d6d-a3e8-908dd716bd22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.241133 Apr 09 20:58:21.962237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 498/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:21 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:22.033216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:22.040833 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-609aab2e-1665-4b58-9ba6-7fb1983d4105 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.175273 Apr 09 20:58:22.041448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 527/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:21 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:22.253679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:22.253937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:22.254288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:22.254422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:22.261368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.261598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.261837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.262341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.262647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.263070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.263271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.263879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.543068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:22.551172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-07ae0a87-3986-4e4d-b775-4fbf496e52a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.301356 Apr 09 20:58:22.560882 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 499/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:22 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:22.561282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:22.562651 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-412e159f-227a-4d12-8f4a-98a4b7db3309 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1333 microversion: 2.1 time: 0.312546 Apr 09 20:58:22.563361 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 528/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:22 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1333 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:22.628239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:22.628867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:22.633475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:22.634576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:22.638777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.639607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.640600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.641271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.647040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.647529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:22.649496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:22.650309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.303531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.308582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.317793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9561296c-eda8-4265-aa63-4ea353972ffc tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.695266 Apr 09 20:58:23.318203 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ddbb7d61-d7d6-4545-a11b-2e262b5ee57c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.688793 Apr 09 20:58:23.327752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 529/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:22 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:23.327934 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 500/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:22 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:23.329929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:23.330685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:23.333070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:23.334263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:23.337383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.338086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.338931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.339376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.341805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.342246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.343321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.343942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.701390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.707068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.708884 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac5b7b8b-d6b2-4ad6-97bc-b9b7b94eb865 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.381822 Apr 09 20:58:23.709576 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 501/1030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:23 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:23.714708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:23.715559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:23.717542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.719264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:23.720851 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5065c5c7-06d0-4bb6-b9cd-a8536c69381a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.399466 Apr 09 20:58:23.721649 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 530/1031] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:23 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:23.722395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.722911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.724010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.724511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.727557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:23.728175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:23.737573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.738033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:23.738966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:23.739577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.008883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:24.017987 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ce94900-8e30-40cb-a281-c50a12f91148 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.307158 Apr 09 20:58:24.018229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:24.019002 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 502/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:23 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:24.024695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.025736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.027478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3aa36b8-9ba8-4fbb-8176-1e5633e40121 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.304493 Apr 09 20:58:24.033572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.034376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.035244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.035806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.037210 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 531/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:23 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:24.226444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:24.234278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c261518-8514-4574-badc-b46f174afa2d tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1669 microversion: 2.1 time: 0.214215 Apr 09 20:58:24.234870 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 503/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1669 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:24.251619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.252117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.258542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.258990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.259814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.260431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.284480 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8eb856ca-9093-4368-a058-5d0bcfd1b9fe tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132/ips" status: 200 len: 180 microversion: 2.1 time: 0.036899 Apr 09 20:58:24.285578 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 532/1035] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132/ips => generated 180 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:24.296283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.296780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.303507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.303955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.305132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.305749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.331550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:58:24.340301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.340973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.352801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.353282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.354368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.354961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.430393 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-46a88e68-3835-4a36-8c7f-b982686d5db5 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "DELETE /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 204 len: 0 microversion: 2.1 time: 0.137627 Apr 09 20:58:24.431275 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 504/1036] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:24 2022] DELETE /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:58:24.456840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.457610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.464145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.464599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.465909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.471666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.675626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:24.695737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d916c30-1ede-49e0-95c2-41cb2deb84aa tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.363596 Apr 09 20:58:24.696673 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 533/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:24.701273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.701877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.718904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.719629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.720446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.721424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.795701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:24.804588 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d57f812f-d427-4aa4-a033-42e8ee21f40f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.371950 Apr 09 20:58:24.805746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 505/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:24.815199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:24.817340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:24.825070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.825554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:24.826603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:24.827528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.287766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.295964 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd003a06-93ae-4038-918c-9400bc580654 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1675 microversion: 2.1 time: 0.598235 Apr 09 20:58:25.297297 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 534/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1675 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:25.302859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:25.303743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:25.310445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.310894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.311675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.312111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.367922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.375364 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e599b3a9-169a-49b6-a61b-5807c88825de tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.568285 Apr 09 20:58:25.375915 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 506/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:24 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:25.380371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:25.381210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:25.387228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.387712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.388485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.388915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.602593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.611663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.613206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.614353 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-147ea842-4611-40ac-a163-20e30a20d2b3 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.315803 Apr 09 20:58:25.614925 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 535/1041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:25 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:25.619331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:25.620078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:25.626522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.626972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.627756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.628204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.660966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.668854 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38796eea-e0c9-4ea0-b8b4-eaa1f6fb18af tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.291933 Apr 09 20:58:25.669708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 507/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:25 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:25.713067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:25.713974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:25.720566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.721074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.721865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.722291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.825810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:25.834377 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49f27939-666a-4c58-a343-1fc8b3c4179f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.218201 Apr 09 20:58:25.834984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 536/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:25 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:25.839641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:25.840257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:25.846402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.846857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.847652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:25.848089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:25.994533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:26.003043 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b1e01808-8d1f-465c-90aa-2e9405e21f47 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.293791 Apr 09 20:58:26.003620 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 508/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:25 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:26.151360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:26.161508 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf9edbfe-5b03-4229-8bff-d8fd34f66e5a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.325295 Apr 09 20:58:26.162199 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 537/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:25 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:26.314902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:26.315904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:26.325946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.327182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.328532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.330199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.391759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:26.392364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:26.399378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.399825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.400617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.401073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.651774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:26.661137 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a98ba51-e623-435b-8723-fec62c90dcca tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1675 microversion: 2.1 time: 0.350947 Apr 09 20:58:26.662327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 509/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:26 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1675 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:26.667237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:26.667914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:26.674042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.674792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.675643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.676317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.686485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:26.695862 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b04eff99-e569-4939-8d0e-2e1a4dd3620c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.307894 Apr 09 20:58:26.699271 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 538/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:26 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:26.723012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:26.725963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:26.740660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.741139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:26.744200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:26.747670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.051310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.064652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.066908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.070910 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9f9c354b-5cc3-450f-8e24-72587c026304 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.406972 Apr 09 20:58:27.081952 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 510/1048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:26 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:27.090769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:27.091474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:27.096396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.104469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.104931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.106127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.107944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aca5bb6f-68f5-4fc1-ad82-b9951d287a99 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.407357 Apr 09 20:58:27.109262 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 539/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:26 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:27.114275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-57ee0c82-de8d-4752-9c48-9bb517ede8c2 req-52b8a519-ea37-4cf1-9f73-53c90627767f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "name": "network-vif-deleted", "tag": "2059c476-7239-469e-bc1b-235cc6bd25a2"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:27.114460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.123778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-57ee0c82-de8d-4752-9c48-9bb517ede8c2 req-52b8a519-ea37-4cf1-9f73-53c90627767f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.125357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-57ee0c82-de8d-4752-9c48-9bb517ede8c2 req-52b8a519-ea37-4cf1-9f73-53c90627767f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.137599 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-57ee0c82-de8d-4752-9c48-9bb517ede8c2 req-52b8a519-ea37-4cf1-9f73-53c90627767f service nova] Creating event network-vif-deleted:2059c476-7239-469e-bc1b-235cc6bd25a2 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:27.144243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-57ee0c82-de8d-4752-9c48-9bb517ede8c2 req-52b8a519-ea37-4cf1-9f73-53c90627767f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Apr 09 20:58:27.144966 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 540/1050] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:27.150880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:27.152134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:27.162447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.163300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.164329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.165160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.544166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.548712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.558682 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23bd11fe-abb0-4c50-8a59-fbe897600647 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.411713 Apr 09 20:58:27.567873 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-328c7446-f4dc-4938-937e-256976eb7041 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.480948 Apr 09 20:58:27.577476 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 541/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:27 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:27.579790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 511/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:27 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:27.586814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:27.587458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:27.599007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.599533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.606679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.607166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.679421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:27.680447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:27.694057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.695758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.696997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.698138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.801999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730fd7f2ff9e4e96be5e412ad86bb0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fe086a6e94378997756b1fc02a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.814426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52b54252-4e53-418d-9e80-6f443dff39bc tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 200 len: 1453 microversion: 2.1 time: 0.139477 Apr 09 20:58:27.827461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 512/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:27 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:27.833665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:27.834712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:27.841385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.842142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.843139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:27.843798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:27.925546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:27.938763 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b9656fb9-6bce-494d-bd21-2ab2b583df58 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.364431 Apr 09 20:58:27.939690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 542/1054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:27 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:28.098559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.098559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.136977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.137811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.138680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.139122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.140866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.150993 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63292e99-d379-483f-8dad-5b6e54767b0e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.321711 Apr 09 20:58:28.154538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 513/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:27 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:28.160660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.173712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.193101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.193639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.194483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.198234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.404702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.413830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf1c742b-7a5b-4950-b21c-239b4668470e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.258149 Apr 09 20:58:28.414444 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 514/1056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:28.418218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.436367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.437927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.447828 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fe1dc31-6ea3-408d-a7de-b0127b5d77a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.361422 Apr 09 20:58:28.448468 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 543/1057] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:28.577093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.577881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.584539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.585507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.585951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.586568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.587006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.587656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.592948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.595335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.596775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.597730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.843008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.854927 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-342403b1-dfaf-45cc-90cb-f30f1e9ebec9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.282491 Apr 09 20:58:28.857888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:28.861631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 515/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:28.866846 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40deec32-d000-4c0f-a0ee-0544fa59ce1e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.285858 Apr 09 20:58:28.869808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 544/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:28.870360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.871050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.877346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.877776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.878715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.879293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.901906 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. Apr 09 20:58:28.902708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:28.903742 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82f56362-dfeb-44ed-bb2f-27cd8c199c51 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 404 len: 111 microversion: 2.1 time: 0.040912 Apr 09 20:58:28.904482 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 516/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:28.959038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:28.959666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:28.966190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.966652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:28.967441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:28.967875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.169584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:29.170860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:29.180858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.181689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.182855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.183618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.205758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:29.216123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1043b8c3-e178-4b9c-be78-2f004254d50b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.261121 Apr 09 20:58:29.217586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 545/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:28 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:29.231013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ea0fd513-fd93-4c6d-99f8-bab959c763cd req-18295dda-014e-43dd-b826-6fda168ea648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264b15de-9eb2-4ae0-bdf8-f3c721a93132", "name": "network-vif-deleted", "tag": "32344bfe-ee77-4304-b233-8b85f1618023"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:29.240670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ea0fd513-fd93-4c6d-99f8-bab959c763cd req-18295dda-014e-43dd-b826-6fda168ea648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.241144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ea0fd513-fd93-4c6d-99f8-bab959c763cd req-18295dda-014e-43dd-b826-6fda168ea648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.253157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ea0fd513-fd93-4c6d-99f8-bab959c763cd req-18295dda-014e-43dd-b826-6fda168ea648 service nova] Creating event network-vif-deleted:32344bfe-ee77-4304-b233-8b85f1618023 for instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 on nch1-master-1 Apr 09 20:58:29.258157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ea0fd513-fd93-4c6d-99f8-bab959c763cd req-18295dda-014e-43dd-b826-6fda168ea648 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039166 Apr 09 20:58:29.258761 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 546/1062] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:29.432368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:29.433081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:29.453607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.455762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.457850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.462711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.471533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:29.483030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3557ffb-d188-489b-a031-17a18c542f99 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.318677 Apr 09 20:58:29.486403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 517/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:29 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:29.492232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:29.497443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:29.516116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.516901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:29.517956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:29.518617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.063609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.077658 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-011e41d1-d3e3-43ab-88ae-b13fdc4fdf4a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.649474 Apr 09 20:58:30.079763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 547/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:29 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:30.085850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:30.086808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:30.097287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.099003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.099792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.100847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.102360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.107525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.112494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.116284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b25ccf8b-515a-419a-b2bd-e297c4309864 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.628541 Apr 09 20:58:30.129878 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 518/1065] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:29 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:30.135462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:30.136076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:30.154305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.154661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.155446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.155883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.472689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.483258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79dfab61-2cd1-40f2-831c-1e1f5a506c2d tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.401900 Apr 09 20:58:30.485422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 548/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:30 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:30.499318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:30.502160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:30.511697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.512516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.513695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.514285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.517596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.527575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6979f47-d6a5-45e6-ac12-e7b760f72b5d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.396005 Apr 09 20:58:30.537169 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 519/1067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:30 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:30.542248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:30.543106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:30.549331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.550012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.551021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:30.551669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:30.837217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.844990 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc32a35a-6d2a-4860-a1de-6bbd41bee121 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.358279 Apr 09 20:58:30.845601 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 549/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:30 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:30.893311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:30.904071 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12e76633-c722-41e5-983f-fd4434c293ae tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.365483 Apr 09 20:58:30.905666 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 520/1069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:30 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:31.096328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:31.097373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:31.104022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.105207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.106987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.107690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.148475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:31.149506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:31.159675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.160128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.172687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.172945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.413475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:31.427497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0062a78e-815c-4362-a721-c7bbb2de4052 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.334149 Apr 09 20:58:31.429530 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 550/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:31 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:31.509543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:31.511936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:31.526098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:31.531755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.533993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.535806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.536583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.540620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:31.543167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:31.545263 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e07787d0-13b3-4bf8-820b-33a162e1c9f2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.401368 Apr 09 20:58:31.546121 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 521/1071] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:31 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:31.565263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:31.566324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:31.599669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.600865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:31.604689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:31.605945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.323053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:32.332439 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d5796f8-64d7-44bf-afde-987ff96f9ea4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.831187 Apr 09 20:58:32.338394 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 551/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:31 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:32.345335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:32.346383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:32.352216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:32.364805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4cd22376-a067-4a35-83c3-bbe4add44cbe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.804336 Apr 09 20:58:32.368281 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 522/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:31 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:32.373485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.376365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.378476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.380494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.381796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:32.384925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:32.400505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.403200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.406392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.408622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.892760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:32.903528 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd35dd0d-e60d-4e5c-b34a-b6c0883329ba tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.562753 Apr 09 20:58:32.907590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 552/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:32 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:32.917832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:32.920504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:32.950672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.951124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.951970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:32.952378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:32.971854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:32.999009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f31e410c-c931-4d87-bef6-8817dbdbfbc0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.627679 Apr 09 20:58:33.009326 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 523/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:32 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:33.015291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:33.016176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:33.023896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.024636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.025684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.029916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.300059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:33.308295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5af107b0-65ba-4036-bf4d-8c571c1911b9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.394493 Apr 09 20:58:33.320129 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 553/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:32 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:33.324509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:33.325152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:33.338657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.339261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.341477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.342021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.374306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. Apr 09 20:58:33.375442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:33.377108 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7070ca5-44b7-49dd-8cb1-d8c7657d321c tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "DELETE /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 404 len: 111 microversion: 2.1 time: 0.064143 Apr 09 20:58:33.377931 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 554/1077] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:33 2022] DELETE /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:33.396392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:33.397603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:33.410274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.411110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.412169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.414021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.629619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:33.640746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:33.642689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:33.644639 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3c635a8-e80a-469a-8391-ff4caa55ea84 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.633078 Apr 09 20:58:33.645740 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 524/1078] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:33 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:33.650960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:33.651737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:33.659155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.659961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.661134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:33.661733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:33.975676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:33.992684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d33c73e3-8eb6-49c0-be82-ea231f92f13b tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.610083 Apr 09 20:58:34.003627 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 555/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:33 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:34.003627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.007631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 264b15de-9eb2-4ae0-bdf8-f3c721a93132] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.022576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.023041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.029602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.030260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.076432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. Apr 09 20:58:34.077706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 264b15de-9eb2-4ae0-bdf8-f3c721a93132 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:34.081442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d8aff07-1ea1-4ac8-9bb3-f2b9cfe3ad06 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132" status: 404 len: 111 microversion: 2.1 time: 0.084279 Apr 09 20:58:34.085469 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 556/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:33 2022] GET /compute/v2.1/servers/264b15de-9eb2-4ae0-bdf8-f3c721a93132 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:34.098977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.106171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.120460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.121171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.122184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.122773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.194301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:34.206858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b36c7663-3263-482e-9906-1f507aa6f068 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.559749 Apr 09 20:58:34.207475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 525/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:33 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:34.212179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.212791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.253848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.254685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.255833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.256802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.591283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:34.600152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a37263c-fc4a-49b6-a26b-4cdce5313bcd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.391577 Apr 09 20:58:34.600760 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 526/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:34 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:34.614863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.616100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.620095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:34.623734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.624413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.625467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.626099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.628543 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a95f9fc-ce6d-4768-aa35-2698cc7abdfa tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.538499 Apr 09 20:58:34.629495 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 557/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:34 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:34.636015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.637121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.648824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.651312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.652735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.655088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.656689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. Apr 09 20:58:34.661286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:34.662534 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9c4372a-685c-4505-8769-79b829163a25 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 404 len: 111 microversion: 2.1 time: 0.051654 Apr 09 20:58:34.667953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 527/1084] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:34 2022] DELETE /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:34.686848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:34.687870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:34.713082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.713998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:34.715039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:34.716996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.103260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:35.118539 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9cd5381f-1379-48fd-95a0-9d896deb5781 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.482574 Apr 09 20:58:35.119817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 558/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:34 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:35.141073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:35.142079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] [instance: 5c0bee38-b470-45a5-9253-a6a5ba25f439] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:35.158111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.160925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.162162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.164597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.211151 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] HTTP exception thrown: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. Apr 09 20:58:35.211763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] Returning 404 to user: Instance 5c0bee38-b470-45a5-9253-a6a5ba25f439 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:35.212305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:35.212836 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f96b73c-bf83-4fa4-8479-f4bc183dbfa7 tempest-ServersTestMultiNic-981442703 tempest-ServersTestMultiNic-981442703-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439" status: 404 len: 111 microversion: 2.1 time: 0.091796 Apr 09 20:58:35.213476 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 559/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:35 2022] GET /compute/v2.1/servers/5c0bee38-b470-45a5-9253-a6a5ba25f439 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:35.229889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:35.235357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:35.238219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:35.241498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:35.241949 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f42c0db1-1814-4320-a631-e5356af0d3d5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.569828 Apr 09 20:58:35.243626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 528/1087] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:34 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:35.248022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.248478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.249296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.249727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.262847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:35.263890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:35.286013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.290047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:35.290987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:35.292590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.137841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:36.149300 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8f2c416c-119f-4d15-80b8-6b3ca6241044 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.934934 Apr 09 20:58:36.150435 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 560/1088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:35 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:36.159422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:36.160197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:36.171445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.171906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.172710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.173178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.218600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:36.228596 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd8b91a2-b831-4460-a8cd-984956d73852 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.983111 Apr 09 20:58:36.229274 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 529/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:35 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:36.234601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:36.235287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:36.242071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.242863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.243767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.244297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.584154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:36.592624 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-793ecb02-60e4-4dda-b0ae-b0a411ef8482 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.441144 Apr 09 20:58:36.593509 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 561/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:36 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:36.599428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:36.600307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:36.607407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.608027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:36.608207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.609687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.610244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.617419 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73c9eb6b-a362-4c2b-8f85-a52ce13a3e4a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.386653 Apr 09 20:58:36.622015 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 530/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:36 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:36.627861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:36.628846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:36.636808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.637484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:36.638459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:36.639058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.051092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.057521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.061059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51ed2571-b7ec-4bac-ba76-a0ebdeccc748 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.465851 Apr 09 20:58:37.061733 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 562/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:36 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:37.067285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.069116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.070463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30c22ad3-0836-497b-bbb4-d937d4dfd4d6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.447287 Apr 09 20:58:37.071475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 531/1093] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:36 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:37.166989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:37.168368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:37.178686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.179133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.180150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.180585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.246160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:37.247410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:37.253668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.254448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.255192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.255814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.492604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.499248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53ef938e-a0bd-4e90-a7ad-0d01e66ec86c tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.337065 Apr 09 20:58:37.510098 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 563/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:37 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:37.586911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.603753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-427e18b0-1124-4408-a15e-91b316f212a3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.361431 Apr 09 20:58:37.611934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:37.612914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:37.615092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 532/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:37 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:37.620339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.620873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.621787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.622436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.640616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:37.649698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:37.665468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.666299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.667317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:37.668677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:37.964848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.973072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:37.977939 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0755767-1012-465a-9d12-ad6b16987261 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.369659 Apr 09 20:58:37.978579 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 564/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:37 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:37.985894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b3ea8f81-4c5f-46a0-aee9-c6aa75f29ec8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.354585 Apr 09 20:58:37.989095 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 533/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:37 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:38.078201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:38.079225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:38.087818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:38.089500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:38.105702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.106161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.106964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.107408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.109403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.110067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.110892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.111327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.832854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:38.842287 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-44d4a856-0be3-4e1b-b92b-d37c85ec0452 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.767915 Apr 09 20:58:38.842889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 565/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:38 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:38.858610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:38.864754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:38.865462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:38.875406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:38.877472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:38.879109 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdab1a20-5c56-4bcb-8dd9-588fb5fbceb4 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.795359 Apr 09 20:58:38.880501 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 534/1099] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:38 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:38.884631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.886047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.887518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.888883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.895320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:38.896356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:38.907507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.908306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:38.909377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:38.910017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:39.341697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:39.345312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:39.353062 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec9e9d53-ec58-4767-ab88-349fe97eaeac tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.471058 Apr 09 20:58:39.354414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 535/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:38 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:39.358020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9965b40-4883-4af1-a549-15345d610412 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.513971 Apr 09 20:58:39.359262 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 566/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:38 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:39.378770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:39.379128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:39.379639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:39.381481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:39.402376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:39.402827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:39.403181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:39.403621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:39.404014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:39.404122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:39.409406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:39.414346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.004415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.014730 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87d740dc-4dc6-4f0a-8485-e8b4c978217a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1307 microversion: 2.1 time: 0.658335 Apr 09 20:58:40.015329 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 536/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:39 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1307 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:40.022578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.036453 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-16495c34-05ca-4706-9454-2b4016cd5aa9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.676191 Apr 09 20:58:40.039646 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 567/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:39 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:40.054426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3c71908e-9e44-4bba-86cc-154a682a3ddc req-404fb350-6378-4bcb-af11-656ea8cf43d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c612ae-fb61-4249-b814-19a660bc500b", "name": "network-vif-unplugged", "status": "completed", "tag": "c1403504-af69-4de2-91df-e163589ef69b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:40.074660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:40.075539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:40.086919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3c71908e-9e44-4bba-86cc-154a682a3ddc req-404fb350-6378-4bcb-af11-656ea8cf43d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.097452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3c71908e-9e44-4bba-86cc-154a682a3ddc req-404fb350-6378-4bcb-af11-656ea8cf43d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.102455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.102915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.103712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.104147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.127914 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3c71908e-9e44-4bba-86cc-154a682a3ddc req-404fb350-6378-4bcb-af11-656ea8cf43d7 service nova] Creating event network-vif-unplugged:c1403504-af69-4de2-91df-e163589ef69b for instance 99c612ae-fb61-4249-b814-19a660bc500b on nch2-master-1 Apr 09 20:58:40.146141 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3c71908e-9e44-4bba-86cc-154a682a3ddc req-404fb350-6378-4bcb-af11-656ea8cf43d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114748 Apr 09 20:58:40.147946 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 537/1104] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:40.174128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:40.175606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:40.192463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.201164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.202948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.203578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.458151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.475859 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0266820c-05c5-4b05-889f-1620796e6623 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.422462 Apr 09 20:58:40.494290 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 568/1105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:40 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:40.500626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:40.501612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:40.508162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.509065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.510183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.510614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.591667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.619442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.622623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:40.624112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-686160e4-fefb-437d-a8df-8a8c24820b1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.458501 Apr 09 20:58:40.625752 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 538/1106] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:40 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:40.635316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:40.637474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:40.646064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.646933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:40.648086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:40.649465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.028037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:41.037313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98da2e27-d0d6-4540-92fd-a36ce7d45a2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.541293 Apr 09 20:58:41.047259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 569/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:40 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:41.053555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:41.054411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:41.063172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.063808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.064198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:41.065388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.065985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.078952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b495019b-ca29-48d3-a9c0-94e0d091313a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1715 microversion: 2.1 time: 0.449645 Apr 09 20:58:41.089443 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 539/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:40 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1715 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:41.095390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:41.096266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:41.103109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.103808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.104765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.105725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.337375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:41.346995 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-782fda9b-0470-4c3a-94f2-ae618243c837 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1487 microversion: 2.1 time: 0.298315 Apr 09 20:58:41.347607 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 570/1109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:41 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1487 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:41.364424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:41.364997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:41.372078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.372552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.373410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.373844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.500361 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-352f1395-c8c8-440a-a5da-6154183ca5fd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42/action" status: 202 len: 0 microversion: 2.1 time: 0.139692 Apr 09 20:58:41.501605 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 571/1110] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:41 2022] POST /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:41.505192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:41.514282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:41.515516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:41.516947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e422fd75-7494-49d7-bfe1-6d845e37b80e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.425997 Apr 09 20:58:41.517740 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 540/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:41 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:41.527673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.527673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.535279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.536108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.563922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:41.571424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:41.584616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.585429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:41.588566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:41.589261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.041983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.044066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.054615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce720735-bb91-4e86-a952-1a045d5741f8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1492 microversion: 2.1 time: 0.526738 Apr 09 20:58:42.055767 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c88d1a72-2c32-427a-b514-a799f8d51127 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.552555 Apr 09 20:58:42.055924 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 541/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:41 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1492 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:42.058262 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 572/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:41 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:42.061985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:42.062795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:42.066958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-81fae9ef-97ee-4589-b0e7-348d9679eda6 req-ffba5cc5-49b7-4510-92c3-6ab8fd6af806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e461201-9323-4eed-a58c-bfd395b8913f", "name": "network-vif-unplugged", "status": "completed", "tag": "146c43f4-1b2c-4bf3-bc91-df1e1247e407"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:42.072642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.073276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.074259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.076516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.086393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-81fae9ef-97ee-4589-b0e7-348d9679eda6 req-ffba5cc5-49b7-4510-92c3-6ab8fd6af806 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.086841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-81fae9ef-97ee-4589-b0e7-348d9679eda6 req-ffba5cc5-49b7-4510-92c3-6ab8fd6af806 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.111508 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-81fae9ef-97ee-4589-b0e7-348d9679eda6 req-ffba5cc5-49b7-4510-92c3-6ab8fd6af806 service nova] Creating event network-vif-unplugged:146c43f4-1b2c-4bf3-bc91-df1e1247e407 for instance 6e461201-9323-4eed-a58c-bfd395b8913f on nch1-master-1 Apr 09 20:58:42.122860 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-81fae9ef-97ee-4589-b0e7-348d9679eda6 req-ffba5cc5-49b7-4510-92c3-6ab8fd6af806 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063008 Apr 09 20:58:42.123895 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 573/1114] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:42.129588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:42.131007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:42.138201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.138887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.140142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.141182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.588138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.593277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.643681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a846c05d-a3e9-4522-a99f-7fc3bbc533de tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.515560 Apr 09 20:58:42.644353 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 574/1115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:42 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:42.655207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.663113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:42.666970 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d522d1cb-fde5-471b-8bde-5ed7881612a9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.609647 Apr 09 20:58:42.668615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 542/1116] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:42 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:42.673642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:42.675128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:42.676517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:42.677520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:42.685543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.686133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.687191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.687845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.704663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.705428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:42.706421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:42.707013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.127546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:43.140416 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b173d0a-c65f-478f-88e1-046441c233be tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1647 microversion: 2.1 time: 0.479340 Apr 09 20:58:43.140568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 575/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:42 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1647 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:43.150194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:43.153591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:43.170293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.171016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.171988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.174456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.395963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:43.404184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b55e029f-240c-4823-89a9-6d163ff8c120 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.733651 Apr 09 20:58:43.414100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 543/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:42 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:43.416142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:43.416767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:43.431302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.431767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.432575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.433017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.639730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:43.650596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c9af965-de5d-49a5-bbdf-ad821eb0941b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.508708 Apr 09 20:58:43.654721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 576/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:43 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:43.659435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a8d98133-b85b-4327-b92e-562f27abd2cc req-7601d252-79ce-4091-850d-7dc6b782c2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c612ae-fb61-4249-b814-19a660bc500b", "name": "network-vif-deleted", "tag": "c1403504-af69-4de2-91df-e163589ef69b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:43.678486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a8d98133-b85b-4327-b92e-562f27abd2cc req-7601d252-79ce-4091-850d-7dc6b782c2c2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.679743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a8d98133-b85b-4327-b92e-562f27abd2cc req-7601d252-79ce-4091-850d-7dc6b782c2c2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.687581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:43.699112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20c638e7-0ac3-43a3-8be5-e6f23ad639ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 200 len: 1472 microversion: 2.1 time: 0.286717 Apr 09 20:58:43.702647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a8d98133-b85b-4327-b92e-562f27abd2cc req-7601d252-79ce-4091-850d-7dc6b782c2c2 service nova] Creating event network-vif-deleted:c1403504-af69-4de2-91df-e163589ef69b for instance 99c612ae-fb61-4249-b814-19a660bc500b on nch2-master-1 Apr 09 20:58:43.703302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 544/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:43 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:43.709254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:43.710151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:43.715516 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a8d98133-b85b-4327-b92e-562f27abd2cc req-7601d252-79ce-4091-850d-7dc6b782c2c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059424 Apr 09 20:58:43.716362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 577/1121] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:43.728610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.728846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:43.730955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.731769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:43.732517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.733838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.743124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.743581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:43.745144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:43.745760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.068617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.072439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.080877 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3872eaad-a85a-40fd-847b-abf1bd4a3087 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.376398 Apr 09 20:58:44.081669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.082581 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 545/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:43 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:44.088644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1446537505"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:44.089960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:44.095402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.097003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3804ab92-776a-426e-8921-21f21f1b9c33 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.379353 Apr 09 20:58:44.097896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.098398 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 578/1123] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:43 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:44.098527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.099351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.099853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.157643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cc5808bd-189d-44d9-80fc-62b42b409c76 req-978e55bb-93d9-4206-98d8-162876c47a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e461201-9323-4eed-a58c-bfd395b8913f", "tag": "146c43f4-1b2c-4bf3-bc91-df1e1247e407"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:44.168969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cc5808bd-189d-44d9-80fc-62b42b409c76 req-978e55bb-93d9-4206-98d8-162876c47a09 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.169933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cc5808bd-189d-44d9-80fc-62b42b409c76 req-978e55bb-93d9-4206-98d8-162876c47a09 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.182741 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cc5808bd-189d-44d9-80fc-62b42b409c76 req-978e55bb-93d9-4206-98d8-162876c47a09 service nova] Creating event network-changed:146c43f4-1b2c-4bf3-bc91-df1e1247e407 for instance 6e461201-9323-4eed-a58c-bfd395b8913f on nch1-master-1 Apr 09 20:58:44.191493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-cc5808bd-189d-44d9-80fc-62b42b409c76 req-978e55bb-93d9-4206-98d8-162876c47a09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038638 Apr 09 20:58:44.197956 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 579/1124] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:58:44.203445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:44.204302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:44.212816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.213834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.214770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.215496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.374814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d51c9bfc0124777b559e1d2cd1e2d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430f19ffcb28429189b8c76282d2077b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.388649 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e28749ca-9cf8-41f2-a01d-af8e2811c56a tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 200 len: 1647 microversion: 2.1 time: 0.189131 Apr 09 20:58:44.398607 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 580/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:44 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 1647 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:44.422044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:44.422655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:44.430007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.430457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.431247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.431684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.515257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-584d644c-1597-4eda-a730-61438a0d1f91 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42/action" status: 202 len: 0 microversion: 2.1 time: 0.427620 Apr 09 20:58:44.517983 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 546/1126] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:44 2022] POST /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 20:58:44.533847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ae3348d-66be-4254-941d-24591ff25459 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee5c670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:44.600789 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ae3348d-66be-4254-941d-24591ff25459 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.075295 Apr 09 20:58:44.601568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 547/1127] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:44 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:44.674794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:44.675608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:44.688987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.689544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.692354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:44.693725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:44.915271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:44.933655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2745658-71f4-4217-9ef2-ce75d7861896 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.513158 Apr 09 20:58:44.936737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 581/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:44 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:45.101220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.102069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.112319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:45.120622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3fcbcc6b-579b-4b36-a0c7-f0041bd8e582 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.450909 Apr 09 20:58:45.126230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.126682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.127674 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 548/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:44 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:45.128314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.129287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.133261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.133874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.142479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.142926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.143724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.144153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.475404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:45.485545 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73ce6085-1ced-4bd7-99d9-b25c7ca8f6cb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.390406 Apr 09 20:58:45.487631 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 582/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:45.513908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.517273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.531222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.532428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.533004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:45.535876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.537816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.548411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:45.552059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:45.553571 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39da0f9b-c615-432b-912e-3e858fd2d8a1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.424811 Apr 09 20:58:45.559557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 549/1131] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:45.586923 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. Apr 09 20:58:45.587840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:45.592805 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-083a61e9-dfb1-4023-a06d-18b0a9a2b769 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 404 len: 111 microversion: 2.1 time: 0.095177 Apr 09 20:58:45.597512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 583/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:45.605385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.606569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.615338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-087a2404-36c6-4d22-b34a-7bd10dde11d8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eb6ad30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.628127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.632445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.633717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.634321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.659356 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. Apr 09 20:58:45.659956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:45.661189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e928db6-b0d3-4e47-b925-a86091d150b3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 404 len: 111 microversion: 2.1 time: 0.062559 Apr 09 20:58:45.662075 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 550/1133] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:45 2022] DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:45.671300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.673568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.687179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.687418 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-087a2404-36c6-4d22-b34a-7bd10dde11d8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.072483 Apr 09 20:58:45.688346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.689205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.689642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.695129 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 584/1134] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:45.706669 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. Apr 09 20:58:45.707546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:45.708825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc304f3d-783a-45d4-bdbc-aba8ca6199a9 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 404 len: 111 microversion: 2.1 time: 0.042826 Apr 09 20:58:45.709622 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 551/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:58:45.718934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c73026a-9e68-4446-b220-45aa0ec819ac tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '.version_select at 0x7fb08ec365e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.748898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c73026a-9e68-4446-b220-45aa0ec819ac tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795275409" status: 202 len: 0 microversion: 2.1 time: 0.033316 Apr 09 20:58:45.749856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 585/1136] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 20:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795275409 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:45.953665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:45.954580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:45.970109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.977629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:45.980487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:45.981275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.145881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:46.146905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:46.153765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.154499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.155449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.156036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.297880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.318009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a02c3da1-f16f-4a84-b6dc-f1f7d985388f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.368609 Apr 09 20:58:46.319431 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 552/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:45 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:46.366404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.374479 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe3b91c5-1bd6-48d2-97a0-fe716a366866 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.240793 Apr 09 20:58:46.375065 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 586/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:46 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:46.504589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:46.505997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:46.512959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.513673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.514711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.515242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.579321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:46.580607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:46.588232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.588941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.590039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:46.590479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:46.747524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.761327 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0065c2ab-65ff-4810-97f3-49bfed4a9e6b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.261281 Apr 09 20:58:46.765410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 553/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:46 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:46.772653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-77448504-806f-4a95-9cc4-a32bcbd4a21a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee2d820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:46.788477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.798896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.800960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:46.802448 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-008dcb99-823b-4a59-8188-fda3aa3a1b6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.228859 Apr 09 20:58:46.803526 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 587/1140] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:46 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:58:46.832348 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-77448504-806f-4a95-9cc4-a32bcbd4a21a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.064890 Apr 09 20:58:46.833112 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 554/1141] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:46 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:47.336426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.337548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:47.344367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.344997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.345953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.346546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.398961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.399595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:47.414565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.415335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.417173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.417727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.560082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:47.570492 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68268ef6-57a4-45f7-a88d-76f7a91352a2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.238179 Apr 09 20:58:47.573095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 588/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:47.577206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-112323ea-07d9-44b9-b194-d70a577c584f tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.578070 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:58:47.578070 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:58:47.600386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-112323ea-07d9-44b9-b194-d70a577c584f tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1641654892" status: 202 len: 0 microversion: 2.1 time: 0.026939 Apr 09 20:58:47.601750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 589/1143] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:58:47 2022] DELETE /compute/v2.1/flavors/1641654892 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:47.612758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b99e5ad9-ff44-483a-9d04-d71d4537abdb tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.644375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:47.655574 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99bc9b64-9721-44f0-921c-ad3f12d18340 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.266232 Apr 09 20:58:47.656807 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b99e5ad9-ff44-483a-9d04-d71d4537abdb tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.048867 Apr 09 20:58:47.657999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 590/1144] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:47.665226 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 555/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:47.682304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0188893-5741-4f71-8e00-f3f4712cd9c5 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.708885 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0188893-5741-4f71-8e00-f3f4712cd9c5 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1004132164" status: 202 len: 0 microversion: 2.1 time: 0.030780 Apr 09 20:58:47.709690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 591/1146] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 20:58:47 2022] DELETE /compute/v2.1/flavors/1004132164 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:58:47.718248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75acb8b5-cb03-459e-ab6d-288227b32451 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.743720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75acb8b5-cb03-459e-ab6d-288227b32451 tempest-ServersWithSpecificFlavorTestJSON-1607964533 tempest-ServersWithSpecificFlavorTestJSON-1607964533-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029105 Apr 09 20:58:47.744821 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 556/1147] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:47.779749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.781479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:47.790932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.792289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.795048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.795048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:47.796645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.797875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.827258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.827729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.828529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.828973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.845068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. Apr 09 20:58:47.845319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:47.846168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a692cbfc-3750-4bc7-a9a4-7bf1506361e4 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 404 len: 111 microversion: 2.1 time: 0.076312 Apr 09 20:58:47.847234 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 592/1148] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:47 2022] DELETE /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:47.853967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:47.854578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:47.871883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.872337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:47.873749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:47.874465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.000040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:48.008596 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d90cca2f-abd1-4225-9333-4b12737cb32b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.233870 Apr 09 20:58:48.018574 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 557/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:48.025112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-23fc5fd1-7581-4581-a6ba-af864da91fa5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee71790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:48.056161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:48.065947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:48.067607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:48.068806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-10c3cac1-59a6-481a-8f97-4715c713bc04 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.220479 Apr 09 20:58:48.079131 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 593/1150] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:47 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:48.079131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:48.079131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 99c612ae-fb61-4249-b814-19a660bc500b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:48.079460 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-23fc5fd1-7581-4581-a6ba-af864da91fa5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.055438 Apr 09 20:58:48.079460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 558/1151] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:48 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:48.080994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.081476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.082265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.082705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.096806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. Apr 09 20:58:48.097446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 99c612ae-fb61-4249-b814-19a660bc500b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:48.098295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb187f20-cd3c-44a5-9472-9ed0fd5beaf2 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b" status: 404 len: 111 microversion: 2.1 time: 0.027613 Apr 09 20:58:48.102147 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 594/1152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:48 2022] GET /compute/v2.1/servers/99c612ae-fb61-4249-b814-19a660bc500b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:48.107201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:48.107708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:48.113588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.114045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.114865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.115307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.128960 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. Apr 09 20:58:48.129731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:48.130870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2f7eb1e-d281-4f1e-aebb-fdf6f493f820 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 404 len: 111 microversion: 2.1 time: 0.027557 Apr 09 20:58:48.131404 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 595/1153] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:58:48 2022] DELETE /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:58:48.138952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:48.139880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] [instance: 3765143e-2819-46e6-94ae-6d26f95a5ef4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:48.145950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.146403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.147200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.147638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.166133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] HTTP exception thrown: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. Apr 09 20:58:48.166726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] Returning 404 to user: Instance 3765143e-2819-46e6-94ae-6d26f95a5ef4 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:58:48.167555 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c325a40-db53-4c65-8b75-541b55e9f8d3 tempest-ServersWithSpecificFlavorTestJSON-736295025 tempest-ServersWithSpecificFlavorTestJSON-736295025-project] 10.222.0.30 "GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4" status: 404 len: 111 microversion: 2.1 time: 0.032296 Apr 09 20:58:48.168418 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 596/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:48 2022] GET /compute/v2.1/servers/3765143e-2819-46e6-94ae-6d26f95a5ef4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 20:58:48.231326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1536820007", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "d5e4efcc-ee43-45d2-b19a-a14b712d6e3d"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:48.287098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] validate_networks() for [('d5e4efcc-ee43-45d2-b19a-a14b712d6e3d', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:58:48.502780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7fe5613c-87bf-4a75-b7f4-4b1d9551e3ae req-88a69b9e-fda8-4580-b98e-d83cbfc908c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c0339f-48c4-473d-93ae-db67c877fb5e", "name": "network-vif-plugged", "status": "completed", "tag": "754b37cf-8904-48a6-9835-7135d3f52459"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:48.519671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7fe5613c-87bf-4a75-b7f4-4b1d9551e3ae req-88a69b9e-fda8-4580-b98e-d83cbfc908c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.520542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7fe5613c-87bf-4a75-b7f4-4b1d9551e3ae req-88a69b9e-fda8-4580-b98e-d83cbfc908c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.538337 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7fe5613c-87bf-4a75-b7f4-4b1d9551e3ae req-88a69b9e-fda8-4580-b98e-d83cbfc908c4 service nova] Creating event network-vif-plugged:754b37cf-8904-48a6-9835-7135d3f52459 for instance e5c0339f-48c4-473d-93ae-db67c877fb5e on nch2-master-1 Apr 09 20:58:48.547006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7fe5613c-87bf-4a75-b7f4-4b1d9551e3ae req-88a69b9e-fda8-4580-b98e-d83cbfc908c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046794 Apr 09 20:58:48.548077 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 597/1155] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:58:48.595756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:48.596806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:48.608787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.610110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:48.611021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:48.611517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.229606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.246340 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ff57228-e596-4fb2-bb55-75c8e2397878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.657223 Apr 09 20:58:49.256175 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 598/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:48 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:49.261786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:49.262474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:49.268916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.269407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.270192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.271076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.321331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:58:49.322491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:58:49.322971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:58:49.323447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:58:49.323991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:58:49.333926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.334381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.335193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.335630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.352748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Getting quotas for project b70c13d77d304aa69f4eeb95e037ea4b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:58:49.357285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Getting quotas for user d26f77ab87bf4c67ac3513a2f62056f4 and project b70c13d77d304aa69f4eeb95e037ea4b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:58:49.369071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:58:49.372646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:58:49.424413 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345804 Apr 09 20:58:49.425810 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 559/1157] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:58:49.432017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:49.433165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:49.446711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.447522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.448508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.449431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.552404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.561064 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c7c86bc-9048-4e92-83c2-86b139466dbd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.303496 Apr 09 20:58:49.561656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 599/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:49 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:49.570767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:49.571399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:49.583586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.584033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.584952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:49.586484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:49.774018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.781695 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7396e9a-64f1-4e9f-8af4-c7bb8cae8abb tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.354606 Apr 09 20:58:49.782283 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 560/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:49 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:49.795091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1f1dae6-6c24-4751-b750-8970bd53425c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eeb5e50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:49.849439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1f1dae6-6c24-4751-b750-8970bd53425c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.065788 Apr 09 20:58:49.850025 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 561/1160] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:49 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:49.859881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81495993-7440-4c2b-b209-d794d4e285de tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:49.860741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81495993-7440-4c2b-b209-d794d4e285de tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:49.868640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.877638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.883875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.885233 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7bdb8ed9-843d-4449-be01-e429311169ac tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.322567 Apr 09 20:58:49.887418 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 600/1161] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:49 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:49.927705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81495993-7440-4c2b-b209-d794d4e285de tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:49.934913 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81495993-7440-4c2b-b209-d794d4e285de tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1217 microversion: 2.1 time: 0.083724 Apr 09 20:58:49.935907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 562/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:49 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:50.263583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:50.264208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:50.272902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.274483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.276204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.276840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.518244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:50.531593 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df5c2ef5-4ee4-4390-89e8-4e340b7837f2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.271518 Apr 09 20:58:50.537924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 601/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:50 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:50.587633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:50.588328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:50.602345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.602809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.603607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.607490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.798534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:50.799307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:50.811402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.812493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.813505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:50.814491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:50.971514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:50.980469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1774a1a1-074e-41e5-b687-b197b1ad14fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.399803 Apr 09 20:58:50.981326 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 563/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:50 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:50.986040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55e2d184-d1a0-4684-8cf3-2ee951f042bf tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eea3310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:51.041476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-55e2d184-d1a0-4684-8cf3-2ee951f042bf tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.059058 Apr 09 20:58:51.045775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 564/1165] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:50 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:51.048165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:51.048811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:51.056278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.057459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.058258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.058757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.209643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.220614 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-55eb501b-fd47-47df-be77-e154336e9ae5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.426109 Apr 09 20:58:51.231473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 602/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:50 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:51.233578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:51.234745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:51.242802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.243499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.244566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.245817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.391491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.413811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.427615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e459692-931c-4fac-82a8-97100cddd18e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1275 microversion: 2.1 time: 0.199805 Apr 09 20:58:51.433764 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 603/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:51 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:51.443391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.445157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.447986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9530d732-2855-4946-825d-49c6859c25ca tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.403876 Apr 09 20:58:51.457984 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 565/1168] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:51 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:51.554577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:51.555207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:51.573849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.574294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.575095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:51.576012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:51.893564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:51.908923 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2aa88413-b75a-4110-9153-a3f7ec4b77d1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.360885 Apr 09 20:58:51.909819 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 604/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:51 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:51.998749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:52.002366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:52.011077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.012573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.013723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.014384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.056385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc0a7544-dd6b-44be-9fd2-ebf7d7fe3c9a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eb2b820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:52.121133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc0a7544-dd6b-44be-9fd2-ebf7d7fe3c9a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.070276 Apr 09 20:58:52.122043 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 605/1170] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:52 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:52.220932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:52.233165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97c6fa64-4ed5-4fde-be33-8e9e0d77c6df tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1476 microversion: 2.1 time: 0.238721 Apr 09 20:58:52.235503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 566/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:51 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:52.240800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:52.242109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:52.253998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.254462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.255301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.256051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.451783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:52.453394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:52.460887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.465655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.469277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.469913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.711087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:52.718955 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9fea278-3456-4d09-a0a0-49d373c2515e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.482249 Apr 09 20:58:52.729311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 606/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:52 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:52.735638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:52.737476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:52.754860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.758696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.759422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.759871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:52.944540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:52.959417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0c4bed52-6d95-44d8-9756-aa12ebe8bc30 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.509029 Apr 09 20:58:52.968765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 567/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:52 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:58:52.968765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-eb7ca5ba-797b-426e-bbf6-aaf01c98d4cd req-d2b6dbf8-3a62-45f6-a8b3-7e0fce2a81dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66be7a-97fe-4f7d-94fb-645e9b367f42", "name": "network-vif-plugged", "status": "completed", "tag": "765d63be-a291-4796-9abd-dd6dc3afb689"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:52.980389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-eb7ca5ba-797b-426e-bbf6-aaf01c98d4cd req-d2b6dbf8-3a62-45f6-a8b3-7e0fce2a81dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:52.980838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-eb7ca5ba-797b-426e-bbf6-aaf01c98d4cd req-d2b6dbf8-3a62-45f6-a8b3-7e0fce2a81dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.012629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-eb7ca5ba-797b-426e-bbf6-aaf01c98d4cd req-d2b6dbf8-3a62-45f6-a8b3-7e0fce2a81dd service nova] Creating event network-vif-plugged:765d63be-a291-4796-9abd-dd6dc3afb689 for instance de66be7a-97fe-4f7d-94fb-645e9b367f42 on nch2-master-1 Apr 09 20:58:53.024703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-eb7ca5ba-797b-426e-bbf6-aaf01c98d4cd req-d2b6dbf8-3a62-45f6-a8b3-7e0fce2a81dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062127 Apr 09 20:58:53.026998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 568/1174] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:53.039355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:53.040371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:53.051940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.052850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.053918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.054521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.214129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:53.234371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:53.239891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:53.258559 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78c843df-8d27-48d5-9479-10d53109505e tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.513527 Apr 09 20:58:53.261421 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 607/1175] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:52 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:53.267329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75e301a4-d61f-45d9-a036-3f304732bb4f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eb3e3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:53.327240 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75e301a4-d61f-45d9-a036-3f304732bb4f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.064158 Apr 09 20:58:53.331868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 608/1176] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:53 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:53.340768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:53.343837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:53.350722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.351252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.352584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.353061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.475000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:53.485868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9998676-5a96-4856-bfcc-92661f59a962 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.457120 Apr 09 20:58:53.486721 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 569/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:53 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:53.635649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:53.646340 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-606bde93-be7f-4b6f-b7f6-a31d1ada59e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1475 microversion: 2.1 time: 0.310326 Apr 09 20:58:53.647216 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 609/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:53 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:53.744175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:53.745126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:53.754336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.755267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.756305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.756956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.976400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:53.977335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:53.984839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.985596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:53.986566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:53.987338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.279425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.289969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.305907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e53b9c10-5677-4452-9284-6f7f18649ac0 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.333436 Apr 09 20:58:54.315114 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d46a0e03-be99-4c4a-b648-a8f8e14e7ff3 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.564023 Apr 09 20:58:54.318184 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 610/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:53 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:54.318800 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 570/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:53 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:54.324174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:54.325006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:54.334207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.334656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.335872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.336491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.346778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b2ed9e0-5256-4a13-9313-6b68f10a8a03 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee494c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:54.413286 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b2ed9e0-5256-4a13-9313-6b68f10a8a03 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.070227 Apr 09 20:58:54.420004 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 571/1181] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:54 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:54.424943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-83693cf4-2cc2-467d-9a51-f91fe552b751 req-ee9bf0e7-500c-4fd9-b3f1-9965154dce7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28990a58-26ce-477f-aa75-401da370fa1b", "tag": "28be12eb-f5a0-44c9-8952-c7005682176d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:54.435839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-83693cf4-2cc2-467d-9a51-f91fe552b751 req-ee9bf0e7-500c-4fd9-b3f1-9965154dce7c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.436311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-83693cf4-2cc2-467d-9a51-f91fe552b751 req-ee9bf0e7-500c-4fd9-b3f1-9965154dce7c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.451359 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-83693cf4-2cc2-467d-9a51-f91fe552b751 req-ee9bf0e7-500c-4fd9-b3f1-9965154dce7c service nova] Creating event network-changed:28be12eb-f5a0-44c9-8952-c7005682176d for instance 28990a58-26ce-477f-aa75-401da370fa1b on nch1-master-1 Apr 09 20:58:54.459050 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-83693cf4-2cc2-467d-9a51-f91fe552b751 req-ee9bf0e7-500c-4fd9-b3f1-9965154dce7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037552 Apr 09 20:58:54.459929 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 572/1182] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:54.504695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:54.505585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:54.513077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.513660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.514552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.515063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.553416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.564003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.566243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.567737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e66308e2-3c99-4ed5-b3ac-e74f8d2e517c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.248146 Apr 09 20:58:54.568567 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 611/1183] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:54 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:54.666113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:54.666819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:54.666986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.675385 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec4a39e4-281a-4b03-9613-2fd6da78892f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.175895 Apr 09 20:58:54.676358 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 573/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:54 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:54.688668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.689451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.690486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:54.690951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:54.883711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:54.892865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-70e439b9-baf6-478b-b24e-636c406ea2b8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1473 microversion: 2.1 time: 0.232641 Apr 09 20:58:54.897536 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 612/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:54 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:55.328165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:55.328730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:55.330887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:55.332350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:55.335795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.336437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.337395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.337974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.347553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.348354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.349597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.350220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.660266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:55.671470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:55.681501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dea2d9b1-de9f-41a8-a697-9fa18474d0c2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.362025 Apr 09 20:58:55.684640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-501de043-24a1-4969-8d72-d405e46afd0c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.360328 Apr 09 20:58:55.685463 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 613/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:55 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:55.690191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dac4735e-2a4a-4527-b84e-34e5fd18b363 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eaccdc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:55.690650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 574/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:55 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:55.695762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:55.696376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:55.758417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.775092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.776096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.776792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.813538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dac4735e-2a4a-4527-b84e-34e5fd18b363 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.125665 Apr 09 20:58:55.819203 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 614/1188] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:55 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:55.819415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:55.819961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:55.845754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.846507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:55.847485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:55.848069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.209743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:56.232168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d85f084b-a3d0-4a43-968b-c4f3ecb5ea04 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.415755 Apr 09 20:58:56.233596 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 615/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:55 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:56.239783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:56.241223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:56.252248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.256451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.257577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.258202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.277131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:56.293262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:56.294835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:56.296203 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a7c523a8-8dce-4a9a-9156-4769cdb81529 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.604419 Apr 09 20:58:56.299461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 575/1190] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:55 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:56.540972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:56.562988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9ccd5bb4-1c6a-4ed2-8eb5-e875ef0ec4db tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1470 microversion: 2.1 time: 0.328065 Apr 09 20:58:56.576856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 616/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:56 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:56.580035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:56.580579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:56.588761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.589244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.603715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.604174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.709931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:56.710826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:56.733720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.735870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.740057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.741322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.765639 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dcdee1c3-6641-4ef3-8a7e-d01d88ab8c11 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127/action" status: 204 len: 0 microversion: 2.1 time: 0.189356 Apr 09 20:58:56.772519 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 576/1192] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:58:56 2022] POST /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127/action => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 20:58:56.783141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:56.789587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:56.807848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.818696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:56.822980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:56.824861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.287441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:57.301596 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92a03745-25de-426e-92af-8abd2bc01658 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.527066 Apr 09 20:58:57.321672 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 577/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:56 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:57.348230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:57.351693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:57.371532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.372298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.379070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.379806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.437753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:57.460502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c14b8b5d-1c49-464c-ab7a-591d7b1d1ff9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.762295 Apr 09 20:58:57.461103 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 617/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:56 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:57.483603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d076fbb-8179-44af-996a-d6d83e2a9e79 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eddeb80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:57.561478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d076fbb-8179-44af-996a-d6d83e2a9e79 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.086917 Apr 09 20:58:57.567265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 618/1195] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:57 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:57.571117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:57.571787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:57.604451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.608285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.611580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.614475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.656693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:57.669715 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e9283994-94e8-4e9b-9763-9e359229638f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1470 microversion: 2.1 time: 0.349982 Apr 09 20:58:57.670696 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 578/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:57 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:57.676039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:57.676996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:57.683919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.685312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.686347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:57.686991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:57.992069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:57.995737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:58.004006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a5528b2-3b3d-4e17-ae60-fa63be3e655d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.440544 Apr 09 20:58:58.004678 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 619/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:57 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:58.006081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:58.007864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:58.010453 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2def67b-318b-40e2-b4ec-d8c811d5fa43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.338627 Apr 09 20:58:58.013742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 579/1198] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:57 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:58.063441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87355ccc-05d7-430d-aafc-b3bea4e08127", "name": "network-vif-plugged", "status": "completed", "tag": "cc886072-17df-443d-8237-a748bd33f221"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:58:58.082026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.082956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.112483 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] Creating event network-vif-plugged:cc886072-17df-443d-8237-a748bd33f221 for instance 87355ccc-05d7-430d-aafc-b3bea4e08127 on nch1-master-1 Apr 09 20:58:58.123039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] Instance 87355ccc-05d7-430d-aafc-b3bea4e08127 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 20:58:58.143037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3f98db93-f797-46ac-b7e4-4087dc1c4b3d req-59acaa22-5936-4cfa-9a25-da3f334d6f41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083530 Apr 09 20:58:58.145751 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 620/1199] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:58:58.321569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:58.322512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:58.333484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.334235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.335525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.342039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.479014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:58.482252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:58.489886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.490549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.491560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.492162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.616559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:58.625544 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-213f90e4-878e-4525-b7e8-2dc3e8f141e7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.308007 Apr 09 20:58:58.626153 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 580/1200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:58 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:58.642271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e657c75b-eb92-4d28-a4a9-37efe42c82e3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee8ab80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:58.778617 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e657c75b-eb92-4d28-a4a9-37efe42c82e3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.148062 Apr 09 20:58:58.779336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 581/1201] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:58 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:58.811992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:58.813327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:58.819896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.820348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:58.825790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:58.826318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.051882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.061105 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3252bb41-03b5-4f0e-a858-0aa79225f947 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.587277 Apr 09 20:58:59.063874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 621/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:58 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:59.068816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:59.075691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:59.091192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.093619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.094606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.099187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.133147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.140727 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17785637-5163-45bc-ad49-8fea74900cad tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1470 microversion: 2.1 time: 0.360524 Apr 09 20:58:59.144724 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 582/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:58 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:59.157321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:59.166004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:59.210375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.210845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.211681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.212122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.469011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.484202 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c38d035e-3269-45d2-a926-c7359adc90ab tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.412050 Apr 09 20:58:59.485222 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 622/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:59 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:58:59.575184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.599723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.622278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:58:59.635743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a7c3e0a-7819-4737-a9bb-862f97cc4612 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.488511 Apr 09 20:58:59.636475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 583/1205] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:58:59 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:58:59.666450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:59.667718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:58:59.681933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.682725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.699082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:58:59.700016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:58:59.801799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d4c8128-59e7-407c-b748-cc709f94a266 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee2b1f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:58:59.877982 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d4c8128-59e7-407c-b748-cc709f94a266 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.089961 Apr 09 20:58:59.896523 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 584/1206] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:58:59 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:00.006291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:00.014518 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-795f3c4b-dd99-4132-a844-42626a1ff5ba tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.360734 Apr 09 20:59:00.016224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 623/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:58:59 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:00.093135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:00.105398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:00.162269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:00.162944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:00.170278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.173025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.177253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.178578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.182528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.183190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.184984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.185410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.685578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:00.688620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:00.696204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f10066bb-e3d7-4b48-b487-67a747f47bd9 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.619731 Apr 09 20:59:00.697265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3020dce8-fb77-4c68-b62a-f2d1a034061c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1462 microversion: 2.1 time: 0.539315 Apr 09 20:59:00.700887 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 585/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:00 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:00.701565 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 624/1209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:00 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1462 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:00.706661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:00.708620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:00.710075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:00.710725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:00.721022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.721859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.726412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.728731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.738465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.743055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:00.746947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:00.763124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.243678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.255271 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-825f6d1e-eb55-44d6-b29d-11c7a3c741f1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.550866 Apr 09 20:59:01.258034 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 586/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:00 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:01.268265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.274913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:01.283766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.297537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.300611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.304159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.304569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.307048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-274c0058-fe77-4735-b3fd-e67a3a8d4523 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.604432 Apr 09 20:59:01.307475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.308044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.312039 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 625/1211] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:00 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:01.317478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f1696b34-9493-42f2-ae31-ce1986dc1c82 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eb60d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.390193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f1696b34-9493-42f2-ae31-ce1986dc1c82 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.076879 Apr 09 20:59:01.396203 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 626/1212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:01.414069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.415100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:01.427772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.428510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.429759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.430366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.622088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.634315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-909a6ed0-6267-41e4-a83f-d2d76ae4c04e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1462 microversion: 2.1 time: 0.374783 Apr 09 20:59:01.635480 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 587/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1462 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:01.651798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-003042e6-2889-443f-8d06-66d1f7917242 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '.version_select at 0x7fb08edc43a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.663004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-003042e6-2889-443f-8d06-66d1f7917242 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.663285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-003042e6-2889-443f-8d06-66d1f7917242 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.686685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-003042e6-2889-443f-8d06-66d1f7917242 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2717 microversion: 2.1 time: 0.037698 Apr 09 20:59:01.690060 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 588/1214] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/os-migrations => generated 2717 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:01.706492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:01.712845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46c69ae3-0bec-4356-a323-9b169eafa5f4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.315189 Apr 09 20:59:01.713129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7594d8fc-147d-4055-993b-8cbecfbfcf0f tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.731178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 627/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:01.733299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7594d8fc-147d-4055-993b-8cbecfbfcf0f tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024942 Apr 09 20:59:01.735565 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 589/1216] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:01.736552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.737207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:01.746262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-79d976be-5a6b-4687-8f6f-26997e1665c0 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-329033097", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:01.750358 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:01.750358 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:59:01.765195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.765657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.766495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:01.766939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:01.784702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-79d976be-5a6b-4687-8f6f-26997e1665c0 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.044008 Apr 09 20:59:01.792874 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 590/1217] 10.222.0.30 () {60 vars in 1145 bytes} [Sat Apr 9 20:59:01 2022] POST /compute/v2.1/flavors => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:01.797967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0088194-b2de-4f36-99e3-d7a8c50b5e4e tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:01.815145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0088194-b2de-4f36-99e3-d7a8c50b5e4e tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020921 Apr 09 20:59:01.819646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 591/1218] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 20:59:02.006284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1124491293", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "4b30fb8f-c92b-427b-9397-3a5d308020a6"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:02.064552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:02.199715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:02.207906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2d383f30-b5d1-45da-8021-8f5d8506212a tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.475641 Apr 09 20:59:02.218193 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 628/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:01 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:02.274398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:02.275371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:02.287983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.289195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.290216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.293677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.656301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:02.656803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:02.657165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:02.657578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:02.657980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:02.678876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.682540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.684045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.685992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.698026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:02.721225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ce98a23-4f43-411b-8bb8-449b12fc0d96 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.450102 Apr 09 20:59:02.725365 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 629/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:02 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:02.733482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:02.734312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:02.756110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:02.756841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.757483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.759335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:02.761169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:02.773911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for user 5ab294d1890047aababb87b3a865a14c and project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:02.808966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:02.811650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:02.911755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6aee494e-27ce-4cb8-bcd5-fffec4cd7b26 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906340 Apr 09 20:59:02.913291 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 592/1221] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 20:59:02.923545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c14a43d-dc5a-4a70-bc19-07a01535327e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eea3c10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:03.041552 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c14a43d-dc5a-4a70-bc19-07a01535327e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.124768 Apr 09 20:59:03.044273 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 593/1222] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:02 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:03.059356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:03.061499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:03.073872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.074438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.075586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.076140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.126351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.145164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.147037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.148720 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f9f71804-f3ac-4670-aaa6-03d368344b53 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.421962 Apr 09 20:59:03.155705 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 630/1223] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:02 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:03.171889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7b37703-80ad-4959-add8-66f55b1ba4bc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:03.174472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7b37703-80ad-4959-add8-66f55b1ba4bc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:03.306998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7b37703-80ad-4959-add8-66f55b1ba4bc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.314496 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7b37703-80ad-4959-add8-66f55b1ba4bc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1279 microversion: 2.1 time: 0.157413 Apr 09 20:59:03.315086 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 631/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:03 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:03.325291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:03.325918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:03.349953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.350404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.351211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.351647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.407190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.424633 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97aabb95-38d5-4186-b9b9-60b1e3aa24c8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.378276 Apr 09 20:59:03.427347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 594/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:03 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:03.687578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.703576 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9c87697-7b12-4620-a62f-bf0e30e5e767 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.387172 Apr 09 20:59:03.704804 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 632/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:03 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:03.753171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:03.756144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:03.772228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.773684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.775943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:03.776725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:03.968872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:03.991077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6bd40044-390b-40ca-94b8-c61693884cfe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.251757 Apr 09 20:59:03.992866 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 595/1227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:03 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:04.013997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f13a2b65-0034-465b-a743-c9bc0d5fe9ba req-f79507c2-758d-4bb8-8c00-16e1e4dcaa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28990a58-26ce-477f-aa75-401da370fa1b", "name": "network-vif-plugged", "status": "completed", "tag": "28be12eb-f5a0-44c9-8952-c7005682176d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:04.046069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f13a2b65-0034-465b-a743-c9bc0d5fe9ba req-f79507c2-758d-4bb8-8c00-16e1e4dcaa1e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.046558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f13a2b65-0034-465b-a743-c9bc0d5fe9ba req-f79507c2-758d-4bb8-8c00-16e1e4dcaa1e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.056058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ebc61c0-3184-42f4-a437-3b2c7eeefe7a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08edebd30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:04.089003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f13a2b65-0034-465b-a743-c9bc0d5fe9ba req-f79507c2-758d-4bb8-8c00-16e1e4dcaa1e service nova] Creating event network-vif-plugged:28be12eb-f5a0-44c9-8952-c7005682176d for instance 28990a58-26ce-477f-aa75-401da370fa1b on nch1-master-1 Apr 09 20:59:04.100533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f13a2b65-0034-465b-a743-c9bc0d5fe9ba req-f79507c2-758d-4bb8-8c00-16e1e4dcaa1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090247 Apr 09 20:59:04.102283 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 633/1228] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:04.155167 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ebc61c0-3184-42f4-a437-3b2c7eeefe7a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.099819 Apr 09 20:59:04.161219 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 596/1229] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:04 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:04.176898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:04.178001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:04.193411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.193949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.196487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.200361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.332445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:04.333807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:04.346494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.346961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.347809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.348249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.411206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:04.429282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:04.431679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:04.443565 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ca0bd6d1-9668-423a-bc95-d40087ed1e29 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.271467 Apr 09 20:59:04.444642 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 634/1230] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:04 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:59:04.461020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:04.461936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:04.468862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.469381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.470149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.470758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.498602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:04.511382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dbf37515-14c6-4698-9b4e-a58409991f90 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1331 microversion: 2.1 time: 0.183264 Apr 09 20:59:04.522092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 597/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:04 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1331 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:04.663634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:04.685562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-62eb012b-ed5d-4e59-85dd-4d31a0477346 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1317 microversion: 2.1 time: 0.235620 Apr 09 20:59:04.686237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 635/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:04 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:04.728869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:04.730494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:04.745716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.746478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:04.748421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:04.749123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.053268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99128d87-af52-4a19-acee-86b126e3875b tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-383254902", "id": 1029805637, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:05.054982 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:05.054982 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:59:05.090283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:05.103607 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef9d6f17-ef5c-45b6-8570-aadad8f289c8 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1317 microversion: 2.1 time: 0.385903 Apr 09 20:59:05.104778 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 636/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:04 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:05.109614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:05.110418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:05.111943 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99128d87-af52-4a19-acee-86b126e3875b tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.438551 Apr 09 20:59:05.112582 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 598/1234] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:59:04 2022] POST /compute/v2.1/flavors => generated 467 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:05.118437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.118881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.119725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.120172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.291809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8296fea9-7384-4394-9b0a-b2320b15122c tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:05.303338 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8296fea9-7384-4394-9b0a-b2320b15122c tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] 10.222.0.30 "GET /compute/v2.1/flavors/1029805637" status: 200 len: 467 microversion: 2.61 time: 0.182579 Apr 09 20:59:05.304473 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 599/1235] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/flavors/1029805637 => generated 467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:05.309299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48e324e3-0889-46be-8973-88740992f893 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee71940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:05.402261 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48e324e3-0889-46be-8973-88740992f893 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.096439 Apr 09 20:59:05.403163 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 600/1236] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:05.410324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9cf76c93-1719-44a4-86d7-7b451719e581 tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] Action: 'update', calling method: .version_select at 0x7fb09581c430>, body: {"flavor": {"description": "new"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:05.416698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:05.434584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f40cf4a5-1db9-4eb0-92d9-ea2c3be57a02 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.323366 Apr 09 20:59:05.436122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 637/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:05.450286 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:05.450286 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:59:05.463240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:05.467231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:05.487685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.488600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.491471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.492270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.518530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9cf76c93-1719-44a4-86d7-7b451719e581 tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1029805637" status: 200 len: 468 microversion: 2.61 time: 0.114113 Apr 09 20:59:05.519399 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 601/1238] 10.222.0.30 () {62 vars in 1218 bytes} [Sat Apr 9 20:59:05 2022] PUT /compute/v2.1/flavors/1029805637 => generated 468 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:05.542099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:05.547869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:05.574483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.575252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.576035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:05.588321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:05.951211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:05.970727 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c735f63f-9ea2-4f31-871d-c03c615987ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1349 microversion: 2.1 time: 0.435112 Apr 09 20:59:05.970727 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 602/1239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1349 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:05.984692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-46d084b4-b0d5-41bf-b670-3fb84e4f2ebf tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:06.007838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:06.038854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:06.047377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:06.071222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f47d8fb1-adf9-4f14-b027-baf222f367a5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.600574 Apr 09 20:59:06.071222 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 638/1240] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:06.089489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:06.102015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:06.117670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-46d084b4-b0d5-41bf-b670-3fb84e4f2ebf tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6777 microversion: 2.61 time: 0.146749 Apr 09 20:59:06.123119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 603/1241] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:59:05 2022] GET /compute/v2.1/flavors/detail => generated 6777 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:06.123908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:06.127248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:06.129849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:06.131886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:06.141152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:06.147234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:06.163319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:06.164082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:06.165115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:06.166216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.182576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:07.197901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3c0d63f-1f0d-4019-876c-651a0f361509 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1506 microversion: 2.1 time: 1.072698 Apr 09 20:59:07.200421 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 604/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:06 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1506 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:07.209878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:07.213014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a39ea2c2-1f04-401a-8faa-60cb5ff9da7a tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.233121 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3233232d-cea1-4273-914c-cb8c319c7aee tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1466 microversion: 2.1 time: 1.168761 Apr 09 20:59:07.234015 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 639/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:06 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1466 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:07.247671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-176639d4-7708-4c92-9139-023d44f3df68 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eb3edc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.297605 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a39ea2c2-1f04-401a-8faa-60cb5ff9da7a tempest-FlavorsV261TestJSON-53776708 tempest-FlavorsV261TestJSON-53776708-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3494 microversion: 2.61 time: 0.094666 Apr 09 20:59:07.310843 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 605/1244] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/flavors => generated 3494 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:07.321446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.322077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:07.339475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.339951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.344110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.344632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.345773 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-176639d4-7708-4c92-9139-023d44f3df68 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.109932 Apr 09 20:59:07.360372 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 640/1245] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:07.368593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.369530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:07.383938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.385622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.386886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.387571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.769472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:07.794806 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-11098a88-cbd1-492b-a0c9-0e1ee5c829fe tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.480301 Apr 09 20:59:07.795614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 606/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:07.800829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.806749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:07.829383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.830032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.831462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.832352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.882045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:07.895688 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a65ddd3a-48dd-4fe1-964a-4fec3d4a7fdb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.532717 Apr 09 20:59:07.896707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 641/1247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:07.902046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:07.902591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:07.935074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.935074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:07.939115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:07.939717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.022721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:08.026413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4d7b0d64-9344-405b-ae55-498e34d7df1e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/os-instance-actions/req-c4147fcf-3862-4dda-a2b9-0cdc63189af5" status: 200 len: 313 microversion: 2.1 time: 0.126920 Apr 09 20:59:08.027889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 642/1248] 10.222.0.30 () {58 vars in 1418 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/os-instance-actions/req-c4147fcf-3862-4dda-a2b9-0cdc63189af5 => generated 313 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:08.040227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.041513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:08.052710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.061951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.064308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.065197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.326409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:08.355190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:08.360319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:08.362047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9ca02f4-354a-45d5-ad01-fe96a8a151ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.564972 Apr 09 20:59:08.362194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 607/1249] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:07 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:08.368348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-465317b0-9875-4514-ad47-5bc752d0150e tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.369152 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:08.369152 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:59:08.400121 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-465317b0-9875-4514-ad47-5bc752d0150e tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1029805637" status: 202 len: 0 microversion: 2.61 time: 0.036767 Apr 09 20:59:08.404970 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 608/1250] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Apr 9 20:59:08 2022] DELETE /compute/v2.1/flavors/1029805637 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:08.418770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:08.421078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:08.442061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.442860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.448233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.449768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.685502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eecaad24-6f5c-4e23-ad6c-de903c745d75 tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1617 microversion: 2.1 time: 0.655145 Apr 09 20:59:08.688461 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 643/1251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:08 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1617 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:08.700950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-74b7ba67-e294-4e03-86c2-b6883a1d6367 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eaef3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.741082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d202489a-7e12-4a17-9ea6-3635e12a7deb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "POST /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/action" status: 202 len: 0 microversion: 2.1 time: 0.332397 Apr 09 20:59:08.744466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 609/1252] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:59:08 2022] POST /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:59:08.768801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea0594e9-5676-4c5d-a48c-21ea1a7662b1 tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.853344 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-74b7ba67-e294-4e03-86c2-b6883a1d6367 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.161448 Apr 09 20:59:08.854136 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 644/1253] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:08 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:08.861080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.868893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:08.876564 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea0594e9-5676-4c5d-a48c-21ea1a7662b1 tempest-FlavorsV261TestJSON-1837756857 tempest-FlavorsV261TestJSON-1837756857-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6319 microversion: 2.61 time: 0.125331 Apr 09 20:59:08.877462 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 610/1254] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 20:59:08 2022] GET /compute/v2.1/flavors/detail => generated 6319 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:08.897939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:08.898686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:08.924575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.928667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.930957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.931435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.932252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.932709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:08.935859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:08.936911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:09.569525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:09.576047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-77ae866c-4d01-4d75-bb65-f1a8774f3897 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.695801 Apr 09 20:59:09.576970 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 611/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:08 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:09.586471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:09.586471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:09.590391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:09.591115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:09.592019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:09.592576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:09.620740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:09.629886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8af75c61-6658-4044-a9dd-fbc2e51505fb tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1508 microversion: 2.1 time: 0.773618 Apr 09 20:59:09.645157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 645/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:08 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1508 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:09.655931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-be63879a-c8d3-4993-b70e-93186d129925 req-3e2a260e-e7ae-417d-8c64-f66dd43d24c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:09.669155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-be63879a-c8d3-4993-b70e-93186d129925 req-3e2a260e-e7ae-417d-8c64-f66dd43d24c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:09.670089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-be63879a-c8d3-4993-b70e-93186d129925 req-3e2a260e-e7ae-417d-8c64-f66dd43d24c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:09.694334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-be63879a-c8d3-4993-b70e-93186d129925 req-3e2a260e-e7ae-417d-8c64-f66dd43d24c6 service nova] Creating event network-changed:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 20:59:09.704588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-be63879a-c8d3-4993-b70e-93186d129925 req-3e2a260e-e7ae-417d-8c64-f66dd43d24c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057659 Apr 09 20:59:09.709429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 646/1257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:09.724041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-790777891", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "acad92b7-b70e-44e1-9c3d-2938f626d037"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:09.842086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:10.247898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:10.271952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-051e9bfc-7e3b-4feb-bfc3-14ec7ebbd9a4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.693698 Apr 09 20:59:10.280182 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 612/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:09 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:10.293633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:10.294417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:10.316967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.320630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.321692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.322212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.657254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:10.657731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:10.658220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:10.658907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:10.659652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:10.675065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.675480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.681207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.681987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.725531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:10.733983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Getting quotas for user 0bcc50583d0c4b9aa9d9c9b7ad87a576 and project b21b82d625c249269c02db9bbe700c7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:10.762498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:10.765020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:10.841785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:10.852502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:10.858797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:10.864964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24454a7f-c9dd-4048-8faa-9e625b9ae006 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.581919 Apr 09 20:59:10.878176 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 613/1259] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:10 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:10.884829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-79dc47d3-6a5d-4c4e-a9f9-25d4397cb2ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08edc4670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:10.887913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1216950e-838f-4d59-b50c-7ca6e6314c87 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176627 Apr 09 20:59:10.893985 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 647/1260] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:59:10.899320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:10.906368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:10.930499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.931046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.931748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:10.932199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:10.975299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-79dc47d3-6a5d-4c4e-a9f9-25d4397cb2ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.095598 Apr 09 20:59:10.976529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 614/1261] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:10 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:10.985443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:11.001273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:11.017104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.017823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.018811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.019471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.292793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:11.303510 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5541209-b5b8-4d82-b24c-d356b191d59d tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.407978 Apr 09 20:59:11.304077 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 648/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:10 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:11.314002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-24bb7762-6b71-4a0b-a858-a4326a7de8dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:11.314169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-24bb7762-6b71-4a0b-a858-a4326a7de8dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:11.319277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:11.340086 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-633f9152-4087-40e0-984d-9bf2da10a305 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1508 microversion: 2.1 time: 0.362167 Apr 09 20:59:11.355153 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 615/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:10 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:11.369192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:11.370114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:11.386416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.387166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.388133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.393599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.466876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-24bb7762-6b71-4a0b-a858-a4326a7de8dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:11.475007 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-24bb7762-6b71-4a0b-a858-a4326a7de8dd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1216 microversion: 2.1 time: 0.165589 Apr 09 20:59:11.487711 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 649/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:11 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:11.607678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:11.620794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84c04a94-ad6c-49a5-ac5c-55ad24891b73 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.264029 Apr 09 20:59:11.624215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 616/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:11 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:11.887128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:11.889096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:11.902099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.902555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.903607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:11.904289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:11.989373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce2a27ba-efe2-467d-8ebb-f20184fb684d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee71f70>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:12.064198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce2a27ba-efe2-467d-8ebb-f20184fb684d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.078966 Apr 09 20:59:12.066842 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 617/1266] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:11 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:12.141510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:12.152877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:12.154924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:12.156215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eefe6c66-0a6a-4d30-a913-ce2054c97bee tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1644 microversion: 2.25 time: 0.274833 Apr 09 20:59:12.167686 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 650/1267] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:11 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1644 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:12.323684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:12.324307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:12.335733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.335733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.338445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.338887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.358244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:12.358995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:12.375084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.375769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.377766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.378372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.701454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:12.734821 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90d29756-01c6-4550-b098-5d3a4c81c3dc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.415510 Apr 09 20:59:12.746336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 618/1268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:12 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:12.760262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:12.760903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:12.777543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.781192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.782074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.782523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.854027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:12.873702 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0575993-95d5-4c59-9e3c-1a0cfb21ee4e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1506 microversion: 2.1 time: 0.516202 Apr 09 20:59:12.889751 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 651/1269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:12 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:12.903097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:12.907208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:12.931078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.940138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:12.941904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:12.942524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.130089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:13.140225 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42692046-3593-4563-bb6f-c035b5dcf9b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1212 microversion: 2.1 time: 0.392024 Apr 09 20:59:13.140827 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 619/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:12 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1212 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:13.153994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '.version_select at 0x7fb08ee6a670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.159167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:13.169880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.170885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.172842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.173657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.262757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d3dd6d9-8f9e-48e2-bdd8-ef67bf476733 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.118115 Apr 09 20:59:13.265171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 620/1271] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 20:59:13 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:13.280939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1bd35329-d983-453f-9bec-ea31daada6ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08edeb310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.304227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:13.312658 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b39267c4-1717-43bc-a6be-08fbfd0f819e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.421033 Apr 09 20:59:13.314078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 652/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:12 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:13.321796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.322699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:13.344701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.347067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.348919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.351313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.418476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1bd35329-d983-453f-9bec-ea31daada6ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.151254 Apr 09 20:59:13.421350 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 621/1273] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:13 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:13.444880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.445853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:13.471136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.471824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.472885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.473570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.526082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:13.746884 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84b17bb9-4ab3-4531-aece-9f14aa18d1bf tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 204 len: 0 microversion: 2.1 time: 0.318595 Apr 09 20:59:13.748315 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 622/1274] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:13 2022] DELETE /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:13.769813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.770786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:13.789309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.794169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.798170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.798942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.887575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:13.902633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:13.905209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:13.906597 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3930f59-82da-4b28-91cb-c1d8404b8d0f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1634 microversion: 2.25 time: 0.591307 Apr 09 20:59:13.912989 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 653/1275] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:13 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1634 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:13.931364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:13.933672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:13.947040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.949306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:13.951623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:13.954451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.314565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:14.316407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:14.325642 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0547303e-fb4c-4e6b-8674-479baefcd939 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.574793 Apr 09 20:59:14.326446 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 623/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:13 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:14.328012 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46393698-4e44-4188-b850-2196a7781169 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1512 microversion: 2.1 time: 0.412429 Apr 09 20:59:14.333141 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 654/1277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:13 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:14.333851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02dee97e-fa81-47d2-ad4d-d5628b0aee10 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '.version_select at 0x7fb08edf13a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.340451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02dee97e-fa81-47d2-ad4d-d5628b0aee10 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.344829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02dee97e-fa81-47d2-ad4d-d5628b0aee10 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.363734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.365100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:14.370098 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02dee97e-fa81-47d2-ad4d-d5628b0aee10 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.042302 Apr 09 20:59:14.371243 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 624/1278] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:14.377096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.377912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:14.385018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.385496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.386322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.386921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.395714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.396444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.397693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.398541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.524056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:14.535430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-616a7e63-42e5-422e-b608-1cafadce0a5e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1286 microversion: 2.1 time: 0.202549 Apr 09 20:59:14.549215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 655/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:14.555527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.556495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:14.566757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.567251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.568549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.569406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.682878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:14.695897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f8b83b0-70a9-4937-aa4f-74d4d6d78bb3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.318675 Apr 09 20:59:14.696741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 625/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:14.706716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d67aaa1-69bc-4b11-a345-ffc9fc99610c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ed84700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.790102 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d67aaa1-69bc-4b11-a345-ffc9fc99610c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.092210 Apr 09 20:59:14.794428 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 626/1281] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:14.842436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:59:14.861604 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb79eea8-d47b-43f9-a038-2385d8e5226e tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 2126 microversion: 2.25 time: 0.310222 Apr 09 20:59:14.862642 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 656/1282] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 2126 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:14.880798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:14.881748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:14.890327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.890903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:14.891794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:14.892303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.234282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:59:15.304874 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b92db26e-b2ac-435c-bdce-1721a537bf46 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 2126 microversion: 2.25 time: 0.427841 Apr 09 20:59:15.305736 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 627/1283] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:14 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 2126 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:59:15.364228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:15.367016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:15.368238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:15.369783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:15.379748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.380663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.382233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.382836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.389380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.393981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.402483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.402961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.842267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:15.854687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14093de5-2d07-4f79-9d1f-b4ce09d97ad2 tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1512 microversion: 2.1 time: 0.507320 Apr 09 20:59:15.866983 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 628/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:15 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:15.877674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:15.878281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:15.897470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.897946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.899170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.899778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.935920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:15.946417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-369d068c-6882-4c41-a4a3-ac9131914b71 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.606902 Apr 09 20:59:15.947025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 657/1285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:15 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:15.962438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:15.963066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:15.978592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.979437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:15.988148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:15.988711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:16.295073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lazy-loading 'services' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:59:16.705495 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments/5fa8081f-7b54-455a-a346-4214f8f81f79" status: 202 len: 0 microversion: 2.25 time: 0.837064 Apr 09 20:59:16.716517 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 629/1286] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Apr 9 20:59:15 2022] DELETE /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments/5fa8081f-7b54-455a-a346-4214f8f81f79 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:16.735262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:16.740577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:16.744362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:16.744692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d775b52-3e22-4264-b5da-7e60e6959c7f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.796615 Apr 09 20:59:16.758351 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 658/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:15 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:16.768834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ca5dac57-630d-4d71-9f17-4f825c5d7a23 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ec36dc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:16.769499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:16.771292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:16.775760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:16.776629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:16.858068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ca5dac57-630d-4d71-9f17-4f825c5d7a23 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1414 microversion: 2.1 time: 0.096652 Apr 09 20:59:16.860689 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 659/1288] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:16 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:16.871439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f441a14f-3608-47f7-90e6-b18baf127c8b req-0098ba10-d439-4b6f-a480-082e97a80684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-plugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:16.888787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f441a14f-3608-47f7-90e6-b18baf127c8b req-0098ba10-d439-4b6f-a480-082e97a80684 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:16.889920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f441a14f-3608-47f7-90e6-b18baf127c8b req-0098ba10-d439-4b6f-a480-082e97a80684 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:16.910592 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f441a14f-3608-47f7-90e6-b18baf127c8b req-0098ba10-d439-4b6f-a480-082e97a80684 service nova] Creating event network-vif-plugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 20:59:16.934467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f441a14f-3608-47f7-90e6-b18baf127c8b req-0098ba10-d439-4b6f-a480-082e97a80684 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071265 Apr 09 20:59:16.936866 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 660/1289] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:17.111962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:17.124457 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7cc6ce58-8fcd-447f-8d09-5cd944385fc1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.406059 Apr 09 20:59:17.126074 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 630/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:16 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:17.138342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-779348e3-7162-4bd5-bbba-e44977db7c9c req-9834f9b0-ea5a-454c-a4b5-8427da466f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28990a58-26ce-477f-aa75-401da370fa1b", "name": "network-vif-deleted", "tag": "28be12eb-f5a0-44c9-8952-c7005682176d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:17.155418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Calling method '.version_select at 0x7fb08eb60af0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.156296 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:17.156296 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:59:17.157496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.157943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-779348e3-7162-4bd5-bbba-e44977db7c9c req-9834f9b0-ea5a-454c-a4b5-8427da466f9b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.158539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-779348e3-7162-4bd5-bbba-e44977db7c9c req-9834f9b0-ea5a-454c-a4b5-8427da466f9b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.158753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.173574 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-779348e3-7162-4bd5-bbba-e44977db7c9c req-9834f9b0-ea5a-454c-a4b5-8427da466f9b service nova] Creating event network-vif-deleted:28be12eb-f5a0-44c9-8952-c7005682176d for instance 28990a58-26ce-477f-aa75-401da370fa1b on nch1-master-1 Apr 09 20:59:17.181478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-779348e3-7162-4bd5-bbba-e44977db7c9c req-9834f9b0-ea5a-454c-a4b5-8427da466f9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053364 Apr 09 20:59:17.181788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.182114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.184167 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 631/1291] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:17.194940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.196125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:17.206162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.206783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.207810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.207946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.208352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.208715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.218384 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7170c4ab-e4a0-4510-82fe-7bd94ad95f13 tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.274032 Apr 09 20:59:17.219301 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 661/1292] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:59:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:17.224583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.225637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:17.234841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.235575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.236562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.237350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.268668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b06c89c0-ea1e-42b3-af57-9cfdea62e5dc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082295 Apr 09 20:59:17.274494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 632/1293] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:17.281789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.282637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.283101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lazy-loading 'fault' on Instance uuid 28990a58-26ce-477f-aa75-401da370fa1b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 20:59:17.284184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.285248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:17.298856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.299856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.301134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.301883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.390189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26f77ab87bf4c67ac3513a2f62056f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70c13d77d304aa69f4eeb95e037ea4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:17.411474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8052206-9760-4c05-919f-6ab0721f834e tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 200 len: 1307 microversion: 2.1 time: 0.190922 Apr 09 20:59:17.416445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 662/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:17.422761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Calling method '.version_select at 0x7fb08eb0d4c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.424144 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:17.424144 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:59:17.425524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.426649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.467707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.471348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.507776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.509282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.517313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4d66531-cdae-401b-8d6b-aa70bfaf843e tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.099082 Apr 09 20:59:17.518581 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 663/1295] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 591 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:17.530182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Calling method '.version_select at 0x7fb08eb9b700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.531277 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:17.531277 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:59:17.532438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.532931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.547217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.548100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.558696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.559145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.565514 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f71629a6-d190-410f-94c9-c995f29b789c tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039430 Apr 09 20:59:17.566430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 664/1296] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:59:17.575793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Calling method '.version_select at 0x7fb08ec36dc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.576773 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:17.576773 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 20:59:17.577933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.578697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.592682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.593418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.600147 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bbf5f22f-06ca-43ee-a249-9c3c81245cea tempest-HypervisorAdminUnderV252Test-1342044758 tempest-HypervisorAdminUnderV252Test-1342044758-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.027922 Apr 09 20:59:17.600986 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 665/1297] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:17.745174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:17.759143 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6530e265-062e-41c9-aa41-7d6c1cdebbe0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.481957 Apr 09 20:59:17.759848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 633/1298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:17.770189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.770827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:17.778025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.778705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.779948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:17.780599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:17.873069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-706cdafd-df72-4f1f-b25a-07e2a805e9d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee5cca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:17.934784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-706cdafd-df72-4f1f-b25a-07e2a805e9d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1423 microversion: 2.1 time: 0.066886 Apr 09 20:59:17.935591 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 634/1299] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1423 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:17.948695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec0e3462-ca6a-4c0a-af7e-8b8f48788b7f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08edebc10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.020701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec0e3462-ca6a-4c0a-af7e-8b8f48788b7f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 200 len: 1423 microversion: 2.1 time: 0.073628 Apr 09 20:59:18.021650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 635/1300] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:18.039634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c04edf1c-570a-4f38-80d3-fe2426565174 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08edde3a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.109804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:18.117892 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-218f4240-cda7-473b-b2f6-b19ea8450fb5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.359888 Apr 09 20:59:18.121746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 666/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:17 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:18.142886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.143573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:18.158563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.159014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.159879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.160320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.409165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:18.432316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22f3b656-0e45-4f8d-9b79-c177b8691450 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1379 microversion: 2.1 time: 0.293629 Apr 09 20:59:18.432915 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 667/1302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:18 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1379 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:18.440473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.441750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:18.450500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.451191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.452371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.453178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.498786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff66c32f-02bc-4992-9ee9-2d2432486852 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062094 Apr 09 20:59:18.499777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 668/1303] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:18 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:18.507935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.509009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] [instance: 28990a58-26ce-477f-aa75-401da370fa1b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:18.516981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.518216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.519795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.520704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.539870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] HTTP exception thrown: Instance 28990a58-26ce-477f-aa75-401da370fa1b could not be found. Apr 09 20:59:18.540982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] Returning 404 to user: Instance 28990a58-26ce-477f-aa75-401da370fa1b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:59:18.542605 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31343bec-2eb0-4cce-a146-0d139966d9fc tempest-InstanceActionsTestJSON-779995669 tempest-InstanceActionsTestJSON-779995669-project] 10.222.0.30 "GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b" status: 404 len: 111 microversion: 2.1 time: 0.041213 Apr 09 20:59:18.544074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 669/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:18 2022] GET /compute/v2.1/servers/28990a58-26ce-477f-aa75-401da370fa1b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:18.572799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c3c45f8d-76a7-442c-9e56-cfd5b76fbe0c req-6953d5f9-9383-471b-99b4-de6814339a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831c8065-303b-4271-ac06-8ac2d0b5d248", "tag": "71a75f60-0cc8-491d-b9f0-e42dc7c09b58"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:18.599440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c3c45f8d-76a7-442c-9e56-cfd5b76fbe0c req-6953d5f9-9383-471b-99b4-de6814339a11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.600554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c3c45f8d-76a7-442c-9e56-cfd5b76fbe0c req-6953d5f9-9383-471b-99b4-de6814339a11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.629420 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c3c45f8d-76a7-442c-9e56-cfd5b76fbe0c req-6953d5f9-9383-471b-99b4-de6814339a11 service nova] Creating event network-changed:71a75f60-0cc8-491d-b9f0-e42dc7c09b58 for instance 831c8065-303b-4271-ac06-8ac2d0b5d248 on nch1-master-1 Apr 09 20:59:18.637419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c3c45f8d-76a7-442c-9e56-cfd5b76fbe0c req-6953d5f9-9383-471b-99b4-de6814339a11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085198 Apr 09 20:59:18.641305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 670/1305] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:18.780300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:18.782949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:18.824757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.825563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:18.826914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:18.828072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.049431 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c04edf1c-570a-4f38-80d3-fe2426565174 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 204 len: 0 microversion: 2.1 time: 1.019153 Apr 09 20:59:19.050841 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 636/1306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:18 2022] DELETE /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 0 bytes in 1021 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:19.060130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:19.060839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:19.074489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.075077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.076168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.076617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.105763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:19.227890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0684a96-7825-4431-83e9-cc88949bde88 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 204 len: 0 microversion: 2.1 time: 0.172060 Apr 09 20:59:19.234707 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 637/1307] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:19 2022] DELETE /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 20:59:19.243384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:19.244376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:19.253358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.254115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.255339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.255957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.756550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:19.769616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c10c589c-e1d7-4c5c-b9fc-09fe29dca7cd tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.532949 Apr 09 20:59:19.770535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 638/1308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:19 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:19.787801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:19.788731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:19.795049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.795511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.796298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:19.796887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:19.803038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:19.812345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b302576-bdd6-423c-82b4-9fd7bf2dafff tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 1.039125 Apr 09 20:59:19.812928 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 671/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:18 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:19.841144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-534495882", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "78a6d2d3-bb80-48c0-a446-3fd1d832ea3c"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:19.903434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] validate_networks() for [('78a6d2d3-bb80-48c0-a446-3fd1d832ea3c', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:20.193673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:20.203897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95eae997-8307-4f1d-a8e1-75e5c4ab5b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1529 microversion: 2.1 time: 0.432038 Apr 09 20:59:20.205248 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 639/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:19 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1529 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:20.212687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:20.214653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:20.222287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.223362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.224853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.225808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.265611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7aae1534-b4c8-482b-8ab5-f1fcdf927419 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058805 Apr 09 20:59:20.266870 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 640/1311] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:20 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:20.272058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:20.272993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:20.279501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.280325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.281359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.282034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.645639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:20.654613 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92de83e9-4eb8-483e-b1d8-306d4ff1da6c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1529 microversion: 2.1 time: 0.386376 Apr 09 20:59:20.657785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 641/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:20 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1529 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:20.674767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d590c755-3dbc-4b1b-9b6f-30ac93954c32 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:20.675973 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 20:59:20.675973 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 20:59:20.720075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d590c755-3dbc-4b1b-9b6f-30ac93954c32 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/4b30fb8f-c92b-427b-9397-3a5d308020a6" status: 202 len: 0 microversion: 2.1 time: 0.048983 Apr 09 20:59:20.721351 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 642/1313] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:20 2022] DELETE /compute/v2.1/flavors/4b30fb8f-c92b-427b-9397-3a5d308020a6 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 20:59:20.731697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-479db1f7-b2da-407a-8664-ca596fe9f459 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:20.795701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-479db1f7-b2da-407a-8664-ca596fe9f459 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064129 Apr 09 20:59:20.801559 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 643/1314] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 20:59:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:20.816081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:20.818358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:20.831320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.832745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.833822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.837012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.949352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:20.949830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:20.950229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:20.950625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:20.951263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:20.971977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.972740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:20.974419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:20.976625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.015073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:21.020286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for user 33746e27054c4f1db976d4a4ae44e073 and project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:21.043716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:21.047502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:21.100094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:21.133162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9de665bd-2e5d-48f7-98f8-cd019fc0dda5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.329108 Apr 09 20:59:21.134798 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 644/1315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:20 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:21.149773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:21.152399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:21.167790 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e790028f-ff8a-4295-8a16-44649c087aaa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338618 Apr 09 20:59:21.170349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 672/1316] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:59:21.179768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.181204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.186370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.187593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.187994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:21.188637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:21.208703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.213084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.214931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.216242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.242354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:21.261802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Old instance type tempest-test_resize_flavor_-329033097, new instance type m1.heat {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 20:59:21.270985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:21.271668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:21.272581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:21.273444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:21.274294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:21.427284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0019b498-0e6e-4286-95cf-020118487892 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1/action" status: 202 len: 0 microversion: 2.1 time: 0.281433 Apr 09 20:59:21.441759 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 645/1317] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:59:21 2022] POST /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:59:21.468190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-45fa5972-3144-4353-94ae-7343575ba8f4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:21.470036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-45fa5972-3144-4353-94ae-7343575ba8f4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:21.679558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45fa5972-3144-4353-94ae-7343575ba8f4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:21.708080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45fa5972-3144-4353-94ae-7343575ba8f4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1207 microversion: 2.1 time: 0.254916 Apr 09 20:59:21.711410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 646/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:21 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1207 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:21.733158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:21.743347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:21.774617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.776608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.782870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.783709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.847328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:21.857598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-575aeefe-4908-4753-a33f-5be39cbaf4bd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.680764 Apr 09 20:59:21.866742 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 673/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:21 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:21.887472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:21.888523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:21.899830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ee365aa-c17d-4de8-aa98-1ab3c53b9ba5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.176031 Apr 09 20:59:21.903225 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 647/1320] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:21 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:21.907600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.923542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:21.930777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:21.932043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.153445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:22.154074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:22.169188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.171163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.172329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.180280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.541178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:22.555679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dadb4039-969e-4037-9a58-d73383bb319b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1538 microversion: 2.1 time: 0.687386 Apr 09 20:59:22.566219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 674/1321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:21 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1538 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:22.719789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:22.728221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:22.729456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:22.736714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e40b7a86-c105-417b-a220-5101092902b0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.589064 Apr 09 20:59:22.742513 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 648/1322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:22 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:22.754091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.755003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.756102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.756769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.877341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:22.880092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:22.912786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.913291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.914115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:22.914556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:22.974372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:22.988120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d83d04d7-f93d-43fc-b8fc-b79d4c996d43 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1259 microversion: 2.1 time: 0.264162 Apr 09 20:59:23.017845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 675/1323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:22 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1259 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:23.053932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:23.055568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:23.067388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:23.076353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:23.077412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:23.078754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:23.120140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa16f62e-ec9a-43f9-bfe9-da1dfc9e78ae tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101054 Apr 09 20:59:23.121382 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 676/1324] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:23 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:23.352533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:23.365859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a58f14bd-0574-43db-bf76-c0ab160c94f9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.491693 Apr 09 20:59:23.367927 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 649/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:22 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:23.575514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:23.577844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:23.606194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:23.607865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:23.609733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:23.610886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.014794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:24.026158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f484336-909e-4354-8b10-d9ca717236d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1538 microversion: 2.1 time: 0.456543 Apr 09 20:59:24.027577 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 650/1326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:23 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1538 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:24.036451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:24.037317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:24.046928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.047650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.048745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.050221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.136712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1018209312", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:24.229991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:24.644510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:24.671423 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03971830-9c99-4bd1-a6c7-dfdc76e81216 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.640091 Apr 09 20:59:24.674212 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 651/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:24 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:24.691379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:24.693608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:24.703946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.704566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.710112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.710890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.815255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:24.815752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:24.816218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:24.816623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:24.817028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:24.839998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.840699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.841695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.842435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.884887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Getting quotas for project 23df4eef46ae4894870e050990d597f0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:24.888924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Getting quotas for user 16441a7999c149ff9dd66e0b3a3a95b4 and project 23df4eef46ae4894870e050990d597f0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:24.912404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:24.915930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:24.919942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:24.922361 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5bf27b17-8c47-4835-91a5-9f9383a62ed4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1265 microversion: 2.1 time: 0.244066 Apr 09 20:59:24.922959 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 652/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:24 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:24.938232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:24.949612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:24.968840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.969350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:24.970144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:24.970577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.005677 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd6dd9aa-e0a4-44c5-a0c4-1d7b0f6ae782 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539071 Apr 09 20:59:25.007165 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 677/1329] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:59:25.012622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Action: 'create', calling method: .version_select at 0x7fb08eadb1f0>, body: {"keypair": {"name": "tempest-keypair-927685062"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:25.036138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18d9905f-6dc1-490c-be92-bfeac6280a36 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101619 Apr 09 20:59:25.039213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 653/1330] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:24 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:25.061860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:25.064663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:25.064889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:25.070661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for user c3f004d8412d43d7a82f7daa56f47305 and project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:25.088534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.091238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.092580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.094298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.370939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:25.387972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for user c3f004d8412d43d7a82f7daa56f47305 and project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:25.441424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73526597-e276-4501-8b0f-0f1c4f6048d5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.32 time: 0.432581 Apr 09 20:59:25.447363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 678/1331] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 20:59:25 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 434 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 20:59:25.448128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7fd015ab-fea5-4e47-b021-405cd8b375fd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:25.458315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7fd015ab-fea5-4e47-b021-405cd8b375fd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:25.577158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:25.586096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-decc7490-8258-4c6a-b6c3-d5c2352e9a5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.545820 Apr 09 20:59:25.586677 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 654/1332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:25 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:25.598904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:25.601331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:25.617757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.622104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.624610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.625360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.630392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7fd015ab-fea5-4e47-b021-405cd8b375fd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:25.640895 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7fd015ab-fea5-4e47-b021-405cd8b375fd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1222 microversion: 2.1 time: 0.197162 Apr 09 20:59:25.651746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 679/1333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:25 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:25.691215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:25.691847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:25.706898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.707357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:25.708601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:25.710019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.012600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:26.030995 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e571fc4-7b4d-47d3-a8a8-5899f2633c07 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1538 microversion: 2.1 time: 0.436263 Apr 09 20:59:26.035191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 655/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:25 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1538 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:26.054299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5758f359-c026-4501-9010-8eab1cdaaea4 req-970e6d71-b3aa-49b0-b86a-9adaa0fe18a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66be7a-97fe-4f7d-94fb-645e9b367f42", "name": "network-vif-unplugged", "status": "completed", "tag": "765d63be-a291-4796-9abd-dd6dc3afb689"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:26.073766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5758f359-c026-4501-9010-8eab1cdaaea4 req-970e6d71-b3aa-49b0-b86a-9adaa0fe18a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.075359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5758f359-c026-4501-9010-8eab1cdaaea4 req-970e6d71-b3aa-49b0-b86a-9adaa0fe18a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.089137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:26.102065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5758f359-c026-4501-9010-8eab1cdaaea4 req-970e6d71-b3aa-49b0-b86a-9adaa0fe18a9 service nova] Creating event network-vif-unplugged:765d63be-a291-4796-9abd-dd6dc3afb689 for instance de66be7a-97fe-4f7d-94fb-645e9b367f42 on nch2-master-1 Apr 09 20:59:26.107281 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52aa49c4-2eaa-459d-8b7b-68d59847679b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.420437 Apr 09 20:59:26.109731 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 680/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:25 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:26.117684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:26.119271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:26.124163 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5758f359-c026-4501-9010-8eab1cdaaea4 req-970e6d71-b3aa-49b0-b86a-9adaa0fe18a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078662 Apr 09 20:59:26.128593 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 656/1336] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:26.131080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.131695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.133342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.134224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.141569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:26.142637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:26.157299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.157754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.159356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.160459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.206444 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e162fa6-b876-41ae-9c08-70467304808d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075442 Apr 09 20:59:26.207245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 657/1337] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:26 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:26.498815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:26.510129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35c64fee-8d7c-4b5d-90da-a4270a753e56 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.398937 Apr 09 20:59:26.513721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 681/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:26 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:26.604882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:26.605331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:26.621870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.622523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.623458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:26.624041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:26.635134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1657440660", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9db78731-e1e1-4de6-972d-c058e9bb637d"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:26.702480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] validate_networks() for [('9db78731-e1e1-4de6-972d-c058e9bb637d', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:27.439052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:27.457882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2645f733-1684-4de3-b347-56dad1555f11 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.857962 Apr 09 20:59:27.458688 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 682/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:26 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:27.465466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:27.466461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:27.473061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:27.473643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:27.474471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:27.474903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:27.599200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:27.607238 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8906635e-f9e4-4b3c-a7b0-daa6d2cfc46b tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1280 microversion: 2.1 time: 0.146647 Apr 09 20:59:27.608037 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 683/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:27 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:27.612741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-abff3060-f781-4a5d-9951-b421bf86a796 req-13ecd187-1dcf-4c42-a32c-6d168dc0178b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b2094d-9261-4ac8-990d-b7103bd8ba3a", "tag": "061549ac-a3d6-4b74-9e58-6e99390adc84"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:27.621479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-abff3060-f781-4a5d-9951-b421bf86a796 req-13ecd187-1dcf-4c42-a32c-6d168dc0178b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:27.622186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-abff3060-f781-4a5d-9951-b421bf86a796 req-13ecd187-1dcf-4c42-a32c-6d168dc0178b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:27.633699 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-abff3060-f781-4a5d-9951-b421bf86a796 req-13ecd187-1dcf-4c42-a32c-6d168dc0178b service nova] Creating event network-changed:061549ac-a3d6-4b74-9e58-6e99390adc84 for instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a on nch1-master-1 Apr 09 20:59:27.639129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-abff3060-f781-4a5d-9951-b421bf86a796 req-13ecd187-1dcf-4c42-a32c-6d168dc0178b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Apr 09 20:59:27.639928 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 684/1341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:27.645445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:27.646299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:27.652759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:27.653233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:27.654014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:27.654489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.004817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:28.013690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-545722a9-1043-4c9a-b5e4-782aaf9b3af9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.372032 Apr 09 20:59:28.014585 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 685/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:27 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:28.019285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:28.019897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:28.026337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.026803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.027904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.028363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.061009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:28.061537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:28.062024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:28.062515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:28.063016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:28.072338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.072782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.073662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.074105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.091118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Getting quotas for project 3389a4f6db1e4cd7b183da2c7e6a4850. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:28.095498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Getting quotas for user 570ad335e35d460fa3fa337374a5a431 and project 3389a4f6db1e4cd7b183da2c7e6a4850. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:28.107488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Going to run 3 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:28.109838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:28.149806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=c963ea0b-4eee-4241-a6d4-f49b42ec7c10,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:28.185493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:28.248862 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9efc05d-e921-44d1-a504-0ddb692e14bc tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786660 Apr 09 20:59:28.249559 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 658/1343] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:59:28.254581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:28.255378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:28.261874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.262544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.263192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.263638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.271245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:28.280246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64fd6a95-bdf0-4804-ac0b-2c6230a1e545 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.264314 Apr 09 20:59:28.280752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 686/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:28 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:28.294144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:28.294864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:28.301976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.302666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.303635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.304227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.315382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fccb6ef7-53ef-4d15-89ce-08e8baea5a1d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064748 Apr 09 20:59:28.315969 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 659/1345] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:28 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:28.321003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-290030709", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "77aa585d-d236-4c76-b3f0-d77cd270281e"}, {"port": "4d183039-0082-437f-a23a-644fd46b056d", "tag": "port-1"}, {"port": "edac2419-450b-406e-b5db-84cf807a3c10", "tag": "port-2"}, {"uuid": "1af320ea-8d0b-4067-a47d-6e9b8642dca3", "tag": "net-1"}, {"uuid": "1af320ea-8d0b-4067-a47d-6e9b8642dca3"}, {"uuid": "a4c51a05-a221-49f3-ae9e-5da1bc9f19e6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a4c51a05-a221-49f3-ae9e-5da1bc9f19e6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6d815065-063f-4887-9bc8-5808837868ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "266a3665-0f1a-4dc2-abdc-875ecf11f419", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "40f07b2b-d7f8-45aa-929d-798886e42bff", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2022044814"}], "key_name": "tempest-keypair-927685062", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:28.530799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] validate_networks() for [('77aa585d-d236-4c76-b3f0-d77cd270281e', None, None, None, None, None), (None, None, '4d183039-0082-437f-a23a-644fd46b056d', None, None, None), (None, None, 'edac2419-450b-406e-b5db-84cf807a3c10', None, None, None), ('1af320ea-8d0b-4067-a47d-6e9b8642dca3', None, None, None, None, None), ('1af320ea-8d0b-4067-a47d-6e9b8642dca3', None, None, None, None, None), ('a4c51a05-a221-49f3-ae9e-5da1bc9f19e6', '10.2.2.100', None, None, None, None), ('a4c51a05-a221-49f3-ae9e-5da1bc9f19e6', '10.2.2.200', None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:28.597577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:28.607323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-daaee1fa-81bc-4ab7-80fe-0f169dd9aa5d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.325122 Apr 09 20:59:28.616944 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 687/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:28 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:28.623472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9d4e77b4-7f3a-4d63-b8bf-c9808d7e4963 req-502a81aa-1c4e-47a3-9a67-e38eee13e38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831c8065-303b-4271-ac06-8ac2d0b5d248", "name": "network-vif-plugged", "status": "completed", "tag": "71a75f60-0cc8-491d-b9f0-e42dc7c09b58"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:28.632315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9d4e77b4-7f3a-4d63-b8bf-c9808d7e4963 req-502a81aa-1c4e-47a3-9a67-e38eee13e38a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.632752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9d4e77b4-7f3a-4d63-b8bf-c9808d7e4963 req-502a81aa-1c4e-47a3-9a67-e38eee13e38a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.645179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9d4e77b4-7f3a-4d63-b8bf-c9808d7e4963 req-502a81aa-1c4e-47a3-9a67-e38eee13e38a service nova] Creating event network-vif-plugged:71a75f60-0cc8-491d-b9f0-e42dc7c09b58 for instance 831c8065-303b-4271-ac06-8ac2d0b5d248 on nch1-master-1 Apr 09 20:59:28.650434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9d4e77b4-7f3a-4d63-b8bf-c9808d7e4963 req-502a81aa-1c4e-47a3-9a67-e38eee13e38a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Apr 09 20:59:28.651798 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 688/1347] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:28.657071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:28.660365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:28.661230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 20:59:28.682886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.683344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.684152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.684589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.764691 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68a85d20-b6d4-4f09-87f5-2582881d2ac2 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.111505 Apr 09 20:59:28.765598 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 689/1348] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 20:59:28 2022] GET /compute/v2.1/servers => generated 1018 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:28.774776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:28.775739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:28.782770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.783265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:28.784303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:28.784964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:29.100287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:29.114906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-151ac3ef-09b4-48bb-80f3-8a85973d8844 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.348189 Apr 09 20:59:29.115519 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 690/1349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:28 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:29.125824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:29.126642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:29.133450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:29.134008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:29.134677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:29.135132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:29.824923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:29.832888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b890c2bb-6211-447c-9568-6c7a5c0414cc tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.710829 Apr 09 20:59:29.833473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 691/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:29 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:29.838196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:29.839577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:29.845819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:29.846262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:29.847159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:29.847601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:30.246878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:30.260855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-008d4bbc-9d99-4e31-a2a0-78e8c7774054 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1275 microversion: 2.1 time: 0.425713 Apr 09 20:59:30.271355 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 692/1351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:29 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1275 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:30.276314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:30.276915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:30.283835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:30.284414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:30.285219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:30.285652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:30.569937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:30.577799 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec1d302f-9264-4ca2-9feb-47a590ec2636 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.305191 Apr 09 20:59:30.587124 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 693/1352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:30 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:30.587124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:30.587124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:30.589809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:30.590293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:30.591072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:30.591503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.034111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:31.044445 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b59f5d3b-301a-44f8-a699-ec002506277e tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1316 microversion: 2.1 time: 0.464498 Apr 09 20:59:31.045996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 694/1353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:30 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:31.053502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:31.055302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:31.067855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.068310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.069458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.070209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.102758 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b07ed5fe-9420-411c-b3ed-5194d31ee400 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054740 Apr 09 20:59:31.103334 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 695/1354] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:31 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:31.108625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:31.109261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:31.116672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.117440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.118424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.118855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.456873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:31.466244 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6f64964-935d-46e2-b2af-76c194456b22 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.361384 Apr 09 20:59:31.476701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 696/1355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:31 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:31.476701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:31.476701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:31.480607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.481085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.481900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.482482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.879090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:31.897272 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9296509d-615b-4ecb-a8c8-dffac2e51464 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.429128 Apr 09 20:59:31.898783 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 697/1356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:31 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:31.913487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:31.917496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:31.924594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.925333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:31.927204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:31.927808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.267326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:32.277389 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb0e1506-9dfc-4e34-a545-6652d4147519 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.377148 Apr 09 20:59:32.278431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 698/1357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:31 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:32.283602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:32.284657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:32.292052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:32.292727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.293700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:32.294281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.537374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:32.552093 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29ad1fb8-3b74-407a-8f28-7071079c03c9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.272156 Apr 09 20:59:32.563427 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 699/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:32 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:32.568887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dd36765c-33a2-4398-b1d2-58d347e724ac req-5743e4a5-b194-4dd7-8908-471b4fb5fe3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81535f89-50ee-497e-b085-84ab9630fee3", "tag": "d2b75502-aefa-4b5b-8bee-c8fc14cee225"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:32.577027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd36765c-33a2-4398-b1d2-58d347e724ac req-5743e4a5-b194-4dd7-8908-471b4fb5fe3c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:32.577636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd36765c-33a2-4398-b1d2-58d347e724ac req-5743e4a5-b194-4dd7-8908-471b4fb5fe3c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.589948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dd36765c-33a2-4398-b1d2-58d347e724ac req-5743e4a5-b194-4dd7-8908-471b4fb5fe3c service nova] Creating event network-changed:d2b75502-aefa-4b5b-8bee-c8fc14cee225 for instance 81535f89-50ee-497e-b085-84ab9630fee3 on nch1-master-1 Apr 09 20:59:32.595562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dd36765c-33a2-4398-b1d2-58d347e724ac req-5743e4a5-b194-4dd7-8908-471b4fb5fe3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030210 Apr 09 20:59:32.596305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 700/1359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:32.601759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:32.602557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:32.610335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:32.610901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.611759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:32.612329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:32.950870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:32.975516 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3eb9658a-fcc3-484d-8ee1-a42fb6f4915b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.377709 Apr 09 20:59:32.977760 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 701/1360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:32 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:32.987396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:32.989054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:33.000480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.001369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.002287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.003127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.519575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:33.520861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:33.521541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:33.522154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:33.522740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:33.536101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.538451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.542145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.542787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.562784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:33.591657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23627f50-f571-4d9a-90a8-d0afa05f1f4a tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1466 microversion: 2.1 time: 0.609822 Apr 09 20:59:33.592984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 702/1361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:32 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1466 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:33.597079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:33.601505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:33.602661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:33.615723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.616436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.616597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Getting quotas for user c3f004d8412d43d7a82f7daa56f47305 and project 9dbc8f96549e4dfaaf941d571addb9c6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:33.617914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.618634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.668504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d0bae077-e015-44c5-bde9-a5f7bb15d628 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072728 Apr 09 20:59:33.669516 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 703/1362] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:33 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:33.677433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:33.678461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:33.687075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.687794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.688852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:33.690255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:33.906924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:33.912589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6d815065-063f-4887-9bc8-5808837868ff',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='266a3665-0f1a-4dc2-abdc-875ecf11f419',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40f07b2b-d7f8-45aa-929d-798886e42bff',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:34.425755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:34.443811 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-121626ea-0a2a-4f66-8cbf-83a146703075 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.772822 Apr 09 20:59:34.455726 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 704/1363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:33 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:34.466532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:34.468090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:34.481321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:34.481766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:34.482556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:34.483986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:34.586260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2ac30b51-9109-4113-9858-d81c493492fe tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.268985 Apr 09 20:59:34.587268 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 660/1364] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Apr 9 20:59:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 6271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 20:59:34.592558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:34.593499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:34.600665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:34.601383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:34.602426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:34.602989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.007109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.019283 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d34c2aff-e420-40f9-90eb-8642295b3492 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.562054 Apr 09 20:59:35.020167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 705/1365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:34 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:35.026156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3ffe30e6-9a59-4687-a289-b87d9d3fc211 req-30bca642-80ff-4bba-ba73-afc7eeb7b3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d480013b-9c5d-4c86-9553-0be0c4abf76f", "tag": "7e43c995-4690-4a85-93bc-a540cbd5e329"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:35.040313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ffe30e6-9a59-4687-a289-b87d9d3fc211 req-30bca642-80ff-4bba-ba73-afc7eeb7b3f5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.041820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ffe30e6-9a59-4687-a289-b87d9d3fc211 req-30bca642-80ff-4bba-ba73-afc7eeb7b3f5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.057002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3ffe30e6-9a59-4687-a289-b87d9d3fc211 req-30bca642-80ff-4bba-ba73-afc7eeb7b3f5 service nova] Creating event network-changed:7e43c995-4690-4a85-93bc-a540cbd5e329 for instance d480013b-9c5d-4c86-9553-0be0c4abf76f on nch1-master-1 Apr 09 20:59:35.067210 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3ffe30e6-9a59-4687-a289-b87d9d3fc211 req-30bca642-80ff-4bba-ba73-afc7eeb7b3f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044582 Apr 09 20:59:35.069264 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 706/1366] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:35.078243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.078668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.079658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.086221 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f1b4c58-23bc-4b98-b91f-bec16b4eb67f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.497321 Apr 09 20:59:35.095304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 661/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:34 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:35.095724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.095724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.095724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.095724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.102726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.104196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.117215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.117678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.118539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.118911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.409376 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e5cfb7fa-3601-4a9d-ab39-ce22ba011d1c tempest-ServersOnMultiNodesTest-245907249 tempest-ServersOnMultiNodesTest-245907249-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1617 microversion: 2.1 time: 0.318626 Apr 09 20:59:35.410171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.419749 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4cfecd8b-022a-4b1e-a5ea-d8e7661147fe tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.348317 Apr 09 20:59:35.424327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 662/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1617 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:35.429584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.430763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.432395 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 707/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:35.439685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ab932fd3-e0ef-4ea3-988f-b599388f7658 req-397852d5-23b7-4ccc-8dbd-21beefa4a8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b2094d-9261-4ac8-990d-b7103bd8ba3a", "name": "network-vif-plugged", "status": "completed", "tag": "061549ac-a3d6-4b74-9e58-6e99390adc84"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:35.444304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.445397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.446185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.449348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ab932fd3-e0ef-4ea3-988f-b599388f7658 req-397852d5-23b7-4ccc-8dbd-21beefa4a8ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.449805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ab932fd3-e0ef-4ea3-988f-b599388f7658 req-397852d5-23b7-4ccc-8dbd-21beefa4a8ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.455926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.465608 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ab932fd3-e0ef-4ea3-988f-b599388f7658 req-397852d5-23b7-4ccc-8dbd-21beefa4a8ba service nova] Creating event network-vif-plugged:061549ac-a3d6-4b74-9e58-6e99390adc84 for instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a on nch1-master-1 Apr 09 20:59:35.471384 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ab932fd3-e0ef-4ea3-988f-b599388f7658 req-397852d5-23b7-4ccc-8dbd-21beefa4a8ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Apr 09 20:59:35.472214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 708/1370] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:35.479821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.480830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.577948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.586308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.587801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.589072 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93c595b7-0829-4977-9c27-a775c4b56b90 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1284 microversion: 2.32 time: 0.115402 Apr 09 20:59:35.601209 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 709/1371] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:35.608291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c975b9b4-9bf2-44ca-96c0-851a21155e19 req-728f9334-171f-4d82-b7b2-a7ee4fdc83a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66be7a-97fe-4f7d-94fb-645e9b367f42", "name": "network-vif-deleted", "tag": "765d63be-a291-4796-9abd-dd6dc3afb689"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:35.619736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c975b9b4-9bf2-44ca-96c0-851a21155e19 req-728f9334-171f-4d82-b7b2-a7ee4fdc83a0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.620184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c975b9b4-9bf2-44ca-96c0-851a21155e19 req-728f9334-171f-4d82-b7b2-a7ee4fdc83a0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.633459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c975b9b4-9bf2-44ca-96c0-851a21155e19 req-728f9334-171f-4d82-b7b2-a7ee4fdc83a0 service nova] Creating event network-vif-deleted:765d63be-a291-4796-9abd-dd6dc3afb689 for instance de66be7a-97fe-4f7d-94fb-645e9b367f42 on nch2-master-1 Apr 09 20:59:35.639544 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c975b9b4-9bf2-44ca-96c0-851a21155e19 req-728f9334-171f-4d82-b7b2-a7ee4fdc83a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036931 Apr 09 20:59:35.640464 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 710/1372] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:35.645716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.646396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.648399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.656755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.657212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.657738 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e62461d-bdc7-4740-9e33-7d1bc7a1c64a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.227857 Apr 09 20:59:35.658063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.658547 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 663/1373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:35.659375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.670174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.671988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.684975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.686329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.687417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.688106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.703401 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad62c09f-b95a-4360-a5a8-ad57ba765bdd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061543 Apr 09 20:59:35.705173 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 711/1374] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:35.711252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.711878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.721852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.722297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.722779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:35.723085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.723572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.853082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7e81402-66b9-46ed-86e4-c0d5ee7a0e55 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 204 len: 0 microversion: 2.1 time: 0.192941 Apr 09 20:59:35.854336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 664/1375] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:35 2022] DELETE /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:35.868651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:35.869472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:35.881106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.883902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.885161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:35.886112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:35.913352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:35.922526 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-10175607-0b12-4879-b603-f07571837f9c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.216096 Apr 09 20:59:35.925491 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 712/1376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:36.038475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.040143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.047242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.048265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.049658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.050479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.061742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.070429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d198b4d-065b-4549-8a25-3abe831ffa51 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1472 microversion: 2.1 time: 0.207250 Apr 09 20:59:36.071565 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 665/1377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:35 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:36.104829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.105454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.111536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.112243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.113233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.113826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.265655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.277425 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-754b7e51-7cb8-406b-9807-a4564af378f3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.243246 Apr 09 20:59:36.287303 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 713/1378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:36.302500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.310545 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61f52dcc-1c52-426d-b35c-6ee6448a8553 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.209931 Apr 09 20:59:36.311052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 666/1379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:36.439118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.439118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.452054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.452943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.454783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.463117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.610248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.611289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.621801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.625379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.626478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.627165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.682249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.694471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a031928-d053-49cc-837d-3388731e92e5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.262331 Apr 09 20:59:36.696650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 714/1380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:36.704393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.704393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.726089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.727077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.727328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.727767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.782075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.793088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.795449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.796945 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-798685a8-c557-4b62-9f22-70c52b0c13c1 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1592 microversion: 2.32 time: 0.192518 Apr 09 20:59:36.798317 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 667/1381] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1592 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:59:36.803829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.805347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.813275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.813854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.815103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.815649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.850893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd43c297-007f-4cfc-9f44-2112a7036d2d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051359 Apr 09 20:59:36.855090 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 668/1382] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:36.903727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:36.912468 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d129995d-fd9d-48b3-b435-e938eb6bd94d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.215736 Apr 09 20:59:36.913220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 715/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:36.944024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:36.944912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:36.952246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.952695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:36.953716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:36.954159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.087951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:37.089286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:37.096242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.096944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.097912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.099125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.107880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:37.116634 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7da30ce-9ec5-4100-9064-5be876af6846 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.176598 Apr 09 20:59:37.126477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 669/1384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:36 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:37.131328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d604fb79-470d-4cc5-88e6-a68d9a19a125", "name": "network-vif-unplugged", "status": "completed", "tag": "1bc4d915-ee13-4ba8-922e-b46c28ad4602"}, {"name": "network-changed", "server_uuid": "bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a", "tag": "7082489d-c707-4f5b-a1d4-a0d36b4ae377"}, {"name": "network-changed", "server_uuid": "d604fb79-470d-4cc5-88e6-a68d9a19a125", "tag": "1bc4d915-ee13-4ba8-922e-b46c28ad4602"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:37.140516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.141242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.154243 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Creating event network-vif-unplugged:1bc4d915-ee13-4ba8-922e-b46c28ad4602 for instance d604fb79-470d-4cc5-88e6-a68d9a19a125 on nch1-master-1 Apr 09 20:59:37.154990 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Creating event network-changed:7082489d-c707-4f5b-a1d4-a0d36b4ae377 for instance bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a on nch1-master-1 Apr 09 20:59:37.155929 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] Creating event network-changed:1bc4d915-ee13-4ba8-922e-b46c28ad4602 for instance d604fb79-470d-4cc5-88e6-a68d9a19a125 on nch1-master-1 Apr 09 20:59:37.163284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-578558d5-3afd-4989-83b3-51703e9ef39a req-63176210-a808-49e5-bfab-82107a417248 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.035469 Apr 09 20:59:37.164610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 670/1385] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:37.267391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:37.275980 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03f68a80-9d06-46c0-89c9-405ff4243221 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1472 microversion: 2.1 time: 0.192103 Apr 09 20:59:37.285433 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 716/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:37 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:37.295445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:37.296306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:37.303196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.303651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.304435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.304875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.331568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:37.332412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:37.342176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.343485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.344498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.345274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.509973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:37.517896 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0ff1cd9-b4b6-4943-b384-2d62f07c9b0e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.226557 Apr 09 20:59:37.535495 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 671/1387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:37 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:37.589966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:37.599046 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-314f03f3-c17f-4d2c-af89-0880473f8529 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.273839 Apr 09 20:59:37.600266 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 717/1388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:37 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:37.712933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:37.713124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:37.719712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.720174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.721733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.722182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.816231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:37.817282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:37.823796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.830351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:37.831907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:37.832739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.004474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.016221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.018473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.020144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.021376 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1cb7efc9-d983-4f3a-a9f3-f3b935202819 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1592 microversion: 2.32 time: 0.209403 Apr 09 20:59:38.026160 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 718/1389] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:37 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1592 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 20:59:38.026674 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-01b61874-b8d1-4a4f-ab32-c123132e76b3 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.318402 Apr 09 20:59:38.037049 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 672/1390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:37 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:38.042508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.043323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.048528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.049828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.051422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.052054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.053602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.054874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.064805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.065304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.068982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.069740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.137925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f934a84f-05bd-41c2-bc7a-aba2f67799ec tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098678 Apr 09 20:59:38.141167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 719/1391] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:38.148536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.149449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.156429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.157095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.158067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.158705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.264360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.276879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-22820731-d8b9-4fc7-a287-e32acf47efe9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.238340 Apr 09 20:59:38.277560 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 673/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:38.287411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f5220aa7-d5c5-4e30-be33-ec439ee19b28 req-f2403d16-aaf5-45ed-b210-4d0169b23183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81535f89-50ee-497e-b085-84ab9630fee3", "name": "network-vif-plugged", "status": "completed", "tag": "d2b75502-aefa-4b5b-8bee-c8fc14cee225"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:38.308035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f5220aa7-d5c5-4e30-be33-ec439ee19b28 req-f2403d16-aaf5-45ed-b210-4d0169b23183 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.309004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f5220aa7-d5c5-4e30-be33-ec439ee19b28 req-f2403d16-aaf5-45ed-b210-4d0169b23183 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.323353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f5220aa7-d5c5-4e30-be33-ec439ee19b28 req-f2403d16-aaf5-45ed-b210-4d0169b23183 service nova] Creating event network-vif-plugged:d2b75502-aefa-4b5b-8bee-c8fc14cee225 for instance 81535f89-50ee-497e-b085-84ab9630fee3 on nch1-master-1 Apr 09 20:59:38.330004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f5220aa7-d5c5-4e30-be33-ec439ee19b28 req-f2403d16-aaf5-45ed-b210-4d0169b23183 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046087 Apr 09 20:59:38.330985 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 674/1393] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:38.338627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.341419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.342178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.348323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c33d4874-fb29-4a39-8ba3-73fa3d34e792 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.204837 Apr 09 20:59:38.349347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.350014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.350958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.351552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.358415 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 720/1394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:38.535096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.541166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.542012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.551416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1585229-0bcb-4f91-a210-5aa633576688 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1472 microversion: 2.1 time: 0.214128 Apr 09 20:59:38.557873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.558805 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 675/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:38.559432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.560518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.561145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.618563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:38.619353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:38.626189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.626616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.628419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:38.628419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:38.813227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.823427 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3c4be35-0de0-44fb-a818-86707a2ebf7c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.291048 Apr 09 20:59:38.824223 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 721/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:38.843417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:38.852923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9021b8ab-ebd1-426a-be6b-1fa4f64ae65a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.238511 Apr 09 20:59:38.854376 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 676/1397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:38 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:39.044057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.044720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.044813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.044891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.051528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.051909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.052076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.052563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.052717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.053197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.053618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.054257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.379808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.382974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.387289 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5aac1dd1-8074-4b7d-9768-af96c9e6935b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.347324 Apr 09 20:59:39.387955 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 722/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:39.392108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.392869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.393917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.394028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.395174 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-215dc7a9-1e7f-4ec5-bd7b-d9527dc34c8c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1707 microversion: 2.32 time: 0.355252 Apr 09 20:59:39.395897 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 677/1399] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1707 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:39.400265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.400435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6d759ae3-9f3d-4e3e-9599-82766e82671c req-a2c17e3a-7fb9-49ef-a733-cadca53cb2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c963ea0b-4eee-4241-a6d4-f49b42ec7c10", "tag": "1651bb82-70f9-47e7-a6c1-3044ad474d20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:39.400816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.401738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.402234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.408516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6d759ae3-9f3d-4e3e-9599-82766e82671c req-a2c17e3a-7fb9-49ef-a733-cadca53cb2aa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.408849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6d759ae3-9f3d-4e3e-9599-82766e82671c req-a2c17e3a-7fb9-49ef-a733-cadca53cb2aa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.419805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6d759ae3-9f3d-4e3e-9599-82766e82671c req-a2c17e3a-7fb9-49ef-a733-cadca53cb2aa service nova] Creating event network-changed:1651bb82-70f9-47e7-a6c1-3044ad474d20 for instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 on nch2-master-1 Apr 09 20:59:39.425815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6d759ae3-9f3d-4e3e-9599-82766e82671c req-a2c17e3a-7fb9-49ef-a733-cadca53cb2aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028798 Apr 09 20:59:39.426425 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 678/1400] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:39.431839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.432540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.432897 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1428bf3e-fb99-410f-bc20-dc66d0365b91 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.043835 Apr 09 20:59:39.436854 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 723/1401] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:39.438975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.438975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.449140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.449140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.449140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.449140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.454925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.455572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.456388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.457104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.885659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.893717 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5975314a-8380-45fc-9778-b6d2b11e9afa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.459201 Apr 09 20:59:39.894402 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 724/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:39.899369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.900557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.905586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:39.907580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.907982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.909056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.909499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.914875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d347400-bcce-44a7-b22a-efd788e05013 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.487122 Apr 09 20:59:39.916061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 679/1403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:39.928397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:39.929021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:39.936883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.937663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:39.938641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:39.939264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.492187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:40.500598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe23c811-7bb4-4949-8514-028a8b4a6940 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1472 microversion: 2.1 time: 0.605213 Apr 09 20:59:40.510379 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 725/1404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:40.515281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:40.515811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:40.515952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:40.523508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.523971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.524770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.525461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.526518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7e6d34a4-e3b1-43d3-8544-48eaadb942db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.609158 Apr 09 20:59:40.527591 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 680/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:39 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:40.533003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:40.534139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:40.543946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.544490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.545634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.546198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.829520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:40.839562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c917b00-b6a6-4f4f-8998-69ae3c25a1ea tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1322 microversion: 2.1 time: 0.328034 Apr 09 20:59:40.841150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:40.844026 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 726/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:40 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:40.849291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:40.849900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:40.858142 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8123e033-f17f-4a29-bee1-c6997fb61f80 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.328951 Apr 09 20:59:40.858419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.858869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.859238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 681/1407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:40 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:40.860090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.860668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.864154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:40.865256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:40.871346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.871795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.872630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.873083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.911798 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5aff8edc-3e4b-4c3d-920a-da5f24d269ab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051431 Apr 09 20:59:40.912616 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 682/1408] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:40 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:40.920906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-19ba25d3-0033-4207-91bd-a65a27bf5175 req-3400a2d3-41d4-4351-949e-bff4da76bd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831c8065-303b-4271-ac06-8ac2d0b5d248", "name": "network-vif-deleted", "tag": "71a75f60-0cc8-491d-b9f0-e42dc7c09b58"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:40.930511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-19ba25d3-0033-4207-91bd-a65a27bf5175 req-3400a2d3-41d4-4351-949e-bff4da76bd95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.930958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-19ba25d3-0033-4207-91bd-a65a27bf5175 req-3400a2d3-41d4-4351-949e-bff4da76bd95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.943314 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-19ba25d3-0033-4207-91bd-a65a27bf5175 req-3400a2d3-41d4-4351-949e-bff4da76bd95 service nova] Creating event network-vif-deleted:71a75f60-0cc8-491d-b9f0-e42dc7c09b58 for instance 831c8065-303b-4271-ac06-8ac2d0b5d248 on nch1-master-1 Apr 09 20:59:40.948844 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-19ba25d3-0033-4207-91bd-a65a27bf5175 req-3400a2d3-41d4-4351-949e-bff4da76bd95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031572 Apr 09 20:59:40.961992 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 683/1409] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:40.972953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:40.973876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:40.982305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.982815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:40.983834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:40.984330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.046879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.057710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.059315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.061026 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4043726-0e35-4b94-b0f8-f5d78b112258 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1707 microversion: 2.32 time: 0.215518 Apr 09 20:59:41.068907 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 727/1410] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:40 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1707 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:41.068907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:41.068907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:41.073219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.073783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.074560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.075051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.188110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.196495 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8387bd7b-ab3b-4259-bd20-341bca2a54fa tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1307 microversion: 2.1 time: 0.239106 Apr 09 20:59:41.196986 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 684/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:40 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:41.248355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.257833 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa0be99e-2253-4d5b-80c5-3a85856a4bdf tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.194888 Apr 09 20:59:41.258833 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 728/1412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:41 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:41.518084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:41.518790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:41.525987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.526441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.527226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.527657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.545336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:41.546067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:41.552237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.552758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.553633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.554133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.607477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.617314 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a34313f-e83b-43fc-8935-8adde0ea0bc2 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 200 len: 1301 microversion: 2.1 time: 0.103227 Apr 09 20:59:41.617917 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 685/1413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:41 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:41.710552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:41.719383 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af01b06e-4fba-43ae-a6ba-5381a9291790 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.178683 Apr 09 20:59:41.719975 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 729/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:41 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:41.861202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:41.861887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:41.868405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.868857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.869662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.870119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.875148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:41.875866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:41.882014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.882531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:41.883367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:41.883880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.063818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.070599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.071801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40c183fe-1170-4b6d-970c-3d6806b6c1c1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1472 microversion: 2.1 time: 0.214913 Apr 09 20:59:42.079005 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 686/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:41 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:42.079005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.079005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.079379 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5bdeac6a-4a80-4fed-a4fc-69ebd09f7fb5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.207485 Apr 09 20:59:42.079520 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 730/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:41 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:42.084214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.084401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.084668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.085436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.085568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.085897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.092432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.092887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.093759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.094199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.116628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6374564b-f4be-4b2d-99b9-4f74f35d8cc6 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.043156 Apr 09 20:59:42.119788 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 687/1417] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:42.232869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0375626-0728-40ff-8bd1-9e9f4afc6052 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:42.234002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0375626-0728-40ff-8bd1-9e9f4afc6052 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] [instance: 960a2568-e553-4fad-92f7-febe6c6d5802] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.241004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e0375626-0728-40ff-8bd1-9e9f4afc6052 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] HTTP exception thrown: Instance 960a2568-e553-4fad-92f7-febe6c6d5802 could not be found. Apr 09 20:59:42.242246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0375626-0728-40ff-8bd1-9e9f4afc6052 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Returning 404 to user: Instance 960a2568-e553-4fad-92f7-febe6c6d5802 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:59:42.243454 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0375626-0728-40ff-8bd1-9e9f4afc6052 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/960a2568-e553-4fad-92f7-febe6c6d5802/action" status: 404 len: 111 microversion: 2.1 time: 0.125212 Apr 09 20:59:42.244286 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 688/1418] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:59:42 2022] POST /compute/v2.1/servers/960a2568-e553-4fad-92f7-febe6c6d5802/action => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:42.256203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.261019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.261732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.271413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.271910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.275760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.275760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.282006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.286945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.290364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08d9147b-2916-4f09-a717-1ada08555b0a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1707 microversion: 2.32 time: 0.209513 Apr 09 20:59:42.295034 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 731/1419] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:42.304929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.306624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.319934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.320664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.332039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.332497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.530545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.543579 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-391d679f-c914-4a54-b52d-a313ac261172 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1486 microversion: 2.1 time: 0.286796 Apr 09 20:59:42.554742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 689/1420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1486 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:42.555102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:42.562699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1198920299", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:42.563765 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a554438-e175-430b-89e4-ae58758c9c3c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.267401 Apr 09 20:59:42.564755 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 732/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:42.569809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f45ebc4-159d-44b5-a159-e2d3a08403b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:42.577201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f45ebc4-159d-44b5-a159-e2d3a08403b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.577583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f45ebc4-159d-44b5-a159-e2d3a08403b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.623592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:42.650235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f45ebc4-159d-44b5-a159-e2d3a08403b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Going to try to stop instance {{(pid=141818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 20:59:42.708362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f45ebc4-159d-44b5-a159-e2d3a08403b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a/action" status: 202 len: 0 microversion: 2.1 time: 0.142127 Apr 09 20:59:42.714010 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 733/1422] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 20:59:42 2022] POST /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 20:59:42.723659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c492f48e-ec19-4f33-ab7a-6015ba147fbc req-1184224e-0d60-4d16-911e-861950530b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d480013b-9c5d-4c86-9553-0be0c4abf76f", "name": "network-vif-plugged", "status": "completed", "tag": "7e43c995-4690-4a85-93bc-a540cbd5e329"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:42.765934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c492f48e-ec19-4f33-ab7a-6015ba147fbc req-1184224e-0d60-4d16-911e-861950530b68 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.767586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c492f48e-ec19-4f33-ab7a-6015ba147fbc req-1184224e-0d60-4d16-911e-861950530b68 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.796464 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c492f48e-ec19-4f33-ab7a-6015ba147fbc req-1184224e-0d60-4d16-911e-861950530b68 service nova] Creating event network-vif-plugged:7e43c995-4690-4a85-93bc-a540cbd5e329 for instance d480013b-9c5d-4c86-9553-0be0c4abf76f on nch1-master-1 Apr 09 20:59:42.801718 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c492f48e-ec19-4f33-ab7a-6015ba147fbc req-1184224e-0d60-4d16-911e-861950530b68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086061 Apr 09 20:59:42.802638 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 734/1423] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:42.807964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.808674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 831c8065-303b-4271-ac06-8ac2d0b5d248] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.815567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.816023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.816810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.817282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.831697 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance 831c8065-303b-4271-ac06-8ac2d0b5d248 could not be found. Apr 09 20:59:42.832239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance 831c8065-303b-4271-ac06-8ac2d0b5d248 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:59:42.833104 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-489d7f67-1dfb-4d89-82d3-fa42eb542cef tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248" status: 404 len: 111 microversion: 2.1 time: 0.029378 Apr 09 20:59:42.833851 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 735/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/831c8065-303b-4271-ac06-8ac2d0b5d248 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:42.841310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.841942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.847938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.848384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.849200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.849638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.862984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:42.863480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:42.864020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:42.864661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:42.865210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:42.876449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.877560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.878760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.879454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.900158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Getting quotas for project 23df4eef46ae4894870e050990d597f0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:42.904708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Getting quotas for user 16441a7999c149ff9dd66e0b3a3a95b4 and project 23df4eef46ae4894870e050990d597f0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:42.918840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:42.921170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:42.970819 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e522bc7-d696-4e52-98b3-2f4869fa8e87 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424605 Apr 09 20:59:42.971553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 690/1425] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 20:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 20:59:42.977086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:42.977943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:42.985144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.986071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.987112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:42.987712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:42.998531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.015779 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f1e7ee64-5d36-4d47-9275-e7215c9fe3e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.178075 Apr 09 20:59:43.032378 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 736/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.037631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.038694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.045532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.046079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.046936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.047466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.077420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:43.198250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-adada6cc-ff53-4c59-97e4-fc6e220141f0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 204 len: 0 microversion: 2.1 time: 0.164260 Apr 09 20:59:43.199615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 737/1427] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:43 2022] DELETE /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:43.208250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06c3524d-963e-4640-ac36-cc57a2682cce tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.209314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06c3524d-963e-4640-ac36-cc57a2682cce tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.288514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.289371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06c3524d-963e-4640-ac36-cc57a2682cce tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.296421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9bf3d547-d229-4962-82c2-b00341d6c33a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.323524 Apr 09 20:59:43.296999 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 691/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:42 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.301906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.304097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.306492 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06c3524d-963e-4640-ac36-cc57a2682cce tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1222 microversion: 2.1 time: 0.095609 Apr 09 20:59:43.307543 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 738/1429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.311186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.311701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.312606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.313166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.314296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.315498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.325001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.325808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.326800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.327543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.362824 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01f4d5df-16e9-47e1-b3b7-2baf5867b0db tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053944 Apr 09 20:59:43.364115 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 739/1430] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:43.369246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.370200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.376562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.377385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.378584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.379259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.515555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.523450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3a73725-6496-441f-bb8f-3a559c8a2078 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.225235 Apr 09 20:59:43.527929 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 692/1431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.532922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.533907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.541661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.542120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.542934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.543374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.548391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.556306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eaaed0aa-3a48-46fe-8fcc-062339ad3e4f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1472 microversion: 2.1 time: 0.190903 Apr 09 20:59:43.556963 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 740/1432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.580538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:43.581328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:43.590043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.590635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.591687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:43.592259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:43.933927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.943242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c0fc65b-56ef-4ff0-a93d-798d1e9465de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.367244 Apr 09 20:59:43.945099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 741/1433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:43.974498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.983813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.985399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:43.986595 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e1d2c2b-5e3b-4f5c-95d6-202eb2595c9a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1707 microversion: 2.32 time: 0.457608 Apr 09 20:59:43.987153 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 693/1434] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:43 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1707 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:44.039040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.039686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.045659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.046105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.046871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.047303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.179848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:44.187519 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a6d210ea-688d-4132-8970-c6775dd20a8e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.152646 Apr 09 20:59:44.188422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 742/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:44.325691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.327946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.330379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.331379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.345804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.347426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.348099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.348790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.349883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.350327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.352905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.353729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.464036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:44.472887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cdb6d352-f277-42a2-95d4-22505cd99338 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1274 microversion: 2.1 time: 0.152754 Apr 09 20:59:44.473536 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 743/1436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:44.484896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.486285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.493077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.493544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.494610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.495122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.528184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c09de39b-d228-4b10-8bee-1466841ebaea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.047326 Apr 09 20:59:44.528997 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 744/1437] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 20:59:44.532714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:44.540375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.541059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.542244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89d0d08e-ee48-4528-89c5-76c5c9256f35 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.232362 Apr 09 20:59:44.542894 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 694/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:44.547610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.548063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.548887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.549351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.572591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.573373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.579691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.580324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.581209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.581706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.738501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:44.770928 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90dc5f98-f9f7-42a6-a2fa-951a39bacf0a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1323 microversion: 2.1 time: 0.234613 Apr 09 20:59:44.774426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 745/1439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:44.789744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:44.801425 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6fbbd997-5583-47d3-a4cc-6f9111f872f7 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1472 microversion: 2.1 time: 0.231390 Apr 09 20:59:44.811185 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 695/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:44.817990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a40e7675-3a6a-44ee-9918-0d44cf5a56ad req-acea4369-45f6-4c5b-bb82-24a14d9c0fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a", "name": "network-vif-plugged", "status": "completed", "tag": "7082489d-c707-4f5b-a1d4-a0d36b4ae377"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:44.833383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a40e7675-3a6a-44ee-9918-0d44cf5a56ad req-acea4369-45f6-4c5b-bb82-24a14d9c0fd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.834240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a40e7675-3a6a-44ee-9918-0d44cf5a56ad req-acea4369-45f6-4c5b-bb82-24a14d9c0fd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.848259 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a40e7675-3a6a-44ee-9918-0d44cf5a56ad req-acea4369-45f6-4c5b-bb82-24a14d9c0fd6 service nova] Creating event network-vif-plugged:7082489d-c707-4f5b-a1d4-a0d36b4ae377 for instance bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a on nch1-master-1 Apr 09 20:59:44.854562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a40e7675-3a6a-44ee-9918-0d44cf5a56ad req-acea4369-45f6-4c5b-bb82-24a14d9c0fd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041242 Apr 09 20:59:44.855709 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 746/1441] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 20:59:44.960781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:44.961448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:44.974580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.975041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:44.975857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:44.976299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.007361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.008271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:45.016943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.017485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.019680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.020129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.488762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.502776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.510576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d296f710-9595-4085-9269-7a7f9f0f3ef2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.553736 Apr 09 20:59:45.511191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 696/1442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:44 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:45.514236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.519773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.526378 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c4fd1e1b-589a-4f40-97e0-7e638a5e6bad tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1754 microversion: 2.32 time: 0.524319 Apr 09 20:59:45.529705 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 747/1443] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1754 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:45.534241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.535095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:45.544943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.548328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:45.555062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.555686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.556337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.556784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.565589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.568209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.569876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.572926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.764779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.794628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a5ef392-fd75-4d47-b959-05be2198cebd tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1280 microversion: 2.1 time: 0.262012 Apr 09 20:59:45.797546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 748/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1280 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:45.812159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.815787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:45.827446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.827920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.828755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.829255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.878778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dad4a2ca-a1b7-4707-bb5e-8aca129d3a25 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.080083 Apr 09 20:59:45.879698 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 749/1445] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:45.895198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.897208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:45.916212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.917203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.918211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:45.918816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:45.967715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:45.982354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56584e80-c4da-4ec5-aa32-7764323b6505 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.452114 Apr 09 20:59:45.993147 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 697/1446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:45.998342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:45.999229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:46.006474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.007210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:46.008159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.008745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:46.609619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:46.629288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:46.633736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a32eff8-ee5f-40db-b7ef-226639571621 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1517 microversion: 2.1 time: 0.638271 Apr 09 20:59:46.645762 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 698/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1517 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:46.647460 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b889cedf-9b7e-47e0-8bbf-580953cd5e41 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.766699 Apr 09 20:59:46.650694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:46.651319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:46.656981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 750/1448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:45 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:46.662194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:46.663091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:46.691645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.692494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:46.692651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.693140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:46.693855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.694038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:46.694487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:46.694774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.447999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:47.461261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0b6ee1ab-31a5-4027-950d-79b289923289 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.802048 Apr 09 20:59:47.473896 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 751/1449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:46 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:47.485696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:47.486374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:47.493481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.493966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.494781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.495316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.543995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:47.560822 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c63fccc-1cec-484b-9db0-3d70b098652d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 200 len: 1472 microversion: 2.1 time: 0.913851 Apr 09 20:59:47.561755 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 699/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:46 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 1472 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:47.576347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:47.576889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:47.593068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.593517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.595981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.596622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.905918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:47.920827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:47.925397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:47.926799 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2605775d-ee79-4ac7-922e-f88c40e36e36 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1836 microversion: 2.32 time: 0.451830 Apr 09 20:59:47.931969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 752/1451] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:47 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1836 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:47.941334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:47.942928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:47.950183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.951197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:47.952320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:47.952905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.231273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:48.248223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eea7c074-f43a-4c65-be56-9c19a9659e64 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1516 microversion: 2.1 time: 0.684094 Apr 09 20:59:48.261696 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 700/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:47 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1516 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:48.270999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:48.275999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:48.293653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:48.294384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.295491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:48.296174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.647046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:48.657992 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-618dfbf5-3a4a-420f-b08b-2af1256d7afa tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.721929 Apr 09 20:59:48.659743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 753/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:47 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:48.673375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:48.674072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:48.691699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:48.695337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.696848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:48.697333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.908215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:48.919459 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8431490d-1cd1-4121-8b24-1181f745433c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.652234 Apr 09 20:59:48.920103 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 701/1454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:48 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:48.924744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f9976046-78f5-44f4-94a5-5e837062e564 req-336b4cbb-fab0-41ed-8237-192da0b9a3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c0339f-48c4-473d-93ae-db67c877fb5e", "name": "network-vif-deleted", "tag": "754b37cf-8904-48a6-9835-7135d3f52459"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:48.951616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f9976046-78f5-44f4-94a5-5e837062e564 req-336b4cbb-fab0-41ed-8237-192da0b9a3fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:48.952454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f9976046-78f5-44f4-94a5-5e837062e564 req-336b4cbb-fab0-41ed-8237-192da0b9a3fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:48.979568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f9976046-78f5-44f4-94a5-5e837062e564 req-336b4cbb-fab0-41ed-8237-192da0b9a3fc service nova] Creating event network-vif-deleted:754b37cf-8904-48a6-9835-7135d3f52459 for instance e5c0339f-48c4-473d-93ae-db67c877fb5e on nch2-master-1 Apr 09 20:59:48.988172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f9976046-78f5-44f4-94a5-5e837062e564 req-336b4cbb-fab0-41ed-8237-192da0b9a3fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066883 Apr 09 20:59:48.988780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 702/1455] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:48.996077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6354aa3a-e144-4ca6-bf30-ae0cec990232 req-a76d2375-3b24-4fbd-93e0-d7472566af8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c963ea0b-4eee-4241-a6d4-f49b42ec7c10", "name": "network-vif-plugged", "status": "completed", "tag": "1651bb82-70f9-47e7-a6c1-3044ad474d20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:49.005252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6354aa3a-e144-4ca6-bf30-ae0cec990232 req-a76d2375-3b24-4fbd-93e0-d7472566af8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.005793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6354aa3a-e144-4ca6-bf30-ae0cec990232 req-a76d2375-3b24-4fbd-93e0-d7472566af8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.018463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6354aa3a-e144-4ca6-bf30-ae0cec990232 req-a76d2375-3b24-4fbd-93e0-d7472566af8f service nova] Creating event network-vif-plugged:1651bb82-70f9-47e7-a6c1-3044ad474d20 for instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 on nch2-master-1 Apr 09 20:59:49.024550 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6354aa3a-e144-4ca6-bf30-ae0cec990232 req-a76d2375-3b24-4fbd-93e0-d7472566af8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034057 Apr 09 20:59:49.026354 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 703/1456] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:49.033198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:49.034243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:49.041423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.042197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.043096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.043914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.052882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.065944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b122fb7-e3cb-47c5-8176-09100b7eaef2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.403642 Apr 09 20:59:49.067410 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 754/1457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:48 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:49.075031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:49.077111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:49.090528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.093449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.094789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.095380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.414272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.425231 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f126885-c7c2-47d5-b651-dd4faece371c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.397132 Apr 09 20:59:49.444669 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 704/1458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:49 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:49.451489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:49.452777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: e5c0339f-48c4-473d-93ae-db67c877fb5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:49.462131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.463425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.464719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.465451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.466177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.481078 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance e5c0339f-48c4-473d-93ae-db67c877fb5e could not be found. Apr 09 20:59:49.482083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance e5c0339f-48c4-473d-93ae-db67c877fb5e could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:59:49.483139 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48f981db-7ab2-4a6f-a378-756f95b73016 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e" status: 404 len: 111 microversion: 2.1 time: 0.036699 Apr 09 20:59:49.484249 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 705/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:49 2022] GET /compute/v2.1/servers/e5c0339f-48c4-473d-93ae-db67c877fb5e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:49.489203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-96059451-44d2-4bcd-8816-cc879965f104 req-eb35b8b0-37bc-4482-9b64-1e68cdf6bc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "2447064d-f2f6-4455-bc1d-f66ad73dad67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:49.499104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-96059451-44d2-4bcd-8816-cc879965f104 req-eb35b8b0-37bc-4482-9b64-1e68cdf6bc90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.499924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-96059451-44d2-4bcd-8816-cc879965f104 req-eb35b8b0-37bc-4482-9b64-1e68cdf6bc90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.505529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8508bc2-9059-48f0-8a9e-b4896633e9eb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.436095 Apr 09 20:59:49.508457 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 755/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:49 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:49.519461 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-96059451-44d2-4bcd-8816-cc879965f104 req-eb35b8b0-37bc-4482-9b64-1e68cdf6bc90 service nova] Creating event network-changed:2447064d-f2f6-4455-bc1d-f66ad73dad67 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:49.527310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-96059451-44d2-4bcd-8816-cc879965f104 req-eb35b8b0-37bc-4482-9b64-1e68cdf6bc90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041086 Apr 09 20:59:49.530046 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 706/1461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:49.530168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:49.531034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:49.541945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1735383613", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6f2c6748-eb93-475b-8e01-8a36bd1222c2"}], "block_device_mapping_v2": [{"uuid": "39d7897e-1a3d-4d30-842e-25f6d0315f17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:49.548717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.549254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.550078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.550526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.623111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] validate_networks() for [('6f2c6748-eb93-475b-8e01-8a36bd1222c2', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 20:59:49.934139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.946383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.949569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:49.950770 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-62cf1630-4a90-4f76-a50d-5939ccad51be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1857 microversion: 2.32 time: 0.441290 Apr 09 20:59:49.951363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 756/1462] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:49 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1857 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:49.966428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:49.966925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:49.972981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.973475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:49.974258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:49.974695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.001337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:50.104843 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b2da10a-0d13-4b49-afc9-5655c1b2a14f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 204 len: 0 microversion: 2.1 time: 0.141816 Apr 09 20:59:50.105589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 757/1463] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:49 2022] DELETE /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:50.111140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:50.112247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:50.118830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.119557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.120565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.121007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.405613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 20:59:50.406042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 20:59:50.406546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 20:59:50.406964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 20:59:50.407380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 20:59:50.412422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:50.418366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.418927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.419640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.420084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.422457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-561af62c-c1cf-47c8-b6ca-0bef6d66927d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.315485 Apr 09 20:59:50.423307 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 758/1464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:50 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:50.428194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:50.429022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:50.444223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.444872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.445903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.450936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 20:59:50.455030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.455894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Getting quotas for user 9c775742dfc04cec8559f9e4d13239b0 and project 2c23a8d6534a4426b2ea106417c8b68a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 20:59:50.519512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 20:59:50.521779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39d7897e-1a3d-4d30-842e-25f6d0315f17',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 20:59:50.667648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:50.676090 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d57db520-94d9-4bd1-b0b7-fedb327ad30f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.251497 Apr 09 20:59:50.677498 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 759/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:50 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:50.682710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:50.683532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:50.690446 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.158715 Apr 09 20:59:50.692697 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 707/1466] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 20:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 20:59:50.700562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.701022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.701850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.702826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.706637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:50.707264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:50.738133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.741382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.741933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:50.742408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:50.983396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:50.996066 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-421a1f9b-4aeb-4748-af09-050f3a17b7c5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.317230 Apr 09 20:59:50.998628 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 760/1467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:50 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:51.013820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.014691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.031340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.032706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.033688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.033857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.035408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.046159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-461d89e6-c119-457a-a372-32f83a1e4ebe tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1472 microversion: 2.1 time: 0.352275 Apr 09 20:59:51.046766 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 708/1468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:50 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:51.051497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.052353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.065503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.066094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.066893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.067323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.227674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.237485 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1c7c09c-4eb7-4688-9da9-45681ac4248e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.233567 Apr 09 20:59:51.238695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 761/1469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:50 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:51.243972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.250347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.256915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.261060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.261954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.262412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.278210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.286995 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a77acf25-964d-4809-ba25-5fc869c1f496 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.239174 Apr 09 20:59:51.287502 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 709/1470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:51 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:51.292463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.293163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.299121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.299566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.300343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.300792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.324030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.332581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.334235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.335438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5f9844b-671b-43e8-bcf1-408dc0ebcca8 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1185 microversion: 2.25 time: 0.095521 Apr 09 20:59:51.336078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 762/1471] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:51 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:51.354176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-69c97aba-2f9b-4750-a69f-e65155b02f10 req-46ca1be8-2021-40ae-b214-03d5f048715c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e71eab-8630-4e09-b286-3de7e1562dd7", "tag": "9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:51.362473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-69c97aba-2f9b-4750-a69f-e65155b02f10 req-46ca1be8-2021-40ae-b214-03d5f048715c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.362913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-69c97aba-2f9b-4750-a69f-e65155b02f10 req-46ca1be8-2021-40ae-b214-03d5f048715c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.375297 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-69c97aba-2f9b-4750-a69f-e65155b02f10 req-46ca1be8-2021-40ae-b214-03d5f048715c service nova] Creating event network-changed:9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9 for instance 81e71eab-8630-4e09-b286-3de7e1562dd7 on nch1-master-1 Apr 09 20:59:51.380598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-69c97aba-2f9b-4750-a69f-e65155b02f10 req-46ca1be8-2021-40ae-b214-03d5f048715c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043220 Apr 09 20:59:51.381230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 763/1472] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:51.439604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.440650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.447475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.447933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.448747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.449217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.536703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.546666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.547982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.549302 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-530c0be3-439d-4ae1-a29d-12908af57642 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.260645 Apr 09 20:59:51.552132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 710/1473] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:51 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:51.556793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "4d183039-0082-437f-a23a-644fd46b056d"}, {"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "edac2419-450b-406e-b5db-84cf807a3c10"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:51.565858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.566301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.577217 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] Creating event network-changed:4d183039-0082-437f-a23a-644fd46b056d for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:51.577813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] Creating event network-changed:edac2419-450b-406e-b5db-84cf807a3c10 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:51.582970 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9ed5eef5-6abd-4f0b-b5d9-8ec726e146dd req-40276699-8f79-4a45-93c9-70b3ad0ac5fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029524 Apr 09 20:59:51.583569 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 711/1474] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:51.603566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.611168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb5f1790-82cf-4cb6-833d-a9d6b3de01f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.176033 Apr 09 20:59:51.611732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 764/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:51 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:51.694556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:51.695253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:51.702011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.702461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.703240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:51.703678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:51.838766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:51.846969 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4fbfde7-21b4-4345-a15d-9315cd55e625 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.156779 Apr 09 20:59:51.847547 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 712/1476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:51 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:52.015809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.016429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.023801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.024258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.025060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.025526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.063547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.064303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.071190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.071632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.072420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.072862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.204368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.212552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e49046e8-5e81-4c70-a5d7-9187cb3c8d6b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.200955 Apr 09 20:59:52.213237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 765/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:52.231918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.240806 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb7b7a0d-6b10-42b1-8b39-02a5274d5c3b tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1472 microversion: 2.1 time: 0.181382 Apr 09 20:59:52.241421 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 713/1478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:52.254615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.255235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.261455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.261914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.262689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.263129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.303720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.304350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.310478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.310920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.311720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.312152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.443748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.451472 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0d746fc-b395-46cf-8d5e-08894a02452a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.200660 Apr 09 20:59:52.454095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 766/1479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 20:59:52.457985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.458562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.465285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.465742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.466569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.467010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.475928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.483625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43dd90fe-cdc7-408e-97e6-a31f7a7db4fc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.183782 Apr 09 20:59:52.484170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 714/1480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:52.535103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.543029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.544546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.545651 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-25febaf4-7c0d-468a-bfd1-0ff473d05053 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1185 microversion: 2.25 time: 0.092685 Apr 09 20:59:52.546225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 767/1481] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:52.567780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.568395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.574593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.575049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.575827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.576269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.628384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.629021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.635122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.635579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.636361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.636806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.925299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.934300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.935810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.936980 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e92801b-ffc0-43e1-8904-ae5ea0bae55a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.373204 Apr 09 20:59:52.937768 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 715/1482] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:52.938917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:52.947510 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2923487-cec0-46ce-a7c1-026f4624f7a1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.323303 Apr 09 20:59:52.948098 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 768/1483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:52.952923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:52.953575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:52.959713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.960167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:52.960943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:52.961407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.231175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:53.232891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:53.243425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.243880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.244884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.245359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.646427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:53.656245 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7412c80b-39f7-4fbc-a4fe-a49b9e0b76a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.706778 Apr 09 20:59:53.667621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 716/1484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:52 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:53.672923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:53.673633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:53.680587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.681661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.682457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.682896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.704000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:53.711987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85f0a444-cf3b-4811-8b99-9a3da4a4b4cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.485507 Apr 09 20:59:53.712550 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 769/1485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:53 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:53.726571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:53.727274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:53.734037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.734555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:53.735399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:53.736011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.081409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.085885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.090244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-260bc4a4-15d0-427d-b208-09ab60ed7eec tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1472 microversion: 2.1 time: 0.421182 Apr 09 20:59:54.090919 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 717/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:53 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:54.095690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.096351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.102283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.103308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.104153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.104774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.105430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d5464b7-c01f-4324-b307-61091f79ab53 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.382476 Apr 09 20:59:54.112914 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 770/1487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:53 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:54.117890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.118666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.125283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.126002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.126843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.127262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.218389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.226674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.228519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.229899 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-67478996-df74-4f47-8868-ad01123d3289 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1233 microversion: 2.25 time: 0.115739 Apr 09 20:59:54.240718 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 771/1488] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1233 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:54.240718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.240718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.245630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.246114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.246905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.247343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.401499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.409429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4228cc5-651a-4982-8b5a-0273ddb3ec43 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.317234 Apr 09 20:59:54.422227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 718/1489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:54.427373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.428145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.444788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.445473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.446501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.446876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.788919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.806728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.810578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.811910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6452b892-8c40-4594-b25e-235631da98b2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.580162 Apr 09 20:59:54.826330 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 772/1490] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:54.839908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.841811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:54.843631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.850545 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e42d07c-ef3e-45c7-b1ff-c1918592f484 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.426978 Apr 09 20:59:54.854564 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 719/1491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:54.866520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:54.870798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:54.872254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.872709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.873531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.874165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.880275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.881094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:54.882133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:54.882786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.250905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:55.258937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8bf17404-60a0-45ce-b852-f36d31c23ba1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.403090 Apr 09 20:59:55.268929 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 720/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:55.268929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:55.268929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:55.289734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.291631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.292816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.293552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.351236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:55.362479 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b369ddbb-4915-49fd-ab94-90f7bff373e1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.534297 Apr 09 20:59:55.364586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 773/1493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:54 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:55.373680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:55.375717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:55.384170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.384729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.385645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.387101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.719467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:55.732671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8cff9b43-8553-45ed-9a1d-08526857219d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 200 len: 1472 microversion: 2.1 time: 0.471609 Apr 09 20:59:55.759524 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 721/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:55 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:55.776075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-14c452da-2113-4685-9ba2-0ef698ed7ade req-01876faa-01e3-4939-b414-7798a93308cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "aeadbd1f-8d76-4ad3-84a7-50139f5852c5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:55.815299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-14c452da-2113-4685-9ba2-0ef698ed7ade req-01876faa-01e3-4939-b414-7798a93308cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.815804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-14c452da-2113-4685-9ba2-0ef698ed7ade req-01876faa-01e3-4939-b414-7798a93308cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.832138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-14c452da-2113-4685-9ba2-0ef698ed7ade req-01876faa-01e3-4939-b414-7798a93308cb service nova] Creating event network-changed:aeadbd1f-8d76-4ad3-84a7-50139f5852c5 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:55.844061 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-14c452da-2113-4685-9ba2-0ef698ed7ade req-01876faa-01e3-4939-b414-7798a93308cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082551 Apr 09 20:59:55.845392 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 722/1495] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:55.858888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:55.859609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:55.872840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:55.874300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.874740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.878153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.878627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.887690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12f6044e-8bec-4696-9e9c-f285a8d32a46 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.521443 Apr 09 20:59:55.888745 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 774/1496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:55 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:55.899745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:55.901446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:55.908736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.910217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:55.914408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:55.916529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.051117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.066872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.071105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.072788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9437c5c5-4d95-48b2-a9bf-18b249c3f96c tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1251 microversion: 2.25 time: 0.224846 Apr 09 20:59:56.075106 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 723/1497] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:55 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1251 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:56.082218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:56.083099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:56.093089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.095243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.096306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.099556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.337102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.376643 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fda53927-b84f-441e-bc3b-913488d955de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.477245 Apr 09 20:59:56.380370 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 775/1498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:55 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:56.393657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:56.396930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:56.414645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.415522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.418916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.420835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.699003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.717441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.721511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.723257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b308822-05cf-4db5-b3a0-a07739b730fb tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.646918 Apr 09 20:59:56.738223 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 724/1499] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:56 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:56.745572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:56.746170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:56.766236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.766715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.774796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.775299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.803432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:56.818921 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9fb337f0-a744-4f52-866f-05f0ecb5db6a tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.433348 Apr 09 20:59:56.828784 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 776/1500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:56 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:56.844792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:56.845535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:56.874148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.874677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:56.879600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:56.880342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.166726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.175075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5193a083-5ed7-42c3-a58f-ae11213280d6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1504 microversion: 2.1 time: 0.435916 Apr 09 20:59:57.176103 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 725/1501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:56 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:57.182420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a3b7f436-8889-42ee-8638-4409d9b77f95 req-c429d83b-0a01-4469-8e82-1b775caf7675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e71eab-8630-4e09-b286-3de7e1562dd7", "name": "network-vif-plugged", "status": "completed", "tag": "9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:57.192110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a3b7f436-8889-42ee-8638-4409d9b77f95 req-c429d83b-0a01-4469-8e82-1b775caf7675 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.192908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a3b7f436-8889-42ee-8638-4409d9b77f95 req-c429d83b-0a01-4469-8e82-1b775caf7675 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.206091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a3b7f436-8889-42ee-8638-4409d9b77f95 req-c429d83b-0a01-4469-8e82-1b775caf7675 service nova] Creating event network-vif-plugged:9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9 for instance 81e71eab-8630-4e09-b286-3de7e1562dd7 on nch1-master-1 Apr 09 20:59:57.212550 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a3b7f436-8889-42ee-8638-4409d9b77f95 req-c429d83b-0a01-4469-8e82-1b775caf7675 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Apr 09 20:59:57.213518 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 726/1502] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:57.220447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.221678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: b3b1c719-b621-4ea4-a81a-06a089ad7a11] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.229466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.229928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.232020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.232698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.234270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.253839 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-908f1f95-b934-49c4-ae00-2657bb81b646 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.417823 Apr 09 20:59:57.256860 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 777/1503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:56 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:57.258599 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance b3b1c719-b621-4ea4-a81a-06a089ad7a11 could not be found. Apr 09 20:59:57.259405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance b3b1c719-b621-4ea4-a81a-06a089ad7a11 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 20:59:57.260478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b251e25-9377-44de-8afe-8678b40ed729 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11" status: 404 len: 111 microversion: 2.1 time: 0.045503 Apr 09 20:59:57.265468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 727/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/b3b1c719-b621-4ea4-a81a-06a089ad7a11 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 20:59:57.273196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.275147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.277117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.277751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.283540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.284357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.285964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.286660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.289497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.290014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.290812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.291447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.600141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.603437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.613159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fa5d2f6-f2b7-4bc8-bccd-f2caec7727b4 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1323 microversion: 2.1 time: 0.347601 Apr 09 20:59:57.615067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.617964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.622736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3952923a-216c-4b54-9d1a-5550b507c6cc tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.355438 Apr 09 20:59:57.623256 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 778/1505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:57.634315 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 728/1506] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:57.635657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.637526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.638400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.641912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.651415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.653485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.655134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.655294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.657093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.657500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.658450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.661452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.688796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:57.848238 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7917349a-97b7-478b-8a6c-b30b1b6b4b57 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 204 len: 0 microversion: 2.1 time: 0.223536 Apr 09 20:59:57.851848 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 779/1507] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:57 2022] DELETE /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:57.857055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.858357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.864777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.865413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.866338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.866775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.915588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:57.923754 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52e24cab-2990-4a34-83c6-05e2dec6ee7c tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.292297 Apr 09 20:59:57.925243 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 729/1508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:57.931972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:57.932675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:57.940577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.941287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:57.942349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:57.942977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.135226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.145710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.147680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.151778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.156835 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8334ac95-0032-4ecb-b9e9-b0a2103b2c44 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.306748 Apr 09 20:59:58.157917 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 780/1509] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:58.162854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.163278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.173428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.174209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.175158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.175627 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14085fcc-01ae-4c06-a9ac-0f8ef9b10645 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.247528 Apr 09 20:59:58.176122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.176961 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 730/1510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:57 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.193389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b1c719-b621-4ea4-a81a-06a089ad7a11", "name": "network-vif-deleted", "tag": "2907881a-378f-4e16-ba12-6884a79f972c"}, {"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "98efa2b7-5e44-4da7-8cbc-fbc1db0c459e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:58.208761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.209698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.219725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:58.234333 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] Creating event network-vif-deleted:2907881a-378f-4e16-ba12-6884a79f972c for instance b3b1c719-b621-4ea4-a81a-06a089ad7a11 on nch2-master-1 Apr 09 20:59:58.234878 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] Creating event network-changed:98efa2b7-5e44-4da7-8cbc-fbc1db0c459e for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:58.243194 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c2a9806c-f6ab-4192-8299-a27e94582fee req-3e2e4546-5e19-4499-a40e-3e473e267a6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055890 Apr 09 20:59:58.244643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 731/1511] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:58.252343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.253438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.261577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.262396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.263428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.265587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.342911 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90da1d5d-2023-40a7-b149-c5eb17251e2d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 204 len: 0 microversion: 2.1 time: 0.183350 Apr 09 20:59:58.347517 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 781/1512] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:58 2022] DELETE /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:58.354816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.356040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.362469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.362923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.363715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.364419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.440618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.454713 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a601b33e-7426-43c8-b695-abf57b918f78 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1479 microversion: 2.1 time: 0.208508 Apr 09 20:59:58.456884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 732/1513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1479 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.470556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.471184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.478197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.479270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.480563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.481210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.667583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.679269 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ffc4c65-ec5c-488d-9f2a-ce067c9aff20 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.329759 Apr 09 20:59:58.679651 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 782/1514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.693803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f3c43d1-60fd-4339-adf2-6bb51a1ff506 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '.version_select at 0x7fb08eb3e5e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.696532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f3c43d1-60fd-4339-adf2-6bb51a1ff506 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.696841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f3c43d1-60fd-4339-adf2-6bb51a1ff506 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.711323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.718606 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f3c43d1-60fd-4339-adf2-6bb51a1ff506 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3113 microversion: 2.1 time: 0.028581 Apr 09 20:59:58.719264 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 783/1515] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/os-migrations => generated 3113 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.723897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9708a5af-1e89-498a-a89c-3e4fa04fca4b req-fe222235-f109-40d0-9241-01bcc477d561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "87ea195a-9ea5-4807-8aeb-44650ead0f55"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 20:59:58.725813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-349e11e3-4de1-485a-9009-42753568135c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1474 microversion: 2.1 time: 0.267703 Apr 09 20:59:58.726476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 733/1516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.731859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.732486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.738090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9708a5af-1e89-498a-a89c-3e4fa04fca4b req-fe222235-f109-40d0-9241-01bcc477d561 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.738541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9708a5af-1e89-498a-a89c-3e4fa04fca4b req-fe222235-f109-40d0-9241-01bcc477d561 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.738649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.739079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.739852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.740315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.749966 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9708a5af-1e89-498a-a89c-3e4fa04fca4b req-fe222235-f109-40d0-9241-01bcc477d561 service nova] Creating event network-changed:87ea195a-9ea5-4807-8aeb-44650ead0f55 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 20:59:58.756160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9708a5af-1e89-498a-a89c-3e4fa04fca4b req-fe222235-f109-40d0-9241-01bcc477d561 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Apr 09 20:59:58.759845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 784/1517] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 20:59:58.765456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.766167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.773024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.773480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.774280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.774725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.949134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.958048 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-01f6958a-131b-4bb2-b1e5-cb25c16db5ea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1517 microversion: 2.1 time: 0.230326 Apr 09 20:59:58.959872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 734/1518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:58.965758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:58.967116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:58.975247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.975669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.976529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:58.976962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:58.981289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.993001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.995260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:58.997267 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b23f2596-2f4e-4159-b065-03a950f6c8fd tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.235640 Apr 09 20:59:58.997845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 785/1519] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 20:59:59.003493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:59.004646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:59.011819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.012272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.013144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.013620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.539388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe94c699-c15e-4720-9b0a-6ddc14531598 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1630 microversion: 2.1 time: 0.575609 Apr 09 20:59:59.543450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 20:59:59.562986 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 735/1520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1630 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:59.568973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:59.569532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:59.583788 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bcd433d7-694b-4ffd-b406-51d4e4f867fa tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.584513 Apr 09 20:59:59.584794 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 786/1521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:58 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 20:59:59.594033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.594033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.594033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.594033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.599844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:59.605751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:59.617430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.618468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.619421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.620016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.626414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 20:59:59.750628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-58cefd8d-75f6-4cd9-a501-cf1aff84acf9 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 204 len: 0 microversion: 2.1 time: 0.196073 Apr 09 20:59:59.754553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 736/1522] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 20:59:59 2022] DELETE /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 20:59:59.760567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 20:59:59.761305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 20:59:59.767759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.768145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 20:59:59.768926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 20:59:59.769384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.014861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.029461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.030480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.033023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.037345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04d0f929-39f8-4276-815d-879bdfa3cace tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.441377 Apr 09 21:00:00.037913 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 787/1523] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 20:59:59 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:00.046009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbd50cdc-5453-4e49-96f5-523d4a0c6ca9 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.289877 Apr 09 21:00:00.049943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-285407231", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "6e4c0a84-06ca-42fe-9656-5da4d34fcdb0"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:00.057765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 737/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 20:59:59 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:00.062680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:00.063452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:00.071048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.079341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.080170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.080636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.141869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] validate_networks() for [('6e4c0a84-06ca-42fe-9656-5da4d34fcdb0', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:00:00.502093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.515258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cfa42c3e-d90f-4c41-8e16-65ba262c9e9e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.456138 Apr 09 21:00:00.516375 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 738/1525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:00 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:00.521146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:00.525977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:00.534034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.534710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.535681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.536500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.635197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.643629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef5f85b9-3946-4487-9075-720d7173d2a0 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1432 microversion: 2.1 time: 0.125972 Apr 09 21:00:00.644225 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 739/1526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:00 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1432 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:00.649245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:00.654670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:00.663193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.664018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.665238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.665898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.915277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:00.922666 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0c2ee1cb-9afd-47b8-9237-8dce8e4ce158 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1523 microversion: 2.1 time: 0.277404 Apr 09 21:00:00.923291 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 740/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:00 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:00.936626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:00.937269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:00.943443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.943974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.944832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.945152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:00:00.945434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.945555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:00:00.946036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:00:00.946556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:00:00.947076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:00:00.955821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.956263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.957116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:00.957551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:00.974135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:00.978647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for user ceba42e80d7746e4897669084c078c09 and project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:00.990311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:00:00.992691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:00:01.041153 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91400f7b-e27f-49a5-9c47-62632b7bb961 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999297 Apr 09 21:00:01.041779 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 788/1528] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:00:01.046264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-099348a3-953b-49bd-94e4-4667e903230e req-6dec83b9-9a1f-4a11-a7f5-42c84cac0341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb7b9d-0282-4585-8686-d923c5652c49", "name": "network-vif-deleted", "tag": "e8f49318-e089-4c16-97fd-0fed692d65b1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:01.054893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-099348a3-953b-49bd-94e4-4667e903230e req-6dec83b9-9a1f-4a11-a7f5-42c84cac0341 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.055923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-099348a3-953b-49bd-94e4-4667e903230e req-6dec83b9-9a1f-4a11-a7f5-42c84cac0341 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.068502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-099348a3-953b-49bd-94e4-4667e903230e req-6dec83b9-9a1f-4a11-a7f5-42c84cac0341 service nova] Creating event network-vif-deleted:e8f49318-e089-4c16-97fd-0fed692d65b1 for instance 27fb7b9d-0282-4585-8686-d923c5652c49 on nch2-master-1 Apr 09 21:00:01.074587 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-099348a3-953b-49bd-94e4-4667e903230e req-6dec83b9-9a1f-4a11-a7f5-42c84cac0341 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Apr 09 21:00:01.075364 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 789/1529] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:01.080911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.082025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.088954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.089261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.089715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.090508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.090945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.098411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.100153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.101289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6406a83-2197-4d1f-8ceb-1e9bbc3401e7 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.168406 Apr 09 21:00:01.112326 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 741/1530] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:00 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:01.116954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea967e2-2ce1-496d-9d15-58e58f3b57a0", "tag": "4101014a-f45a-4573-a194-f9b7022a29b0"}, {"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "598fea91-f00b-41e4-8273-ec325cadb0f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:01.128568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.129019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.143098 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] Creating event network-changed:4101014a-f45a-4573-a194-f9b7022a29b0 for instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 on nch2-master-1 Apr 09 21:00:01.143794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] Creating event network-changed:598fea91-f00b-41e4-8273-ec325cadb0f1 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:01.151468 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-db99a59e-2c3c-4002-bfe1-06147c4f3c61 req-e2dae125-d024-4d15-a065-1af844c84184 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037917 Apr 09 21:00:01.152594 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 742/1531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:01.159699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e27149da-4954-4434-816e-614b45874254 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.160594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e27149da-4954-4434-816e-614b45874254 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.220765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e27149da-4954-4434-816e-614b45874254 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.228096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e27149da-4954-4434-816e-614b45874254 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1210 microversion: 2.1 time: 0.073783 Apr 09 21:00:01.229311 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 743/1532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1210 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:01.234097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.234921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.242750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.243232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.244053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.244537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.259587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.268240 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e40449a2-eb03-4933-96de-8cfb7ea7e186 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1543 microversion: 2.1 time: 0.191287 Apr 09 21:00:01.269180 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 790/1533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1543 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:01.274281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.275042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.281110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.281796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.282713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.283150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.510087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.519053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.520560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.521796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7bcf3168-1838-49e3-92be-f8e028f3ba25 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.291368 Apr 09 21:00:01.522321 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 744/1534] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:01.525675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.533502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9864e242-4b85-46e7-ab23-d1e3821d9f57 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1322 microversion: 2.1 time: 0.263053 Apr 09 21:00:01.534063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 791/1535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:01.536628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.537424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.543438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.543894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.544692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.545125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.660442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.661332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.667867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.668395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.669201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.669703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.682263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.690047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de0eea03-2c1d-4095-aa5c-01ee180ef074 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.162360 Apr 09 21:00:01.690630 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 745/1536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:01.735004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:01.742596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71cb012f-158f-4c9d-9fd9-c64f5f3fc7b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 200 len: 1303 microversion: 2.1 time: 0.086578 Apr 09 21:00:01.743169 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 792/1537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:01.939973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:01.940478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:01.949195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.949649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:01.950437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:01.951078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.099119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.107629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-021a6810-32a4-47aa-9763-0a3e7b51e975 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1523 microversion: 2.1 time: 0.171747 Apr 09 21:00:02.122598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:02.123960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:02.128862 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 746/1538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:01 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:02.131018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.131692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.132657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.133308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.246386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:02.246976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:02.253236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.253683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.254465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.254900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.279014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.287812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.289845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.291181 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91db66af-3b39-4d6c-bb48-1389da8f0c51 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.172630 Apr 09 21:00:02.291818 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 793/1539] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:02 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:02.296517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:02.297144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:02.303372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.303821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.304599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.305047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.317553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.325539 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-320dcfe2-bc5c-4135-aa2b-2ef305ac92cf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1262 microversion: 2.1 time: 0.083280 Apr 09 21:00:02.326206 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 747/1540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:02 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:02.514002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:02.526932 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db1c6649-97d7-47e1-91e8-6b4b6a074c03 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1542 microversion: 2.1 time: 0.233817 Apr 09 21:00:02.528138 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 794/1541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:02 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:02.540037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:02.541132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:02.549963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.550455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.551237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.553469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:02.554258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:02.554536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.564109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.564493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:02.565309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:02.566280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.016171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.024583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0de21fd2-a067-46ea-a186-6433609e3453 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1471 microversion: 2.1 time: 0.475636 Apr 09 21:00:03.035717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 795/1542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:02 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:03.035717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.035717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.039108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.039588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.040422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.041353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.070404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.080975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.082488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.083701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54eb06df-dec1-446e-98b9-9f4bc6921a9b tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.547681 Apr 09 21:00:03.084278 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 748/1543] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:02 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:03.089721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.090692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 27fb7b9d-0282-4585-8686-d923c5652c49] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.098984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.099690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.100469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.101175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.117415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance 27fb7b9d-0282-4585-8686-d923c5652c49 could not be found. Apr 09 21:00:03.118019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance 27fb7b9d-0282-4585-8686-d923c5652c49 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:03.118858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-29cc89cc-4869-4622-a2ec-e848c964a8c6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49" status: 404 len: 111 microversion: 2.1 time: 0.033525 Apr 09 21:00:03.119425 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 749/1544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/27fb7b9d-0282-4585-8686-d923c5652c49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:03.127871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:03.128575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.136187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.136635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.137444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.137877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.161966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lazy-loading 'flavor' on Instance uuid 81e71eab-8630-4e09-b286-3de7e1562dd7 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:03.239998 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3ddf739-136b-407e-8396-59985f403f69 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.115101 Apr 09 21:00:03.241112 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 750/1545] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:03 2022] POST /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:00:03.248472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.249514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.260386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.261175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.262238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.262825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.363546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.371051 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ffbd7eee-292e-42b4-b98a-e2304f9d6450 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.344630 Apr 09 21:00:03.371590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 796/1546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:03.381240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.382275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.391129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.391915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.392696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.393313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.611984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.620614 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52b33891-bdf0-47ae-9ff7-608f9b5941c1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 200 len: 1523 microversion: 2.1 time: 0.377801 Apr 09 21:00:03.621776 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 751/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:03.626859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.627770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.634871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.635417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.637979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.638767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.782424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:03.789933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-09a1b864-7348-4cfd-af8f-f640a0ad9805 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1473 microversion: 2.1 time: 0.417047 Apr 09 21:00:03.817407 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 797/1548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:03.822332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:03.822876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:03.834885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.835032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:03.836043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:03.836666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.054342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57a91a10-a906-4799-a6ee-6051d9cac4e4 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1630 microversion: 2.1 time: 0.431276 Apr 09 21:00:04.055188 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 752/1549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1630 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:04.071940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.082126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.085822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.087850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.088871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.090269 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87d7797c-6359-4af9-823c-623185aa2473 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.271973 Apr 09 21:00:04.093220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 798/1550] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:03 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:04.100384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.101000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.107557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.108263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.109495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.109858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.120626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.121092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.126245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.126697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.300073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.308766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4fc5a730-a485-41e5-984a-2b8fac96aa52 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1268 microversion: 2.1 time: 0.252354 Apr 09 21:00:04.313772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 753/1551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:04.327767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-0298d74e-1680-4657-9545-69191ef5c8b5 req-5e66d7f7-5341-41a2-a795-3ad868b74655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c963ea0b-4eee-4241-a6d4-f49b42ec7c10", "name": "network-vif-deleted", "tag": "1651bb82-70f9-47e7-a6c1-3044ad474d20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:04.351699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0298d74e-1680-4657-9545-69191ef5c8b5 req-5e66d7f7-5341-41a2-a795-3ad868b74655 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.352319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0298d74e-1680-4657-9545-69191ef5c8b5 req-5e66d7f7-5341-41a2-a795-3ad868b74655 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.375765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-0298d74e-1680-4657-9545-69191ef5c8b5 req-5e66d7f7-5341-41a2-a795-3ad868b74655 service nova] Creating event network-vif-deleted:1651bb82-70f9-47e7-a6c1-3044ad474d20 for instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 on nch2-master-1 Apr 09 21:00:04.382378 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-0298d74e-1680-4657-9545-69191ef5c8b5 req-5e66d7f7-5341-41a2-a795-3ad868b74655 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058335 Apr 09 21:00:04.387955 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 754/1552] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:04.394946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.395655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.403181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.403632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.404443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.404877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.419232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.426809 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b5c10ee-9144-4535-8db2-914848b62925 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1474 microversion: 2.1 time: 0.331692 Apr 09 21:00:04.427645 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 799/1553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:04.433199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.433992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.440228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.440928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.442986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.443442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.668711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.673357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.685183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.688267 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58a8eeb7-6fe7-4321-99ce-46b11023d9ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.259415 Apr 09 21:00:04.689027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 800/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:04.690721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.691990 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5b4c1693-dc2c-4c81-8e28-1c2265dff0c0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.301883 Apr 09 21:00:04.692557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 755/1555] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:04.697421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.698223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.704657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.705138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.706094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.706530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.720775 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] HTTP exception thrown: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. Apr 09 21:00:04.721397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 404 to user: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:04.722435 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7eac57d-9a1b-4e65-b7d3-7376fce1b65b tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 404 len: 111 microversion: 2.1 time: 0.028735 Apr 09 21:00:04.722996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 801/1556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:04.732470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.736393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.737472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:04.742719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.743302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.744109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.745247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.808796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.809732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:04.822911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.823665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.824927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.825551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.830575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fcd3504-f9e4-44fc-ac3c-a656a6921d49 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.101820 Apr 09 21:00:04.831490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 756/1557] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:00:04.843613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-187769e2-c9ca-4f4d-9752-fb7a0dd4b02e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.845074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-187769e2-c9ca-4f4d-9752-fb7a0dd4b02e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:04.845871 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-187769e2-c9ca-4f4d-9752-fb7a0dd4b02e tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.006354 Apr 09 21:00:04.850780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 757/1558] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:00:04.856316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.859645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.860393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:04.866753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.867016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.867955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.868243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.876597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.877367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.878254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lazy-loading 'fault' on Instance uuid 7c41e34e-8722-41ec-ae27-9cb25d4642a0 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:04.904283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:00:04.942797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.943374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-421e04d3-024c-4f25-8566-42049b788f29 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.091568 Apr 09 21:00:04.949345 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 758/1559] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers => generated 683 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:04.950886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-unplugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:04.952321 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b4c8ecc-c369-46ae-869b-5d452d2cfc17 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1308 microversion: 2.1 time: 0.149306 Apr 09 21:00:04.959566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.960140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.962737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 802/1560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:04.967491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:04.971347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:04.971840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.servers [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Removing options 'limit' from query {{(pid=141818) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 09 21:00:04.972825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] Creating event network-vif-unplugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:00:04.973021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:04.979452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] Instance dd75b541-d45b-4a01-a4fb-7122b67286c1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:00:04.979620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.979962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.980760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:04.981356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:04.986626 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1eb4a442-6319-4f62-aa7f-d1282e3acfbd req-6aed595c-a720-4e4b-b786-97fdc06b5916 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040373 Apr 09 21:00:04.987637 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 759/1561] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:05.008781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:00:05.072067 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aeff49c3-0bb2-4bed-a5c5-2367a813821c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.108221 Apr 09 21:00:05.072701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 803/1562] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Apr 9 21:00:04 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:05.072818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.073683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.080870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.081444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.082288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.082867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.085926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9db6dc49-2c84-4392-8f4b-d48fd66b9dcb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.088260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9db6dc49-2c84-4392-8f4b-d48fd66b9dcb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.088260 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9db6dc49-2c84-4392-8f4b-d48fd66b9dcb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.007734 Apr 09 21:00:05.093427 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 804/1563] 10.222.0.30 () {58 vars in 1141 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:00:05.098487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-166ebcbb-9a4a-4f6a-bb06-2b5781201dda tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.099634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-166ebcbb-9a4a-4f6a-bb06-2b5781201dda tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.100429 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-166ebcbb-9a4a-4f6a-bb06-2b5781201dda tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.006054 Apr 09 21:00:05.106164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 805/1564] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:00:05.111636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-839d0793-0e73-48f8-925d-c554ea13086f tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.115274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-839d0793-0e73-48f8-925d-c554ea13086f tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.116087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-839d0793-0e73-48f8-925d-c554ea13086f tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:05.123139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.servers [None req-839d0793-0e73-48f8-925d-c554ea13086f tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Flavor 'non_existing_flavor' could not be found {{(pid=141818) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Apr 09 21:00:05.124176 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-839d0793-0e73-48f8-925d-c554ea13086f tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.017210 Apr 09 21:00:05.125592 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 806/1565] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:05.132104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.132936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.139395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.139845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.140621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.141119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.274404 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-901fca2d-8390-475f-95e7-8257a4b59638 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1613 microversion: 2.1 time: 0.206061 Apr 09 21:00:05.275373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 760/1566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1613 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:05.280335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.283912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.285058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:05.291419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.291872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.292708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.293176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.314291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.323082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.324677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.325982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9581b750-6516-4bc4-bc34-0b81f5256788 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.199239 Apr 09 21:00:05.336575 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 807/1567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:05.336575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:05.336575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.338672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.339154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.339965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.340398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.370312 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] HTTP exception thrown: Cannot 'migrate' instance 81e71eab-8630-4e09-b286-3de7e1562dd7 while it is in vm_state suspended Apr 09 21:00:05.370903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Returning 409 to user: Cannot 'migrate' instance 81e71eab-8630-4e09-b286-3de7e1562dd7 while it is in vm_state suspended {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.371730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c69becc3-9c76-411a-a720-f3a09697f7de tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7/action" status: 409 len: 148 microversion: 2.1 time: 0.043871 Apr 09 21:00:05.372276 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 808/1568] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:05 2022] POST /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7/action => generated 148 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:00:05.376920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.378045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.381130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f625bba9-1ddf-4262-815a-203a026240ef tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.104339 Apr 09 21:00:05.381781 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 761/1569] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:05.387280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-864f5c9e-2e86-4058-92fc-42542874ed66 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:05.388534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-864f5c9e-2e86-4058-92fc-42542874ed66 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.389410 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-864f5c9e-2e86-4058-92fc-42542874ed66 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3/action" status: 400 len: 144 microversion: 2.1 time: 0.006630 Apr 09 21:00:05.390010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.390523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.391237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 762/1570] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:05 2022] POST /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3/action => generated 144 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:00:05.391838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.392480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.397152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.401232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.401896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:05.408630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.409122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.409934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.410784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.496260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06900063-12a6-40d7-a11d-7f137cef9104 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.103872 Apr 09 21:00:05.496962 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 763/1571] 10.222.0.30 () {58 vars in 1183 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:05.502084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d5c32f0-2621-4a9b-92ad-89552041cccb tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:05.503452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d5c32f0-2621-4a9b-92ad-89552041cccb tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.504254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d5c32f0-2621-4a9b-92ad-89552041cccb tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3/action" status: 400 len: 120 microversion: 2.1 time: 0.006190 Apr 09 21:00:05.505266 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 764/1572] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:05 2022] POST /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3/action => generated 120 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:00:05.509927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.510727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.517905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.518351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.519149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.519583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.545568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.553974 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-be199dfe-c7e9-407f-8cb6-d19ad6360560 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.180461 Apr 09 21:00:05.561230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 809/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:05.568545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.571933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.572694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:05.578044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.578499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.579375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.579812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.676424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:00:05.683762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.698872 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f28fafc8-9794-4478-8576-0ea509f200d9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1474 microversion: 2.1 time: 0.192303 Apr 09 21:00:05.709767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 765/1574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:05.715366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d5ed21b-6b42-4a78-bfba-bb504120cf55 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:05.716636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d5ed21b-6b42-4a78-bfba-bb504120cf55 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Failed to fetch instance by id 999 {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:00:05.717448 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1d5ed21b-6b42-4a78-bfba-bb504120cf55 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] HTTP exception thrown: Instance 999 could not be found. Apr 09 21:00:05.718204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d5ed21b-6b42-4a78-bfba-bb504120cf55 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:05.720524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d5ed21b-6b42-4a78-bfba-bb504120cf55 tempest-ServersAdminNegativeTestJSON-321642897 tempest-ServersAdminNegativeTestJSON-321642897-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008997 Apr 09 21:00:05.721807 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 766/1575] 10.222.0.30 () {60 vars in 1178 bytes} [Sat Apr 9 21:00:05 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:00:05.726837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.729682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.741919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.742383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.743414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.744015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.760266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.769016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.769587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.969607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:05.972394 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8df9da7-7984-4fb5-bb80-6adc8518337a tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.407610 Apr 09 21:00:05.973362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 810/1576] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:05.980625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.981281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:05.989229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.989944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.991404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:05.991843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:05.992567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b279400-10be-4406-b6dd-654c1c9ced29 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.269475 Apr 09 21:00:05.993493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 767/1577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:05.998389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:05.998965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.005903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.006457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.007329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.007843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.034266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:06.175548 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97de4e9c-76e0-48c9-9fa8-46dc168ff79e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 204 len: 0 microversion: 2.1 time: 0.180737 Apr 09 21:00:06.177296 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 768/1578] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:05 2022] DELETE /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:06.183364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.184819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.193537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.195574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.197084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.197743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.217636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.227138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.229148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.230586 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-936a1dc4-4c52-42fa-aaf9-44b948c236d0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.254526 Apr 09 21:00:06.231840 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 811/1579] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:05 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:06.237623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eb5e547b-5704-4ea0-a78d-c941a8b42298 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.237883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.238486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.238947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lazy-loading 'fault' on Instance uuid 7c41e34e-8722-41ec-ae27-9cb25d4642a0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:06.241648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eb5e547b-5704-4ea0-a78d-c941a8b42298 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.242757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eb5e547b-5704-4ea0-a78d-c941a8b42298 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009806 Apr 09 21:00:06.243694 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 812/1580] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:06.250163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.266009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.274445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.277513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.278402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.278860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.310676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.321786 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0a9a1b13-15d4-4567-9a22-92810e6d8608 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 200 len: 1308 microversion: 2.1 time: 0.142935 Apr 09 21:00:06.325432 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 769/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:06.331541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.335541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.336916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Searching by: {'deleted': False, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:00:06.343901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.344572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.345538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.346070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.376257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:00:06.413846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d9741ea1-ca5b-4f53-8c67-387d121ef4e8 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.086984 Apr 09 21:00:06.420847 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 770/1582] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:06.421749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.422402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.432529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.433702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.437614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.438113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.468528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.476801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-746ce520-1ddc-474c-9b2e-ea95bbcac08f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1468 microversion: 2.1 time: 0.231950 Apr 09 21:00:06.481520 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 813/1583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:06.488810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b91dfb80-764b-45b5-a1e7-4240962afc81 req-eee42851-96b3-4a9f-86cc-fc2f0edac6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c41e34e-8722-41ec-ae27-9cb25d4642a0", "name": "network-vif-deleted", "tag": "60c84a40-994b-44d8-8a03-52559d3ae09d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:06.504929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b91dfb80-764b-45b5-a1e7-4240962afc81 req-eee42851-96b3-4a9f-86cc-fc2f0edac6c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.506190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b91dfb80-764b-45b5-a1e7-4240962afc81 req-eee42851-96b3-4a9f-86cc-fc2f0edac6c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.520447 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b91dfb80-764b-45b5-a1e7-4240962afc81 req-eee42851-96b3-4a9f-86cc-fc2f0edac6c6 service nova] Creating event network-vif-deleted:60c84a40-994b-44d8-8a03-52559d3ae09d for instance 7c41e34e-8722-41ec-ae27-9cb25d4642a0 on nch1-master-1 Apr 09 21:00:06.530938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b91dfb80-764b-45b5-a1e7-4240962afc81 req-eee42851-96b3-4a9f-86cc-fc2f0edac6c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048110 Apr 09 21:00:06.532287 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 814/1584] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:06.546843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.547558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.554377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.555009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.555931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.556371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.574521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] HTTP exception thrown: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. Apr 09 21:00:06.575148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 404 to user: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:06.575991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d29d073-754b-4ae4-b030-e3784affaeb1 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 404 len: 111 microversion: 2.1 time: 0.042425 Apr 09 21:00:06.579889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 815/1585] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:06 2022] DELETE /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:06.584747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.585389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.591630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.592453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.593283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.593722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.605163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.614549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.615879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.617287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a24c6b5-2e98-4dad-b7fc-4de7df87e087 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.201330 Apr 09 21:00:06.618011 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 771/1586] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:06.622826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.623872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.631130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.631702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.632596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.632909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.671327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:06.772764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.782946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-505b66c3-0780-4948-80b0-61cce14948bf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.201762 Apr 09 21:00:06.784462 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 816/1587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:06.797575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.798565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.799405 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b10e6751-4942-4e08-a52e-397cbc1a9d61 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 204 len: 0 microversion: 2.1 time: 0.179885 Apr 09 21:00:06.800013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 772/1588] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:06 2022] DELETE /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:06.808419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.809017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.809326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.809882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.810914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.811591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.816594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.817104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.817853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.818443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.847056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:06.942842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d81fa166-5670-40e9-a40e-a326a3e64584 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 204 len: 0 microversion: 2.1 time: 0.137804 Apr 09 21:00:06.944237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 773/1589] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:06 2022] DELETE /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:00:06.957762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:06.959169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: c963ea0b-4eee-4241-a6d4-f49b42ec7c10] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:06.970770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.971709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.973178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:06.974495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:06.988008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:06.997923 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b91a476f-e4c7-482c-b491-7dbd4c9273bb tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1471 microversion: 2.1 time: 0.212136 Apr 09 21:00:06.998619 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 817/1590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:07.014496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.015497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] HTTP exception thrown: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. Apr 09 21:00:07.015636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.016254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 404 to user: Instance c963ea0b-4eee-4241-a6d4-f49b42ec7c10 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:07.016982 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a0afd81-7a5b-484a-a68b-d8c1365b19bb tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10" status: 404 len: 111 microversion: 2.1 time: 0.067563 Apr 09 21:00:07.017886 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 774/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:06 2022] GET /compute/v2.1/servers/c963ea0b-4eee-4241-a6d4-f49b42ec7c10 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:00:07.022302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.022797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:07.023342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.023454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.024458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.025687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.029561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.029978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.030779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.032389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.074532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.074995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.075819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.076255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.101731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for project e77d97d277f245d4822a646af7d5f50d. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:07.106400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for user 5ab294d1890047aababb87b3a865a14c and project e77d97d277f245d4822a646af7d5f50d. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:07.166086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.179957 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-16ea0716-b675-4b4d-b9ca-94f3f8727b6d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.173077 Apr 09 21:00:07.180859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 818/1592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:07.185925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.186704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.195061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.195794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.196657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.197284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.275915 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ff839c7-e5f7-4313-816b-2e1b6d7ea5ce tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1/action" status: 202 len: 0 microversion: 2.1 time: 0.256065 Apr 09 21:00:07.279450 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 775/1593] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:07 2022] POST /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:00:07.286338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d3244213-defb-4926-be5b-8bb2f3d003e8 req-50469a0c-3475-442d-a588-b6c0e3988e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e94f544-180a-47fe-9df7-06afcdf7ca2d", "tag": "1af61b32-e6ec-4d29-b14a-ebb1c3a817f0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:07.295733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d3244213-defb-4926-be5b-8bb2f3d003e8 req-50469a0c-3475-442d-a588-b6c0e3988e6b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.296255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d3244213-defb-4926-be5b-8bb2f3d003e8 req-50469a0c-3475-442d-a588-b6c0e3988e6b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.309247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d3244213-defb-4926-be5b-8bb2f3d003e8 req-50469a0c-3475-442d-a588-b6c0e3988e6b service nova] Creating event network-changed:1af61b32-e6ec-4d29-b14a-ebb1c3a817f0 for instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d on nch2-master-1 Apr 09 21:00:07.315942 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d3244213-defb-4926-be5b-8bb2f3d003e8 req-50469a0c-3475-442d-a588-b6c0e3988e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Apr 09 21:00:07.316990 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 776/1594] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:07.322758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.323543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.330303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.331168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.332163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.332674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.373228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.383812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab91ec72-5967-45c3-a400-b25dd2f0db5c tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1522 microversion: 2.1 time: 0.201538 Apr 09 21:00:07.388131 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 819/1595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:07.393348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.397109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.407895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.408885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.410185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.410790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.588351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.598565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.600183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.601456 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-756931e1-1769-4494-aaab-5d32ea2cc658 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.283237 Apr 09 21:00:07.602778 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 777/1596] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:07.606342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.609782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.611056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 7c41e34e-8722-41ec-ae27-9cb25d4642a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.618246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e126e3e-e0c3-47d9-a2af-9b306a1ff2e8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.228518 Apr 09 21:00:07.618925 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 820/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:07.619829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.620375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.621412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.622845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.625568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.626484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.649996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.650480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.651381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.653708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance 7c41e34e-8722-41ec-ae27-9cb25d4642a0 could not be found. Apr 09 21:00:07.654660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.655006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance 7c41e34e-8722-41ec-ae27-9cb25d4642a0 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:07.656332 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd2bf1e5-b9e1-4df2-9acd-dd03b413e396 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0" status: 404 len: 111 microversion: 2.1 time: 0.052093 Apr 09 21:00:07.662141 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 778/1598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/7c41e34e-8722-41ec-ae27-9cb25d4642a0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:07.667115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.668297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.676457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.676910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.677733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.678732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.912089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.913651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.921725 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-720688c6-7133-40c3-b67c-5f3ee1b55844 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1468 microversion: 2.1 time: 0.301413 Apr 09 21:00:07.928054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.929594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:07.938865 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 821/1599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:07.939074 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7862c1da-f1e5-499b-906e-e895d16e1684 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.268818 Apr 09 21:00:07.939074 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 779/1600] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:07.941560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd9886af-fa27-48d4-abc5-5bd74142f3b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.945984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:07.947667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:07.957026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.957769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.958804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:07.959475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:07.982321 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd9886af-fa27-48d4-abc5-5bd74142f3b8 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e008c1d0-8970-4031-b5df-777088fcff3c" status: 204 len: 0 microversion: 2.1 time: 0.050997 Apr 09 21:00:07.984151 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 822/1601] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:00:07 2022] DELETE /compute/v2.1/os-server-groups/e008c1d0-8970-4031-b5df-777088fcff3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:07.991523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4483afc2-da31-41be-8c49-d6bffb9a4e8a req-4f48ba3f-150c-4d0b-a288-13a03fb33947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea967e2-2ce1-496d-9d15-58e58f3b57a0", "name": "network-vif-plugged", "status": "completed", "tag": "4101014a-f45a-4573-a194-f9b7022a29b0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:08.000951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4483afc2-da31-41be-8c49-d6bffb9a4e8a req-4f48ba3f-150c-4d0b-a288-13a03fb33947 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.001553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4483afc2-da31-41be-8c49-d6bffb9a4e8a req-4f48ba3f-150c-4d0b-a288-13a03fb33947 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.012787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4483afc2-da31-41be-8c49-d6bffb9a4e8a req-4f48ba3f-150c-4d0b-a288-13a03fb33947 service nova] Creating event network-vif-plugged:4101014a-f45a-4573-a194-f9b7022a29b0 for instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 on nch2-master-1 Apr 09 21:00:08.017882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4483afc2-da31-41be-8c49-d6bffb9a4e8a req-4f48ba3f-150c-4d0b-a288-13a03fb33947 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Apr 09 21:00:08.018489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 823/1602] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:08.023483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.024057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.030229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.030673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.031439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.031864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.055723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:08.101203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:08.109767 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f1ef554-eb1f-4d54-b647-e57b34515cf5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.167628 Apr 09 21:00:08.110517 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 780/1603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:07 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:08.135841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c302a8c-4329-43a1-84b5-13085f43c1b9 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 204 len: 0 microversion: 2.1 time: 0.115943 Apr 09 21:00:08.136444 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 824/1604] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:08 2022] DELETE /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:08.147685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.148411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.157986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.158692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.159833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.160447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.188822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:08.197453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.198153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.204895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.205385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.206173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.206610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.272815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f8a7def-639c-4fe8-a574-602a65756145 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 204 len: 0 microversion: 2.1 time: 0.131198 Apr 09 21:00:08.273510 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 781/1605] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:08 2022] DELETE /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:08.281725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.282539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.288340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.288787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.289592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.290020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.344866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:08.353297 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a7a3381-cce4-4565-8a9f-9ee73eb3bce5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.160079 Apr 09 21:00:08.353878 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 825/1606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:08 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:08.404236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.404846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.410937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.411614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.412399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.412854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.431398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:08.439138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-31ca47c2-f23b-480f-a410-02f9626020f6 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1474 microversion: 2.1 time: 0.161388 Apr 09 21:00:08.449022 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 782/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:08 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1474 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:08.542051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:08.549829 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63ad8c6a-5123-4bba-b0a0-a341793d8448 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1522 microversion: 2.1 time: 0.149446 Apr 09 21:00:08.550525 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 826/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:08 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:08.620090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.620611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.627039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.627494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.628273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.628712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.635643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:08.636880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:08.643275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.643713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:08.644493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:08.644921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.154457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.159171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.162535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38951200-592d-43c6-b2c3-3d2d19de0b95 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.530749 Apr 09 21:00:09.163126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 827/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:08 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:09.167571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.168207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.168848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.170672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.171837 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c698e97-4a12-46e7-b7c9-8254d25541e6 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.555863 Apr 09 21:00:09.183199 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 783/1610] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:08 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:09.183382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.183382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.183382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.183382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.183763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.183763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.183763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.184029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.184889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.185410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.364644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.368180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.373359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.374862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.376003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37baf071-5578-42c4-8330-7a3db764d9af tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.211930 Apr 09 21:00:09.376181 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-995d6301-6145-4cb8-a60f-326109a90b0f tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1468 microversion: 2.1 time: 0.202812 Apr 09 21:00:09.376575 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 828/1611] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:09.384173 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 784/1612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1468 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:09.384173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.384173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.388156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.388765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.394572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.395246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.396037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.396232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.396494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.396687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.397553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.397987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.586645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.590067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.594703 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9185fbf3-5189-443e-b29a-d54ce61d01ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.217003 Apr 09 21:00:09.595442 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 829/1613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:09.598033 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3569cb1-11cc-47ca-af3a-52485cf0403c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1496 microversion: 2.1 time: 0.220009 Apr 09 21:00:09.598790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 785/1614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1496 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:09.603437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.604047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.604647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:09.605301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:09.610245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.610883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.611632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.612071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.612241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.612720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.613699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:09.614138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:09.800332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.803480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:09.808419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-049b7405-e77b-4c79-8e0c-70c778948f0d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1474 microversion: 2.1 time: 0.212078 Apr 09 21:00:09.809147 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 830/1615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:09.811527 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d26c103b-5c31-47c6-86d1-f2c0e7d06fea tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1522 microversion: 2.1 time: 0.211840 Apr 09 21:00:09.812210 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 786/1616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:09 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:10.036033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-plugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:10.044733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.045215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.057266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] Creating event network-vif-plugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:00:10.063001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] Instance dd75b541-d45b-4a01-a4fb-7122b67286c1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:00:10.069427 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d46ef9ec-8b53-417d-8847-6c52745a4b35 req-664aceb1-4441-451d-90ef-081e114f1315 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037520 Apr 09 21:00:10.070000 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 831/1617] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:10.180096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.180901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.191286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.192190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.195362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.195900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.196900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.197554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.199087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.199516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.202091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.202091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.430752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.438786 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb87d626-9b86-4e3d-83e8-f2f9ee14af57 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.262485 Apr 09 21:00:10.446116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 787/1618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:10.446116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.446116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.447593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.451202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.451881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.452893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.453226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.459346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.460833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.462021 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4d655cc-5418-499b-924c-9e2dfef22ea3 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.275033 Apr 09 21:00:10.462609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 832/1619] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:10.467116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.467717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.473913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.474366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.475140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.475576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.659088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.666196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.667124 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2701d1d-da8d-42a0-9cff-5a8606d2e6de tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1468 microversion: 2.1 time: 0.226483 Apr 09 21:00:10.667713 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 788/1620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:10.672159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.672776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.678813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.679254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.679474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.680085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.680523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.681483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:10.682687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a3a22c5-1215-4bfd-be6b-dd19ccdc6990 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.219090 Apr 09 21:00:10.683367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 833/1621] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:10.687991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:10.688615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:10.700944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.701684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:10.702481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:10.702883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.063496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:11.073059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de36601a-6df7-4708-af91-c6f46df2c2d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 200 len: 1473 microversion: 2.1 time: 0.387875 Apr 09 21:00:11.073886 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 834/1622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 1473 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:11.086120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:11.086870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:11.093526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.094331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.095004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.095536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.105986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:11.117324 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1571b233-fe9c-462e-b431-d130a7d6cf13 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.448512 Apr 09 21:00:11.129124 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 789/1623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:10 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:11.134807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:11.135590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:11.143088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.143531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.144327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.144766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.503932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:11.512792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6a6d835-804c-4c0f-bb28-e15e2ad75265 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1474 microversion: 2.1 time: 0.433035 Apr 09 21:00:11.523326 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 835/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:11 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1474 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:11.529284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-961333615"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:11.531213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:11.539591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.540740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.541822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.542474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.723495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:11.732824 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad706b1c-9f11-49a1-9f82-223a8b5cfa66 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1522 microversion: 2.1 time: 0.602341 Apr 09 21:00:11.737089 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 790/1625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:11 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:11.742172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:11.748012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:11.761091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.763458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.767747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.771761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.959469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9d388f6-ed5d-4974-8b26-64d3292c66f2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a/action" status: 202 len: 0 microversion: 2.1 time: 0.434078 Apr 09 21:00:11.960545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 836/1626] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:11 2022] POST /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:00:11.966095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:11.967112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:11.973935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.974510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:11.975402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:11.975958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.137279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.147961 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aea44032-af36-4368-9b22-6c2e68c90c9d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.409021 Apr 09 21:00:12.152001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 791/1627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:11 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:12.159725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e94377fb-ac89-4fa8-8c34-e0ef1e183132 req-ee57a735-6e56-4099-82f8-cbeb37b234d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a", "name": "network-vif-deleted", "tag": "7082489d-c707-4f5b-a1d4-a0d36b4ae377"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:12.168962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e94377fb-ac89-4fa8-8c34-e0ef1e183132 req-ee57a735-6e56-4099-82f8-cbeb37b234d8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.169537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e94377fb-ac89-4fa8-8c34-e0ef1e183132 req-ee57a735-6e56-4099-82f8-cbeb37b234d8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.181518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e94377fb-ac89-4fa8-8c34-e0ef1e183132 req-ee57a735-6e56-4099-82f8-cbeb37b234d8 service nova] Creating event network-vif-deleted:7082489d-c707-4f5b-a1d4-a0d36b4ae377 for instance bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a on nch1-master-1 Apr 09 21:00:12.188292 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e94377fb-ac89-4fa8-8c34-e0ef1e183132 req-ee57a735-6e56-4099-82f8-cbeb37b234d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034427 Apr 09 21:00:12.189021 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 792/1628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:12.203733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.204758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:12.214599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.215355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.218666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.219511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.331913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.339434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.343995 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15cdd9e7-428a-4048-8ae2-4e1b90a489d1 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1426 microversion: 2.1 time: 0.153430 Apr 09 21:00:12.344644 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 793/1629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1426 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:12.349672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.350492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:12.354010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.355660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.356825 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-54a3efe6-cba5-4a41-8582-8344f233b08c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.395016 Apr 09 21:00:12.357430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 837/1630] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:11 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:12.363093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.363551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.364346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.364784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.380160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6787975-afe0-42cb-90e4-ba598b32332b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f1dd310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.458468 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6787975-afe0-42cb-90e4-ba598b32332b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.082568 Apr 09 21:00:12.459076 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 838/1631] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:12.464219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9bac4601-a485-49f3-9272-9dcd7b523b8f req-5a3308ff-8b50-4635-b806-b207f87d70f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d480013b-9c5d-4c86-9553-0be0c4abf76f", "name": "network-vif-deleted", "tag": "7e43c995-4690-4a85-93bc-a540cbd5e329"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:12.473588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9bac4601-a485-49f3-9272-9dcd7b523b8f req-5a3308ff-8b50-4635-b806-b207f87d70f7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.475308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9bac4601-a485-49f3-9272-9dcd7b523b8f req-5a3308ff-8b50-4635-b806-b207f87d70f7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.488948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9bac4601-a485-49f3-9272-9dcd7b523b8f req-5a3308ff-8b50-4635-b806-b207f87d70f7 service nova] Creating event network-vif-deleted:7e43c995-4690-4a85-93bc-a540cbd5e329 for instance d480013b-9c5d-4c86-9553-0be0c4abf76f on nch1-master-1 Apr 09 21:00:12.492659 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9bac4601-a485-49f3-9272-9dcd7b523b8f req-5a3308ff-8b50-4635-b806-b207f87d70f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032286 Apr 09 21:00:12.493489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 839/1632] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:12.499179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.500023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:12.508048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.509106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.510243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.510689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.584566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.593228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.594759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.596217 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f6b3286f-0c7e-4391-93f7-c36524cf2f6f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.250304 Apr 09 21:00:12.598001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 794/1633] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:12.602036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.603049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:12.609766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.610531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.611533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.611973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.783314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.792219 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1b860f9-775b-4b6c-a327-b1c98ee1791a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.297093 Apr 09 21:00:12.792808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 840/1634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:12.797523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:12.798488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:12.806220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.806869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.808035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.808805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.841346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:12.841807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:12.842254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lazy-loading 'fault' on Instance uuid bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:12.853926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.862434 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ca6b49b-1bf6-4b0e-a31b-cec24a95d90d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1474 microversion: 2.1 time: 0.264222 Apr 09 21:00:12.863047 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 795/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1474 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:12.886286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:12.894305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1bc6f77b-de2a-41c7-a534-e1a1aaa016f5 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 200 len: 1313 microversion: 2.1 time: 0.100246 Apr 09 21:00:12.894919 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 841/1636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:12 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 1313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:13.172217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.173336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.184575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.186226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.187769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.189254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.362264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.363781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.376222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.376955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.377960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.378555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.419461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.427441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff26e5cf-b38a-4a0f-b9f0-1bed55e8480b tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.259876 Apr 09 21:00:13.428240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 796/1637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:13.436665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.437554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.445188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.446394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.446543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.446874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.487125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.497747 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4152616-5fd7-4aea-a1ec-239ca402513c tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1298 microversion: 2.1 time: 0.140459 Apr 09 21:00:13.504609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 842/1638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:13.509427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2e989a9-abdf-4fdd-bc3b-185e366d9f9f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f6f8ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.615851 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2e989a9-abdf-4fdd-bc3b-185e366d9f9f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.110443 Apr 09 21:00:13.623851 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 843/1639] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:13.631076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.631930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.639841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.641190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.642339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.643481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.873780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.883742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.885539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.887763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dbe81e51-feab-434f-a66a-ed74210c17be tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.458669 Apr 09 21:00:13.888565 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 797/1640] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:13.905606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.906780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.913186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.913903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.914889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.915482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.936081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.957338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.961118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:13.964330 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53d1b732-afe3-4521-a4f1-dd825e0b3229 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.339093 Apr 09 21:00:13.966908 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 844/1641] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:13.974451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:13.976263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:13.986229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.987206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:13.988445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:13.989314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.066427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:14.076176 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf4a3aca-60de-4a8a-a5e0-dcbd2cc5205f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1432 microversion: 2.1 time: 0.106842 Apr 09 21:00:14.086424 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 845/1642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1432 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:14.091786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.092744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.096159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:14.100105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.101016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.102112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.103049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.106381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d717c54f-8ba7-4065-8a6f-5609ca2ec878 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.204323 Apr 09 21:00:14.107230 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 798/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:13 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:14.112644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ad40c821-1b1f-49b2-acf3-3760bfacdda7 req-7ac1085b-6ea3-49eb-b3b8-7d1e004ff408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e94f544-180a-47fe-9df7-06afcdf7ca2d", "name": "network-vif-plugged", "status": "completed", "tag": "1af61b32-e6ec-4d29-b14a-ebb1c3a817f0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:14.122896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] HTTP exception thrown: Instance bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a could not be found. Apr 09 21:00:14.124411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 404 to user: Instance bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:14.125590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf633cab-eceb-43dd-92b0-2f77675e2252 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a" status: 404 len: 111 microversion: 2.1 time: 0.037708 Apr 09 21:00:14.126650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 846/1644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/bc91cc3c-e0b6-48c4-ad6d-f31b56de2b6a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:14.136763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.141285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ad40c821-1b1f-49b2-acf3-3760bfacdda7 req-7ac1085b-6ea3-49eb-b3b8-7d1e004ff408 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.142303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.147859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ad40c821-1b1f-49b2-acf3-3760bfacdda7 req-7ac1085b-6ea3-49eb-b3b8-7d1e004ff408 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.152830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.153412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.156441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.156441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.169855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ad40c821-1b1f-49b2-acf3-3760bfacdda7 req-7ac1085b-6ea3-49eb-b3b8-7d1e004ff408 service nova] Creating event network-vif-plugged:1af61b32-e6ec-4d29-b14a-ebb1c3a817f0 for instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d on nch2-master-1 Apr 09 21:00:14.182569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ad40c821-1b1f-49b2-acf3-3760bfacdda7 req-7ac1085b-6ea3-49eb-b3b8-7d1e004ff408 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073712 Apr 09 21:00:14.182995 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 799/1645] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:14.200513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.200874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.201282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lazy-loading 'fault' on Instance uuid d480013b-9c5d-4c86-9553-0be0c4abf76f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:14.210227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1ae4ef8f-b9ca-402e-b851-3f7dc82ac561 req-53f0c1e8-cf69-4e65-86aa-eb410985e051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674593e6-b6e7-4b13-bbc2-06fa68785ee0", "name": "network-vif-deleted", "tag": "147d52be-77da-4ccb-86ad-30f4bd1a6539"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:14.219455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1ae4ef8f-b9ca-402e-b851-3f7dc82ac561 req-53f0c1e8-cf69-4e65-86aa-eb410985e051 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.220004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1ae4ef8f-b9ca-402e-b851-3f7dc82ac561 req-53f0c1e8-cf69-4e65-86aa-eb410985e051 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.231874 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1ae4ef8f-b9ca-402e-b851-3f7dc82ac561 req-53f0c1e8-cf69-4e65-86aa-eb410985e051 service nova] Creating event network-vif-deleted:147d52be-77da-4ccb-86ad-30f4bd1a6539 for instance 674593e6-b6e7-4b13-bbc2-06fa68785ee0 on nch2-master-1 Apr 09 21:00:14.237498 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1ae4ef8f-b9ca-402e-b851-3f7dc82ac561 req-53f0c1e8-cf69-4e65-86aa-eb410985e051 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031465 Apr 09 21:00:14.238120 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 800/1646] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:14.253629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ad335e35d460fa3fa337374a5a431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389a4f6db1e4cd7b183da2c7e6a4850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:14.261642 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-065d56c3-537f-4ebf-a245-df1d727d69db tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 200 len: 1313 microversion: 2.1 time: 0.130374 Apr 09 21:00:14.262451 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 847/1647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 1313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:14.446374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.447445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.454196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.455063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.456172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.456832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.515213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.515767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.531826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.532477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.534384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.535119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.581672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.582130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.582647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lazy-loading 'fault' on Instance uuid 81e71eab-8630-4e09-b286-3de7e1562dd7 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:14.656968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:14.666501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0d4f6c5-1d82-48f5-8556-37502d4895c6 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 200 len: 1312 microversion: 2.1 time: 0.155514 Apr 09 21:00:14.668225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 848/1648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:14.673467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e71eab-8630-4e09-b286-3de7e1562dd7", "name": "network-vif-deleted", "tag": "9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9"}, {"server_uuid": "cef417c4-dee0-46c2-a42f-dc721270cc56", "name": "network-vif-deleted", "tag": "2e45c6ce-b2c0-4790-bc04-fbb033004b11"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:14.688166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:14.694504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.695172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.696972 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28b98b51-0272-4946-a4e4-d2b2a14b2ac1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1470 microversion: 2.1 time: 0.256704 Apr 09 21:00:14.706829 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 801/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:14.709574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] Creating event network-vif-deleted:9e46b2b2-2e20-4e16-bdf7-e3cb3bdfd4c9 for instance 81e71eab-8630-4e09-b286-3de7e1562dd7 on nch1-master-1 Apr 09 21:00:14.710305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] Creating event network-vif-deleted:2e45c6ce-b2c0-4790-bc04-fbb033004b11 for instance cef417c4-dee0-46c2-a42f-dc721270cc56 on nch2-master-1 Apr 09 21:00:14.711675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-120c64de-39ea-460d-8aab-c4c2fe7d9947 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08efa2c10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.721000 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-11d5926c-1e3d-4c6a-bf27-5fa9ed1c7404 req-1d24bd33-f502-4110-a279-87b7ede2116b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050429 Apr 09 21:00:14.722083 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 849/1650] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:14.769569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-120c64de-39ea-460d-8aab-c4c2fe7d9947 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.061548 Apr 09 21:00:14.770767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 802/1651] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:14.907696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.908396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.914704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.915232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.916080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:14.916609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:14.984380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:14.985589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:14.997310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.008562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.009624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.010160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.504038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.524449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.529106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.534803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.537987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83f00508-1478-4366-a54e-7563e6863ab2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.632973 Apr 09 21:00:15.551540 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 850/1652] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:15.551540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:15.551540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:15.557507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.562043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.562999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.563601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.567000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.567636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.568353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e07c232-e0ab-43e8-92b6-d37f11b393ad tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1281 microversion: 2.25 time: 0.587970 Apr 09 21:00:15.569754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 803/1653] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:14 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:00:15.584868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:15.585530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:15.594472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.595162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.596492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.597256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.612270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.612715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.613378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lazy-loading 'fault' on Instance uuid cef417c4-dee0-46c2-a42f-dc721270cc56 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:15.914758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:15.922906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-890083c8-023b-4871-8ece-d20c32fd76ad tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 200 len: 1308 microversion: 2.1 time: 0.380641 Apr 09 21:00:15.923615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 851/1654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:15 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:15.928334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:15.928905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] [instance: d480013b-9c5d-4c86-9553-0be0c4abf76f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:15.935688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.936134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.936914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.937379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.951463 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] HTTP exception thrown: Instance d480013b-9c5d-4c86-9553-0be0c4abf76f could not be found. Apr 09 21:00:15.952057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] Returning 404 to user: Instance d480013b-9c5d-4c86-9553-0be0c4abf76f could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:15.952950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d63ea99e-0521-444f-be25-8cc011c29b73 tempest-ListServersNegativeTestJSON-349425652 tempest-ListServersNegativeTestJSON-349425652-project] 10.222.0.30 "GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f" status: 404 len: 111 microversion: 2.1 time: 0.028358 Apr 09 21:00:15.956763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 852/1655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:15 2022] GET /compute/v2.1/servers/d480013b-9c5d-4c86-9553-0be0c4abf76f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:15.958634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:15.959241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81e71eab-8630-4e09-b286-3de7e1562dd7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:15.966020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.966468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.967229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:15.967667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:15.983695 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] HTTP exception thrown: Instance 81e71eab-8630-4e09-b286-3de7e1562dd7 could not be found. Apr 09 21:00:15.984553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Returning 404 to user: Instance 81e71eab-8630-4e09-b286-3de7e1562dd7 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:15.985655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-28347881-3059-4d9a-ae47-f8e24e1e4bac tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7" status: 404 len: 111 microversion: 2.1 time: 0.030890 Apr 09 21:00:15.986210 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 853/1656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:15 2022] GET /compute/v2.1/servers/81e71eab-8630-4e09-b286-3de7e1562dd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:15.994143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:15.996360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.007239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.007974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.010770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.011911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.099946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.110234 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7abe9fa2-93cf-4934-b01e-5fda59705ca4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.539039 Apr 09 21:00:16.112856 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 804/1657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:15 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:16.128193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d16f6531-3eb3-4a9d-bd6d-1b7d660dae72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee8ad30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.189835 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d16f6531-3eb3-4a9d-bd6d-1b7d660dae72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.065932 Apr 09 21:00:16.190431 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 805/1658] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:16.204828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.205806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.213541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.215212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.217058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.217708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.249447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:16.292156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.305671 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb6f980d-070c-4090-b51b-bb445f49c200 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1536 microversion: 2.1 time: 0.317434 Apr 09 21:00:16.307150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 854/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:15 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1536 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:16.399176 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6f16213-b254-47aa-9eda-3db7695077be tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 204 len: 0 microversion: 2.1 time: 0.200363 Apr 09 21:00:16.399793 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 806/1660] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:16 2022] DELETE /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:16.408363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.408986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.417894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.420503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.430038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.430509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.560875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.561751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.574210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.574673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.575487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.575932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.585688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.598823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61e5274e-c390-4020-8dd6-84df229557f3 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1478 microversion: 2.1 time: 0.194746 Apr 09 21:00:16.599416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 855/1661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:16.607034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.607639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.614454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.615124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.616318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.616871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.867242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.869664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.882011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.883951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.885432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5aaa6ce-be3b-4cd3-949c-882831fad2f0 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1477 microversion: 2.25 time: 0.284956 Apr 09 21:00:16.886178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 856/1662] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:16.891531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0fae1dcb-d783-4616-8542-e892299d1471 req-a90c475f-c1a1-4e9d-acc8-b8ec8aad7ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b2094d-9261-4ac8-990d-b7103bd8ba3a", "name": "network-vif-plugged", "status": "completed", "tag": "061549ac-a3d6-4b74-9e58-6e99390adc84"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:16.899602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0fae1dcb-d783-4616-8542-e892299d1471 req-a90c475f-c1a1-4e9d-acc8-b8ec8aad7ff1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.900272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0fae1dcb-d783-4616-8542-e892299d1471 req-a90c475f-c1a1-4e9d-acc8-b8ec8aad7ff1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.902697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.905436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:16.906714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb2046ec-9e78-4e77-baaa-0eb2a97824f5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.350702 Apr 09 21:00:16.911383 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 807/1663] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:16.916323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.917153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.920098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0fae1dcb-d783-4616-8542-e892299d1471 req-a90c475f-c1a1-4e9d-acc8-b8ec8aad7ff1 service nova] Creating event network-vif-plugged:061549ac-a3d6-4b74-9e58-6e99390adc84 for instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a on nch1-master-1 Apr 09 21:00:16.925639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0fae1dcb-d783-4616-8542-e892299d1471 req-a90c475f-c1a1-4e9d-acc8-b8ec8aad7ff1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037980 Apr 09 21:00:16.925824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.926136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.926999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 857/1664] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:16.927122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.927349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.944522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:16.946125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: cef417c4-dee0-46c2-a42f-dc721270cc56] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:16.954726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.955532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.956625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:16.957417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:16.986129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance cef417c4-dee0-46c2-a42f-dc721270cc56 could not be found. Apr 09 21:00:16.987309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance cef417c4-dee0-46c2-a42f-dc721270cc56 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:16.988406 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dfd14609-af04-4f76-a489-c64290ecb7bf tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56" status: 404 len: 111 microversion: 2.1 time: 0.052301 Apr 09 21:00:16.989650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 858/1665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/cef417c4-dee0-46c2-a42f-dc721270cc56 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:17.000182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.002218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: 674593e6-b6e7-4b13-bbc2-06fa68785ee0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.010389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.011404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.012634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.013543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.031556 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance 674593e6-b6e7-4b13-bbc2-06fa68785ee0 could not be found. Apr 09 21:00:17.032679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance 674593e6-b6e7-4b13-bbc2-06fa68785ee0 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:17.033792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd79fe3a-716b-4b80-86ab-bcfef8c7d5b4 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0" status: 404 len: 111 microversion: 2.1 time: 0.039914 Apr 09 21:00:17.035000 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 859/1666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/674593e6-b6e7-4b13-bbc2-06fa68785ee0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:17.044375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25411d87-d994-4011-972d-a24ea6db648f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.080245 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-25411d87-d994-4011-972d-a24ea6db648f tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/426161ce-ad7e-4226-af71-00baafd1ea21" status: 204 len: 0 microversion: 2.1 time: 0.041183 Apr 09 21:00:17.082196 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 860/1667] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:00:17 2022] DELETE /compute/v2.1/os-server-groups/426161ce-ad7e-4226-af71-00baafd1ea21 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:17.099816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:17.106236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.106827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.113300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.113978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.114774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.115242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.127451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3c41961-75c4-4db6-8196-e33036762df4 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1970 microversion: 2.25 time: 0.214742 Apr 09 21:00:17.140538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 808/1668] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:16 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1970 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:17.145834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.147847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.154475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.154921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.156289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.156764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.158234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:17.264716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d99d0cd2-7ff8-4ef7-806f-f649c38eb894 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 204 len: 0 microversion: 2.1 time: 0.174897 Apr 09 21:00:17.268265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 861/1669] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:17 2022] DELETE /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:17.270966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.271567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.278568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.279162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.280341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.280473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.431655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:17.440986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0e6ad96-f741-4212-82d9-664731c97a82 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1310 microversion: 2.1 time: 0.299325 Apr 09 21:00:17.441928 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 809/1670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1310 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:17.460852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-beb757da-d2d9-4177-8950-2cb42c925246 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08efdd1f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.513745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-beb757da-d2d9-4177-8950-2cb42c925246 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.070420 Apr 09 21:00:17.514329 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 810/1671] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:17.524023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.524780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.532567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.533385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.534406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.534913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.552204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:17.570793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5fe3997d-656b-4e43-8443-e71082845f45 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1970 microversion: 2.25 time: 0.303920 Apr 09 21:00:17.571388 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 862/1672] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1970 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:17.590308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.592138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.599002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.599760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.600714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.601242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.779279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:17.791520 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a8b9268-bfe1-45c5-a7b5-329451505601 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1473 microversion: 2.1 time: 0.275158 Apr 09 21:00:17.792888 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 811/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:17.807865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.809598 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:00:17.809598 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:00:17.811297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.813154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.813926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:17.814236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.814778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.822608 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-778dd6b0-229d-46c6-adfd-0c3c2be3a202 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1536 microversion: 2.1 time: 0.240107 Apr 09 21:00:17.825477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 863/1674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1536 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:17.829123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:17.829777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.836243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.836688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.837499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.837925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.840643 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85b83ebe-edc8-4730-9ef2-c4a6309cd9ce tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037258 Apr 09 21:00:17.841504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 812/1675] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:00:17.851994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:17.854162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:17.861538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.861998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.862884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:17.863463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:17.887631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'flavor' on Instance uuid 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:17.901779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Going to try to live migrate instance to nch1-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 21:00:18.011617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:18.019756 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6af19e6-fc96-4e34-818f-8b620c9d5c64 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1478 microversion: 2.1 time: 0.195118 Apr 09 21:00:18.020428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 864/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:17 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:18.025403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:18.026400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:18.032863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.033343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.034117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.034555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.261062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:18.271335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:18.272869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:18.283625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51566809-cc9b-4a79-8f87-cc9fffafedbc tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.252684 Apr 09 21:00:18.284295 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 865/1677] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:18 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:18.460505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:18.461292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:18.468133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.468646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.469725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.470330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.624287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:18.632570 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23e3d218-ec52-4fc6-a001-855a0d9db190 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1494 microversion: 2.1 time: 0.178020 Apr 09 21:00:18.633447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 866/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:18 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:18.638195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-736cb297-b522-464e-ab5a-b40ca19bc2c5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f1f1700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:18.693781 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-736cb297-b522-464e-ab5a-b40ca19bc2c5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.058515 Apr 09 21:00:18.699916 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 867/1679] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:18 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:18.700711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:18.701296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:18.707624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.708156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.709022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.709549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.882490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7c1f4d3-abcd-4847-9eec-669b8bc62b23 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1645 microversion: 2.1 time: 0.186020 Apr 09 21:00:18.895386 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 868/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:18 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1645 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:18.903740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:18.904811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:18.914739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.915496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:18.916690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:18.917357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.247848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:19.256090 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe949f1c-4c75-4164-8bf2-a193bc1ac7a5 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1473 microversion: 2.1 time: 0.359157 Apr 09 21:00:19.256778 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 869/1681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:18 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1473 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:19.261465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:19.262075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:19.268685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.268877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.269704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.270220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.561329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:19.569930 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba8ac6f8-4f22-4cd9-b9b5-af2457117211 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1536 microversion: 2.1 time: 0.312160 Apr 09 21:00:19.585448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 870/1682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:19 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1536 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:19.591226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:19.592948 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:00:19.592948 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:00:19.595103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.597947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.598820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.599278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.630200 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed7b321d-2500-468b-8e79-852dbb39dcf9 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043277 Apr 09 21:00:19.637986 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 871/1683] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 21:00:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:19.643117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-unplugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:19.652583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.652583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.675114 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] Creating event network-vif-unplugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:00:19.682835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] Instance dd75b541-d45b-4a01-a4fb-7122b67286c1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:00:19.690840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-df0b8d3e-2a26-4c7d-94fd-e6335adec26d req-d6189307-bbdd-4599-9f52-b3ee4177d2e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051305 Apr 09 21:00:19.695480 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 872/1684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:19.701975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:19.703593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:19.712324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.714364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.715380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.716032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.934858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:19.942917 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ce06822-67fd-4c1b-bf30-a804b549b39e tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1478 microversion: 2.1 time: 0.245940 Apr 09 21:00:19.945227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 873/1685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:19 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1478 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:19.955384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:19.955977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:19.969857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.973251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:19.974851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:19.976549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:20.309156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:20.318638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:20.320225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:20.336169 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b6cdf36-a1c5-4f7b-a564-a63483cd8eb2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.370014 Apr 09 21:00:20.336767 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 874/1686] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:19 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:20.341618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86489236-f2ba-4d43-9f62-f940ba1bac4b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f1ddf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:20.421983 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86489236-f2ba-4d43-9f62-f940ba1bac4b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.084025 Apr 09 21:00:20.422777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 875/1687] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:20 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:20.434175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:20.443522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:20.464995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:20.465485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:20.466295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:20.466711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:20.996328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:21.007641 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ef0caf8-6751-435a-a250-72716c20899d tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1473 microversion: 2.1 time: 0.583928 Apr 09 21:00:21.008604 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 876/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:20 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1473 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:21.014138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:21.014874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:21.021710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:21.022364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:21.023446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:21.024207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:22.066950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:22.083926 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7a747de-faf6-4b3e-aa1e-70edee84abd3 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1529 microversion: 2.1 time: 1.073361 Apr 09 21:00:22.084835 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 877/1689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:21 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1529 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:22.089531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:22.090330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:22.103198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:22.103655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:22.104463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:22.104908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:22.604614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16441a7999c149ff9dd66e0b3a3a95b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23df4eef46ae4894870e050990d597f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:22.614726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9c96585-e8a0-4581-b3c1-80f154a71192 tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 200 len: 1478 microversion: 2.1 time: 0.528756 Apr 09 21:00:22.615346 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 878/1690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:22 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 1478 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:22.630553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e65996e1-1e66-4a23-ac8b-882a962e48df", "device": "/dev/xvdb"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:22.631734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:22.646846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:22.647302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:22.648120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:22.648563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.174013 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e289c72-f51d-4d41-a7f1-e70ba37f979d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0/action" status: 202 len: 0 microversion: 2.25 time: 5.325680 Apr 09 21:00:23.178730 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 813/1691] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:00:17 2022] POST /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0/action => generated 0 bytes in 5331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:00:23.186614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:23.191510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:23.195158 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce913936-5195-4ec5-b264-015a140a7ea0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "POST /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577800 Apr 09 21:00:23.196635 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 879/1692] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:00:22 2022] POST /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:23.213557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53939ed2-3415-49d3-a864-ce70540e3f3b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ef7f040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:23.228566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.230410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.231512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.232197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.321066 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53939ed2-3415-49d3-a864-ce70540e3f3b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.122579 Apr 09 21:00:23.321477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 880/1693] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:23 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:23.337485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:23.338238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:23.355948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.359709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.365809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.370935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.468557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.469130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.469630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lazy-loading 'fault' on Instance uuid acad92b7-b70e-44e1-9c3d-2938f626d037 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:23.633536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcc50583d0c4b9aa9d9c9b7ad87a576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21b82d625c249269c02db9bbe700c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:23.645118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e822e6b-0201-4315-ae27-1919bd88e677 tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 200 len: 1307 microversion: 2.1 time: 0.319079 Apr 09 21:00:23.651618 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 881/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:23 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:23.657603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:23.661532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:23.690539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.697557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:23.700681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:23.701360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.006033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.015467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.017046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.022520 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57002d01-73e9-4cec-92c3-38763375b807 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.842161 Apr 09 21:00:24.028908 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 814/1695] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:23 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:24.045018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-37703f05-064c-440d-abab-03a7fd924b86 req-1084d5a3-c5b9-4ae3-bcb5-02bb21362861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81535f89-50ee-497e-b085-84ab9630fee3", "name": "network-vif-deleted", "tag": "d2b75502-aefa-4b5b-8bee-c8fc14cee225"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:24.078295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-37703f05-064c-440d-abab-03a7fd924b86 req-1084d5a3-c5b9-4ae3-bcb5-02bb21362861 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.078720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-37703f05-064c-440d-abab-03a7fd924b86 req-1084d5a3-c5b9-4ae3-bcb5-02bb21362861 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.103237 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-37703f05-064c-440d-abab-03a7fd924b86 req-1084d5a3-c5b9-4ae3-bcb5-02bb21362861 service nova] Creating event network-vif-deleted:d2b75502-aefa-4b5b-8bee-c8fc14cee225 for instance 81535f89-50ee-497e-b085-84ab9630fee3 on nch1-master-1 Apr 09 21:00:24.119966 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-37703f05-064c-440d-abab-03a7fd924b86 req-1084d5a3-c5b9-4ae3-bcb5-02bb21362861 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078086 Apr 09 21:00:24.120863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 815/1696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:24.138487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d3f03000-f938-4961-befb-c840cfcdd4fc req-6b65d3b4-8ec0-430a-87c5-b8589c64968e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-plugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:24.160566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d3f03000-f938-4961-befb-c840cfcdd4fc req-6b65d3b4-8ec0-430a-87c5-b8589c64968e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.164351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d3f03000-f938-4961-befb-c840cfcdd4fc req-6b65d3b4-8ec0-430a-87c5-b8589c64968e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.202763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d3f03000-f938-4961-befb-c840cfcdd4fc req-6b65d3b4-8ec0-430a-87c5-b8589c64968e service nova] Creating event network-vif-plugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:00:24.210578 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d3f03000-f938-4961-befb-c840cfcdd4fc req-6b65d3b4-8ec0-430a-87c5-b8589c64968e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085608 Apr 09 21:00:24.213830 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 816/1697] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:24.219607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:24.232503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:24.249843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.250737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.251723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.252318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.411833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.421000 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c6c47af-7fe0-44cb-93ee-f3135e0016d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1529 microversion: 2.1 time: 0.768007 Apr 09 21:00:24.431171 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 882/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:23 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1529 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:24.461664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:24.462394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] [instance: 81535f89-50ee-497e-b085-84ab9630fee3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:24.472639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.473218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.474084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.474601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.509787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] HTTP exception thrown: Instance 81535f89-50ee-497e-b085-84ab9630fee3 could not be found. Apr 09 21:00:24.510524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] Returning 404 to user: Instance 81535f89-50ee-497e-b085-84ab9630fee3 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:24.511460 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d4ff2eb-9918-48f1-bd3d-576e3e5e318d tempest-ServersAdminNegativeTestJSON-547942144 tempest-ServersAdminNegativeTestJSON-547942144-project] 10.222.0.30 "GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3" status: 404 len: 111 microversion: 2.1 time: 0.078457 Apr 09 21:00:24.512253 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 883/1699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:24 2022] GET /compute/v2.1/servers/81535f89-50ee-497e-b085-84ab9630fee3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:24.519223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15363348-0a0e-4677-8b9d-920b08809099 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ef7fee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:24.595234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-15363348-0a0e-4677-8b9d-920b08809099 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.081728 Apr 09 21:00:24.601155 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 884/1700] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:24 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:24.609385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6fd62ac-31d6-46a6-9f2d-1d07e6777a50 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:24.622230 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:00:24.622230 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:00:24.646608 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c6fd62ac-31d6-46a6-9f2d-1d07e6777a50 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] HTTP exception thrown: Flavor 4b30fb8f-c92b-427b-9397-3a5d308020a6 could not be found. Apr 09 21:00:24.647610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6fd62ac-31d6-46a6-9f2d-1d07e6777a50 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Returning 404 to user: Flavor 4b30fb8f-c92b-427b-9397-3a5d308020a6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:24.648684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6fd62ac-31d6-46a6-9f2d-1d07e6777a50 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/4b30fb8f-c92b-427b-9397-3a5d308020a6" status: 404 len: 109 microversion: 2.1 time: 0.045919 Apr 09 21:00:24.649526 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 885/1701] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:24 2022] DELETE /compute/v2.1/flavors/4b30fb8f-c92b-427b-9397-3a5d308020a6 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:24.669170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:24.669816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] [instance: acad92b7-b70e-44e1-9c3d-2938f626d037] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:24.691112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.692064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.693157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:24.694370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:24.731787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] HTTP exception thrown: Instance acad92b7-b70e-44e1-9c3d-2938f626d037 could not be found. Apr 09 21:00:24.750821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] Returning 404 to user: Instance acad92b7-b70e-44e1-9c3d-2938f626d037 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:24.753486 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-674b259a-7a23-496c-ad0c-fe2acf773e9c tempest-ServersOnMultiNodesTest-271080827 tempest-ServersOnMultiNodesTest-271080827-project] 10.222.0.30 "GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037" status: 404 len: 111 microversion: 2.1 time: 0.089684 Apr 09 21:00:24.760856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 886/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:24 2022] GET /compute/v2.1/servers/acad92b7-b70e-44e1-9c3d-2938f626d037 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:00:24.913992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1085235197", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:24.953864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.962414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.975113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:24.979824 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c321fac1-f241-484e-a983-66420e12b879 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 0.764514 Apr 09 21:00:24.981475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 817/1703] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:24 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:25.018737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:00:25.047523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:25.048561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:25.060561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:25.061312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:25.064848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:25.068914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.200424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.210747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.220188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.221635 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d7019af-b0b1-43a6-a5d3-4a6f780dae3c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 1.178509 Apr 09 21:00:26.222386 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 818/1704] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:25 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:00:26.239384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a7fa513a-e46a-460b-91da-f1616acda789 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f017ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:26.328427 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a7fa513a-e46a-460b-91da-f1616acda789 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.104738 Apr 09 21:00:26.334570 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 819/1705] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:26 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:26.341117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:26.341613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:00:26.342565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:00:26.343206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:00:26.343829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:00:26.343953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:26.344507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:00:26.359914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:26.360461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.365505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:26.366787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.367950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:26.368649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.371985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:26.372453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.409423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:26.416786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Getting quotas for user 5ab294d1890047aababb87b3a865a14c and project e77d97d277f245d4822a646af7d5f50d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:26.467727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:00:26.470226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:00:26.571535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-556c37f0-ed7d-4c58-beb5-ff28545d45f8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661385 Apr 09 21:00:26.573752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 887/1706] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:00:26.586993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-35bbd6bc-b546-4ef0-9103-17c141154f31 req-8ef5b69f-ea51-48ae-9014-a387315035cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acad92b7-b70e-44e1-9c3d-2938f626d037", "name": "network-vif-deleted", "tag": "ea23a674-89c2-48ea-9d14-9a710c1b9f16"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:26.623146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-35bbd6bc-b546-4ef0-9103-17c141154f31 req-8ef5b69f-ea51-48ae-9014-a387315035cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:26.623803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-35bbd6bc-b546-4ef0-9103-17c141154f31 req-8ef5b69f-ea51-48ae-9014-a387315035cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:26.650879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-35bbd6bc-b546-4ef0-9103-17c141154f31 req-8ef5b69f-ea51-48ae-9014-a387315035cd service nova] Creating event network-vif-deleted:ea23a674-89c2-48ea-9d14-9a710c1b9f16 for instance acad92b7-b70e-44e1-9c3d-2938f626d037 on nch1-master-1 Apr 09 21:00:26.659237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-35bbd6bc-b546-4ef0-9103-17c141154f31 req-8ef5b69f-ea51-48ae-9014-a387315035cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079210 Apr 09 21:00:26.674158 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 888/1707] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:26.687986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89e5c858-9fc0-4bea-8a28-afa204c92ee9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:26.689156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89e5c858-9fc0-4bea-8a28-afa204c92ee9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:26.877443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89e5c858-9fc0-4bea-8a28-afa204c92ee9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.885602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89e5c858-9fc0-4bea-8a28-afa204c92ee9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1213 microversion: 2.1 time: 0.209607 Apr 09 21:00:26.886819 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 889/1708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:26 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:26.899576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.916756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.918928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:26.920757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc812894-6552-4327-b12f-baa18559dbab tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 0.589546 Apr 09 21:00:26.922216 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 820/1709] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:26 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:27.246143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:27.247350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:27.283720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:27.286807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:27.290551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:27.297556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:27.343759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d6d37a1-fc04-409c-a6bd-937daf6da97f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f017790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:27.488757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d6d37a1-fc04-409c-a6bd-937daf6da97f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.149317 Apr 09 21:00:27.490889 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 821/1710] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:27 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:27.903140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd013459-67c1-4395-95e2-e5a717b21bec tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:27.904502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd013459-67c1-4395-95e2-e5a717b21bec tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:27.952394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:27.965718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:27.967256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:27.976685 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe55cec0-10c7-4e20-b324-5710644d39e2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.738823 Apr 09 21:00:27.980513 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 890/1711] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:27 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:28.003139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:28.010035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:28.025853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.029613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.030632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.031789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.094769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd013459-67c1-4395-95e2-e5a717b21bec tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:28.147718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd013459-67c1-4395-95e2-e5a717b21bec tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1213 microversion: 2.1 time: 0.244230 Apr 09 21:00:28.147718 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 822/1712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:27 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:28.164531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:28.167684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:28.178759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.182848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.182848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.182848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.565830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:28.582571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:28.585785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:28.589767 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0dc5d6b3-b86f-4e1d-b3c6-300b4bc21d50 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 0.605893 Apr 09 21:00:28.592512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 891/1713] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:27 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:28.600817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c52f472-6556-44d6-87d1-f78ca2f0d43a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f1dd790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:28.689653 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf047075-e4fc-4926-a2af-2a75f540fb51 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1691 microversion: 2.1 time: 0.539493 Apr 09 21:00:28.693779 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c52f472-6556-44d6-87d1-f78ca2f0d43a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.098691 Apr 09 21:00:28.694419 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 892/1714] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:28 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:28.703797 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 823/1715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:28 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1691 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:28.711846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:28.722224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:28.736203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.737213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.739509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:28.741279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:28.851479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lazy-loading 'flavor' on Instance uuid 7e94f544-180a-47fe-9df7-06afcdf7ca2d {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:28.899473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Going to try to live migrate instance to nch1-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 21:00:29.469843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1443771366", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:29.568624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] validate_networks() for [('61e5f5f4-430e-4ab0-b6e0-c7f372b7c7b4', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:00:30.362551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:00:30.363183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:00:30.364020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:00:30.364592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:00:30.365221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:00:30.381446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:30.386161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:30.387457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:30.387795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:30.447542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Getting quotas for project 8584541985ac44cc923c89a5a518ec32. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:30.463487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Getting quotas for user 08995e63d5ec446bbcf643822d5f37c7 and project 8584541985ac44cc923c89a5a518ec32. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:30.490787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:00:30.503976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:00:30.619506 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52580e9a-1965-4bdb-bd5b-fcacb93494a8 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.923315 Apr 09 21:00:30.620178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 893/1716] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:00:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:00:30.632994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:30.641800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:30.654825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:30.656357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:30.659251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:30.660441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:31.277531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:31.292382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:31.316304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:31.323805 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cdbdfab9-4437-4fa2-b459-db58b3bf965d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.702541 Apr 09 21:00:31.342874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 894/1717] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:30 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:31.371723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:31.372695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:31.390554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:31.391083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:31.391940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:31.392385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:32.757793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:32.766994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e32cde4b-6046-44de-82ff-094f552b9b4d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 1.422596 Apr 09 21:00:32.767586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 895/1718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:31 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:32.785534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:32.786152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:32.825909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:32.829206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:32.833181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:32.836726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:33.860130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:33.868845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:33.870389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:33.871557 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3176a716-d8f4-446d-8028-2a7a866f9f6a tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 1.103054 Apr 09 21:00:33.872141 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 896/1719] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:32 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:33.906120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6a063f9-cee4-46a4-8861-128ed287100e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eadc040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:34.012699 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6a063f9-cee4-46a4-8861-128ed287100e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.139326 Apr 09 21:00:34.013697 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 897/1720] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:33 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:34.033977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:34.038302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:34.052691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:34.057777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:34.066243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:34.070427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:34.104479 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0b96d96-85ad-48c7-af64-62b30cf39378 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/action" status: 202 len: 0 microversion: 2.1 time: 5.398391 Apr 09 21:00:34.105136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 824/1721] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:28 2022] POST /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/action => generated 0 bytes in 5401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:00:34.527230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1594796871", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:34.657842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:00:34.768108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:34.778924 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8bc779f2-b8aa-43c8-bf46-1f7e3ac3a1c6 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1281 microversion: 2.1 time: 0.761645 Apr 09 21:00:34.779763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 898/1722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:34 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1281 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:35.000323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-56bd46fa-57ef-4340-b443-4faddd7662ee req-07199c8b-cae9-4b32-9aa9-d3f51c947e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "2447064d-f2f6-4455-bc1d-f66ad73dad67"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:35.022901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-56bd46fa-57ef-4340-b443-4faddd7662ee req-07199c8b-cae9-4b32-9aa9-d3f51c947e86 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.023701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-56bd46fa-57ef-4340-b443-4faddd7662ee req-07199c8b-cae9-4b32-9aa9-d3f51c947e86 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.067575 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-56bd46fa-57ef-4340-b443-4faddd7662ee req-07199c8b-cae9-4b32-9aa9-d3f51c947e86 service nova] Creating event network-vif-plugged:2447064d-f2f6-4455-bc1d-f66ad73dad67 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:35.080149 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-56bd46fa-57ef-4340-b443-4faddd7662ee req-07199c8b-cae9-4b32-9aa9-d3f51c947e86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298914 Apr 09 21:00:35.084101 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 899/1723] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:35.093055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:35.100441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:35.117891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.118663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.119769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.120370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.335913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:00:35.336563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:00:35.337259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:00:35.337713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:00:35.338142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:00:35.357219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.358274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.362067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.363093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.419706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Getting quotas for project fb7b11a68b314c95b8ecc93cd51356b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:35.432710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Getting quotas for user 1ce74147326849bc8bf26bcfa9e30276 and project fb7b11a68b314c95b8ecc93cd51356b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:35.478632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:00:35.486114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:00:35.587496 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7b730eb-0cf3-4e7f-8af4-09884c613261 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477702 Apr 09 21:00:35.588408 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 825/1724] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:00:35.597246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cfa07250-77fc-45bd-b634-e92533aa6201 req-0a675d1a-2f9d-44e0-8d90-3c941f2edd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea967e2-2ce1-496d-9d15-58e58f3b57a0", "name": "network-vif-unplugged", "status": "completed", "tag": "4101014a-f45a-4573-a194-f9b7022a29b0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:35.621938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cfa07250-77fc-45bd-b634-e92533aa6201 req-0a675d1a-2f9d-44e0-8d90-3c941f2edd6c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.622643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cfa07250-77fc-45bd-b634-e92533aa6201 req-0a675d1a-2f9d-44e0-8d90-3c941f2edd6c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.650291 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cfa07250-77fc-45bd-b634-e92533aa6201 req-0a675d1a-2f9d-44e0-8d90-3c941f2edd6c service nova] Creating event network-vif-unplugged:4101014a-f45a-4573-a194-f9b7022a29b0 for instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 on nch2-master-1 Apr 09 21:00:35.657607 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cfa07250-77fc-45bd-b634-e92533aa6201 req-0a675d1a-2f9d-44e0-8d90-3c941f2edd6c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067692 Apr 09 21:00:35.659880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 826/1725] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:35.665534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:35.676780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:35.692050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.692823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.693849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.694481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.770968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:35.788152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:35.790391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:35.792982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5291cd56-cbff-4e41-9a96-e9151fe04008 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.707546 Apr 09 21:00:35.807994 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 900/1726] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:35 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:35.815908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:35.823509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:35.835917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.838730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:35.844046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:35.844712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:36.882666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:36.892309 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9f9d52e-f8b7-4c04-ac31-dd9fa4da4fcc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 1.230777 Apr 09 21:00:36.892969 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 827/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:35 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:37.088550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:37.097170 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d41f6d9d-37ba-48c1-836a-8490b65f38c3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 1.287619 Apr 09 21:00:37.097764 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 901/1728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:35 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:37.135609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c39d7c1-8ad6-49fb-99c8-94db47b6854e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f6f8040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:37.211802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:37.212696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:37.228755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:37.248971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:37.252742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:37.254286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:37.275134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c39d7c1-8ad6-49fb-99c8-94db47b6854e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.167691 Apr 09 21:00:37.278498 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 902/1729] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:37 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:37.302442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:37.302721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:37.344645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:37.349672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:37.350798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:37.352561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:38.214147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:38.237721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3dcb9817-73bd-4b6d-8272-6970cfa826d1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1266 microversion: 2.1 time: 0.957687 Apr 09 21:00:38.244825 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 903/1730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:37 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1266 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:38.273768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:38.275423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:38.294094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:38.296259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:38.298248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:38.300298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.045929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.063557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.067869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.072231 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b77376cc-873a-4e44-98c9-e9c1fdc41c4f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 2.166042 Apr 09 21:00:39.073578 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 828/1731] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:36 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:39.085640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:39.089630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:39.111709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:39.115070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.116626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:39.119461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.833597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.849768 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71940dcb-f85f-43ad-b82e-26666a474b2b tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 1.603280 Apr 09 21:00:39.860507 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 904/1732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:38 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:39.876372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "edac2419-450b-406e-b5db-84cf807a3c10"}, {"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "4d183039-0082-437f-a23a-644fd46b056d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:39.878169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.898325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.905866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:39.910317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:39.916764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.918184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd769bcb-0649-431d-b717-3911dfab3c2e tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.840602 Apr 09 21:00:39.932387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 829/1733] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:39 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:39.939387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:39.940611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:39.961652 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] Creating event network-vif-plugged:edac2419-450b-406e-b5db-84cf807a3c10 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:39.962508 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] Creating event network-vif-plugged:4d183039-0082-437f-a23a-644fd46b056d for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:39.965946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:39.966411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.967235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:39.967732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:39.988981 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0d14509e-6631-4de6-8d17-37f3921e6045 req-245e597f-9eca-4f15-8cbc-903cd3821ec0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127201 Apr 09 21:00:39.992935 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 905/1734] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:40.008311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea967e2-2ce1-496d-9d15-58e58f3b57a0", "tag": "4101014a-f45a-4573-a194-f9b7022a29b0"}, {"name": "network-changed", "server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:40.030542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.031310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.046865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] Creating event network-changed:4101014a-f45a-4573-a194-f9b7022a29b0 for instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 on nch2-master-1 Apr 09 21:00:40.051641 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] Creating event network-changed:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:00:40.071982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d5de3cb7-ca58-484a-8ec0-005e520a4be0 req-8a3c5b56-1c8e-41b2-9b80-1fbd58b482f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077382 Apr 09 21:00:40.077279 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 906/1735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:40.094034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:40.097810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:40.113467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.114248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.116320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.117018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.463402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:40.492035 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7213a3a8-b0ef-4e8c-abf7-cdcd15b429b4 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 0.556285 Apr 09 21:00:40.506349 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 830/1736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:39 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:40.506349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54e41cef-3cff-4325-94f4-c94dcd977621 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eea38b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:40.605930 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54e41cef-3cff-4325-94f4-c94dcd977621 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1413 microversion: 2.1 time: 0.111107 Apr 09 21:00:40.607203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 831/1737] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:40 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:40.620696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:40.621729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:40.629973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.630709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.631733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.632344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.773128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:40.797242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-62e2582a-f02c-4fd9-9795-13c2d3988be2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.714574 Apr 09 21:00:40.821356 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 907/1738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:40 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:40.823909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:40.832698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6898dd06-bdcd-4844-beaf-34591e66aa50 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1272 microversion: 2.1 time: 0.218280 Apr 09 21:00:40.833341 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 832/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:40 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:40.859675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:40.860304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:40.876350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.877240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:40.878627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:40.879409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.046003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-675b8d2a-78ef-46ea-bfa5-c5db115d95dc req-d64c1d83-9e9d-444b-87f3-ce576d1a31d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:41.060394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-675b8d2a-78ef-46ea-bfa5-c5db115d95dc req-d64c1d83-9e9d-444b-87f3-ce576d1a31d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.064634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-675b8d2a-78ef-46ea-bfa5-c5db115d95dc req-d64c1d83-9e9d-444b-87f3-ce576d1a31d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.097475 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-675b8d2a-78ef-46ea-bfa5-c5db115d95dc req-d64c1d83-9e9d-444b-87f3-ce576d1a31d2 service nova] Creating event network-changed:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:00:41.113466 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-675b8d2a-78ef-46ea-bfa5-c5db115d95dc req-d64c1d83-9e9d-444b-87f3-ce576d1a31d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285411 Apr 09 21:00:41.116418 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 908/1740] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:41.132723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:41.140642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:41.161479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.165426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.167257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.168191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.468513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:41.483728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:41.485571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:41.499720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-514d0967-de41-491c-a04b-964783692297 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 0.649363 Apr 09 21:00:41.500690 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 833/1741] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:40 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:41.505666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:41.506532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:41.519591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.520029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.521736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.526677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.933102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:41.950596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b836a65a-c9bb-40b7-a8a4-97d797e90e7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 0.830795 Apr 09 21:00:41.951494 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 909/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:41 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:41.956558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:41.957425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:41.969711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.974853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:41.976131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:41.977106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:42.235913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:42.255199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:42.256745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:42.258179 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26bf278b-89da-48f6-813b-b0067156857c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.756267 Apr 09 21:00:42.269318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 834/1743] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:41 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:42.276148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02ad3321-3be7-44aa-a552-db568bdec387 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f038790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:42.355010 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02ad3321-3be7-44aa-a552-db568bdec387 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1422 microversion: 2.1 time: 0.084153 Apr 09 21:00:42.362864 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 835/1744] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:42 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:42.368237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:42.369155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:42.376308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:42.376997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:42.378010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:42.378776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:42.526672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:42.549798 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c4ec4da4-98a9-40d7-85f4-c8092baccc72 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 0.593123 Apr 09 21:00:42.552895 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 910/1745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:41 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:42.562407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:42.563752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:42.576209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:42.578416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:42.582085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:42.582799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:43.008063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:43.017531 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0574ffd8-beb2-4002-a835-d3620ab3c1c1 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.462830 Apr 09 21:00:43.023867 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 911/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:42 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:43.037914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "598fea91-f00b-41e4-8273-ec325cadb0f1"}, {"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "98efa2b7-5e44-4da7-8cbc-fbc1db0c459e"}, {"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "87ea195a-9ea5-4807-8aeb-44650ead0f55"}, {"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-plugged", "status": "completed", "tag": "aeadbd1f-8d76-4ad3-84a7-50139f5852c5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:43.060243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:43.061018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:43.079262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Creating event network-vif-plugged:598fea91-f00b-41e4-8273-ec325cadb0f1 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:43.080093 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Creating event network-vif-plugged:98efa2b7-5e44-4da7-8cbc-fbc1db0c459e for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:43.080814 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Creating event network-vif-plugged:87ea195a-9ea5-4807-8aeb-44650ead0f55 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:43.081597 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] Creating event network-vif-plugged:aeadbd1f-8d76-4ad3-84a7-50139f5852c5 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:43.089543 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6e4e2db2-7101-447b-ae64-3190bc1309aa req-0f830434-5e20-41e9-ab7d-4db37baf8123 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.063636 Apr 09 21:00:43.091821 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 912/1747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:43.099243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fc26ade-4a2b-430e-b96e-81488740611d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee621f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:43.202931 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fc26ade-4a2b-430e-b96e-81488740611d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 200 len: 1422 microversion: 2.1 time: 0.108938 Apr 09 21:00:43.205289 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 913/1748] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:00:43 2022] GET /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:43.214345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:43.215635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:43.239107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:43.239552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:43.240351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:43.240811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:43.553183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:43.590045 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a020232a-a888-484f-8254-55535b0007b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 1.225101 Apr 09 21:00:43.604245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 836/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:42 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:43.610965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:43.612353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:43.620500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:43.621371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:43.622854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:43.623577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:44.224659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:44.233955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:44.235873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:44.237404 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c1a2180-567c-4613-a2b7-bc616acd439d tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1487 microversion: 2.25 time: 1.030604 Apr 09 21:00:44.238189 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 914/1750] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:43 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1487 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:44.254642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b18021e-004f-4ef0-939e-46d1d53b41ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee62550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:44.370626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:44.382990 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2343b7a8-0d65-4b02-9b00-818eea130f72 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 0.775995 Apr 09 21:00:44.383604 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 837/1751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:43 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:44.393673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:44.394345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:44.413719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:44.414593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:44.415640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:44.416583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.148056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b18021e-004f-4ef0-939e-46d1d53b41ef tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 204 len: 0 microversion: 2.1 time: 0.908510 Apr 09 21:00:45.148683 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 915/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:44 2022] DELETE /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 0 bytes in 910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:45.154485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:45.155506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:45.172251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.172753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.174312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.174974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.230907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:45.252242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:45.256794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:45.258769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4aba121b-8f96-4dde-908d-9d9319e366da tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 1878 microversion: 2.32 time: 0.874140 Apr 09 21:00:45.267013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 838/1753] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:44 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 1878 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:45.274470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:45.275080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:45.282555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.283290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.285242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.285964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.876955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:45.894146 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f70f1f0-3848-43ad-8223-05504ac34e7f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 0.743979 Apr 09 21:00:45.895323 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 916/1754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:45 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:45.903796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:45.904678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:45.921704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:45.923061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.923466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.924254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.924913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.938978 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0943af94-a1a8-4c45-b4a2-2e5c71cb0c77 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.669937 Apr 09 21:00:45.939599 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 839/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:45 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:45.958938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6ae5c19c-9f2d-4877-a7d4-83336462538f req-cc1d40c0-b671-46cf-b075-6b11d644f093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b2094d-9261-4ac8-990d-b7103bd8ba3a", "name": "network-vif-unplugged", "status": "completed", "tag": "061549ac-a3d6-4b74-9e58-6e99390adc84"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:45.967736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6ae5c19c-9f2d-4877-a7d4-83336462538f req-cc1d40c0-b671-46cf-b075-6b11d644f093 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:45.968409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6ae5c19c-9f2d-4877-a7d4-83336462538f req-cc1d40c0-b671-46cf-b075-6b11d644f093 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:45.989500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6ae5c19c-9f2d-4877-a7d4-83336462538f req-cc1d40c0-b671-46cf-b075-6b11d644f093 service nova] Creating event network-vif-unplugged:061549ac-a3d6-4b74-9e58-6e99390adc84 for instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a on nch1-master-1 Apr 09 21:00:45.996774 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6ae5c19c-9f2d-4877-a7d4-83336462538f req-cc1d40c0-b671-46cf-b075-6b11d644f093 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042628 Apr 09 21:00:45.998102 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 840/1756] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:46.004424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:46.005071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:46.018149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.018600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.019604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.020203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.053340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:46.176645 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-59840c75-29be-4a7d-b9b3-69043360f7e9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 204 len: 0 microversion: 2.1 time: 0.165072 Apr 09 21:00:46.179250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 841/1757] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:00:45 2022] DELETE /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:00:46.198886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:46.200249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:46.207734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.208183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.210412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.210846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.423517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:46.435058 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34bbc23a-adb4-4686-bad1-e0357baed0d3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.538309 Apr 09 21:00:46.446038 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 917/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:45 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:46.450908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:46.451642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:46.459068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.459609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.460623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.461304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.737595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:46.757919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:46.762439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:46.763683 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2a2bcfc-aa36-45c0-bb7a-47d3264530b1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1477 microversion: 2.25 time: 0.582787 Apr 09 21:00:46.764301 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 842/1759] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:46 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1477 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:46.777398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:46.778925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:46.787119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.787706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:46.788880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:46.789756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.233744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:47.244571 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-375b9ec8-679f-4fb0-9511-09e46b07825a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 0.797605 Apr 09 21:00:47.245619 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 918/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:46 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:47.320428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ac540020-dcb5-47b5-aefe-16492c9a82be req-80076157-d86f-459f-b00c-eacc11b1bf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46fcb37-e8b8-47d8-bf95-d38db3ed80f9", "tag": "f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:47.330440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ac540020-dcb5-47b5-aefe-16492c9a82be req-80076157-d86f-459f-b00c-eacc11b1bf9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.330884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ac540020-dcb5-47b5-aefe-16492c9a82be req-80076157-d86f-459f-b00c-eacc11b1bf9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.343294 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ac540020-dcb5-47b5-aefe-16492c9a82be req-80076157-d86f-459f-b00c-eacc11b1bf9d service nova] Creating event network-changed:f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721 for instance d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 on nch2-master-1 Apr 09 21:00:47.348757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ac540020-dcb5-47b5-aefe-16492c9a82be req-80076157-d86f-459f-b00c-eacc11b1bf9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101655 Apr 09 21:00:47.349419 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 919/1761] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:47.354966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-893656887", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "78a6d2d3-bb80-48c0-a446-3fd1d832ea3c"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:47.375474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:47.390434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:47.392292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:47.394098 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec4c212f-9aab-4c15-b902-c98edc861a54 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2828 microversion: 2.32 time: 0.628129 Apr 09 21:00:47.395073 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 843/1762] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:46 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2828 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:47.400844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78a85756-f3fc-481b-bbee-40c43115784d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '.version_select at 0x7fb08f0faaf0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:47.403842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78a85756-f3fc-481b-bbee-40c43115784d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.404294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78a85756-f3fc-481b-bbee-40c43115784d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.425280 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78a85756-f3fc-481b-bbee-40c43115784d tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 4470 microversion: 2.25 time: 0.028631 Apr 09 21:00:47.426019 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 844/1763] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Apr 9 21:00:47 2022] GET /compute/v2.1/os-migrations => generated 4470 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:47.432075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:47.432918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:47.442838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] validate_networks() for [('78a6d2d3-bb80-48c0-a446-3fd1d832ea3c', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:00:47.443599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.444058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.445282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.445977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.873784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:47.884774 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e61c2cbf-00cf-40f3-a66a-92c0b5021278 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 0.457344 Apr 09 21:00:47.885974 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 845/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:47 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:47.891429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:47.892050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:47.900176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.900673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:47.901909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:47.902424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.376724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:48.388047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78dbce1c-dbae-4b48-900c-b415be31cbd2 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.500932 Apr 09 21:00:48.389907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 846/1765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:47 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:48.395638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:48.396595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:48.403385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.404215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.405623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.406018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.740710 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2490bdfd-1923-4dae-bde5-6763982d1c4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.348763 Apr 09 21:00:48.761642 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 847/1766] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:00:48 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390/os-interface => generated 1830 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:48.772132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:48.773543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:48.789196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.791985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.795075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.795721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.847704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:00:48.848213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:00:48.848628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:00:48.849138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:00:48.849553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:00:48.868296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.870265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.872016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:48.874871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:48.921230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:00:48.933844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for user 33746e27054c4f1db976d4a4ae44e073 and project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:00:49.012748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:00:49.016431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:00:49.087136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce7b99be-8807-4f8e-bef8-eb20de4e71b8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735709 Apr 09 21:00:49.088673 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 920/1767] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:00:49.096412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:49.098463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:49.116307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] Lazy-loading 'services' on Instance uuid 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:49.118389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.119658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.122175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.124310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.179803 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fd0852a-4b37-4aa5-ba82-7b66c59d36f5 tempest-LiveAutoBlockMigrationV225Test-2100307713 tempest-LiveAutoBlockMigrationV225Test-2100307713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1970 microversion: 2.25 time: 0.415430 Apr 09 21:00:49.181330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 848/1768] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:48 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1970 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:49.189344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-plugged", "status": "completed", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}, {"server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "name": "network-vif-plugged", "status": "completed", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:49.210699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.213258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.237112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] Creating event network-vif-plugged:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:00:49.238132 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] Creating event network-vif-plugged:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:00:49.248526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-bfca8997-340b-4a91-9917-34ae2c75914a req-dabd981e-f068-45f2-bdf2-a02143bd5794 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065082 Apr 09 21:00:49.250080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 849/1769] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:49.261892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:49.263859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:49.273507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.274226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.277394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.278049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.399383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:49.411705 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3344d671-36f0-4e25-81b7-45b022d5ca5b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.321502 Apr 09 21:00:49.412747 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 921/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:49 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:49.427048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-54630b75-b41d-477e-bb91-4b221dd724f1 req-ef5b6aeb-199f-4f1a-945e-a5ce03d71d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b2094d-9261-4ac8-990d-b7103bd8ba3a", "name": "network-vif-deleted", "tag": "061549ac-a3d6-4b74-9e58-6e99390adc84"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:49.454745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-54630b75-b41d-477e-bb91-4b221dd724f1 req-ef5b6aeb-199f-4f1a-945e-a5ce03d71d1a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.456028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-54630b75-b41d-477e-bb91-4b221dd724f1 req-ef5b6aeb-199f-4f1a-945e-a5ce03d71d1a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.500002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-54630b75-b41d-477e-bb91-4b221dd724f1 req-ef5b6aeb-199f-4f1a-945e-a5ce03d71d1a service nova] Creating event network-vif-deleted:061549ac-a3d6-4b74-9e58-6e99390adc84 for instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a on nch1-master-1 Apr 09 21:00:49.514679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-54630b75-b41d-477e-bb91-4b221dd724f1 req-ef5b6aeb-199f-4f1a-945e-a5ce03d71d1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098432 Apr 09 21:00:49.517099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 922/1771] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:49.528896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:49.530211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:49.539106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.539909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:49.540971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:49.542268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.158687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:50.167644 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-908c0b9c-06d6-40ac-b27c-01a076f6a993 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 0.912084 Apr 09 21:00:50.169125 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 850/1772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:49 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:50.179204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:50.179820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:50.199300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.200187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.201962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.202679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.284667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:50.298721 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c5854d4-6e20-4bc2-92ca-98195fa4f59c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1211 microversion: 2.1 time: 0.123259 Apr 09 21:00:50.299340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 851/1773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:50 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:50.308279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:50.310701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:50.312717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:50.316602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-abec6b82-42ff-45ba-a909-f8047d8d8826 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1313 microversion: 2.1 time: 0.795631 Apr 09 21:00:50.317269 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 923/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:49 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:50.322126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:50.322947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:50.335629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.336450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.337525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.338174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.343966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.344422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.351775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.352335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.373711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:50.616650 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 204 len: 0 microversion: 2.25 time: 0.310366 Apr 09 21:00:50.621930 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 852/1775] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:00:50 2022] DELETE /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:00:50.660556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:50.670096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d07a26be-6740-4ab3-be7c-1cb53d25834d tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.351514 Apr 09 21:00:50.674124 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 924/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:50 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:50.679567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:50.680481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:50.704300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.705112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.707643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:50.708961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:50.795103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-98c8fcc7-3f01-4601-a5d2-1c5bf2fb3aad tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Calling method '.version_select at 0x7fb08efdd700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:51.037836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-98c8fcc7-3f01-4601-a5d2-1c5bf2fb3aad tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.411071 Apr 09 21:00:51.046654 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 853/1777] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:00:50 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:51.052562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:51.055338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:51.074505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.086572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.091518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.093598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.094089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.103309 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee9a98d1-a3a7-4f6e-96a9-27735397716a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.427627 Apr 09 21:00:51.104489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 925/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:50 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:51.125233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e69ec4b-e33e-440f-bd83-2b61cc4a716b tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Action: 'create', calling method: .version_select at 0x7fb08f705790>, body: {"pool": "non_exist_pool"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:51.359555 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5e69ec4b-e33e-440f-bd83-2b61cc4a716b tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] HTTP exception thrown: Floating IP pool not found. Apr 09 21:00:51.360224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e69ec4b-e33e-440f-bd83-2b61cc4a716b tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Returning 404 to user: Floating IP pool not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:51.360997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e69ec4b-e33e-440f-bd83-2b61cc4a716b tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.255340 Apr 09 21:00:51.361941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 926/1779] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 21:00:51 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:00:51.366918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:51.367546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:51.387983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.388847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.389318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.403699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.654398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.668959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.675391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.685336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5bc0e8c-a3a4-4774-a4aa-4939a6747eaa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1483 microversion: 2.25 time: 0.628841 Apr 09 21:00:51.687156 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 854/1780] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:51 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1483 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:51.707948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:51.708675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:51.730010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.731109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.733410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.734066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.924765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.934765 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b7583e4-2fbf-4d01-8558-d1ebb17b6066 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1323 microversion: 2.1 time: 0.570420 Apr 09 21:00:51.938174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:51.940918 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 927/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:51 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1323 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:51.950755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:51.954169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:51.955579 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aff40147-1d41-4116-9199-de192c3c2de1 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1265 microversion: 2.1 time: 0.263206 Apr 09 21:00:51.968390 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 855/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:51 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:51.970106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.970865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.971913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:51.972591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:51.973745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4eacf62-75fd-4a27-994a-bf931954e395 tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Calling method '.version_select at 0x7fb08f007ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:52.069175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-a4eacf62-75fd-4a27-994a-bf931954e395 tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0e39a974-d0c0-4185-9b1d-d405c24feecd could not be found", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:00:52.071131 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-a4eacf62-75fd-4a27-994a-bf931954e395 tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] HTTP exception thrown: Floating IP not found for ID 0e39a974-d0c0-4185-9b1d-d405c24feecd Apr 09 21:00:52.071968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4eacf62-75fd-4a27-994a-bf931954e395 tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] Returning 404 to user: Floating IP not found for ID 0e39a974-d0c0-4185-9b1d-d405c24feecd {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:52.073753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4eacf62-75fd-4a27-994a-bf931954e395 tempest-FloatingIPsNegativeTestJSON-2078853369 tempest-FloatingIPsNegativeTestJSON-2078853369-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/0e39a974-d0c0-4185-9b1d-d405c24feecd" status: 404 len: 111 microversion: 2.1 time: 0.104171 Apr 09 21:00:52.075525 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 856/1783] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:00:51 2022] DELETE /compute/v2.1/os-floating-ips/0e39a974-d0c0-4185-9b1d-d405c24feecd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:00:52.085858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-db3cb8b2-440c-43a7-8350-f4a372d727f5 req-06de3a84-58a0-40f0-acaf-f5f8441f4b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "tag": "2447064d-f2f6-4455-bc1d-f66ad73dad67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:52.110925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db3cb8b2-440c-43a7-8350-f4a372d727f5 req-06de3a84-58a0-40f0-acaf-f5f8441f4b08 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.111733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db3cb8b2-440c-43a7-8350-f4a372d727f5 req-06de3a84-58a0-40f0-acaf-f5f8441f4b08 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.131007 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-db3cb8b2-440c-43a7-8350-f4a372d727f5 req-06de3a84-58a0-40f0-acaf-f5f8441f4b08 service nova] Creating event network-changed:2447064d-f2f6-4455-bc1d-f66ad73dad67 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:00:52.149849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-db3cb8b2-440c-43a7-8350-f4a372d727f5 req-06de3a84-58a0-40f0-acaf-f5f8441f4b08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072869 Apr 09 21:00:52.150489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 857/1784] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:52.169607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:52.170455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:52.190669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.191150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.191997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.192441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.386572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:52.396638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-346c6ebb-bf6b-4cd3-915f-a7acce173d55 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1463 microversion: 2.1 time: 0.454449 Apr 09 21:00:52.412379 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 928/1785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:51 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1463 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:52.418122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:52.419042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:52.432757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.433441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.444447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.455174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.590602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:52.601722 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-084f5c6e-8222-436b-ad22-3d2c1a713508 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.449049 Apr 09 21:00:52.602611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 858/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:52 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:52.619174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:52.620252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:52.630699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.631471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.633386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.634062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.867553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:52.876331 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c06f0f22-6953-4c79-8650-5f57b7f71c76 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.462440 Apr 09 21:00:52.881737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 929/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:52 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:52.886799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:52.892973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:52.909700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.910273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:52.911188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:52.911736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.111273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26b9f2fd-6634-428d-97c2-1415944c6db5 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1614 microversion: 2.1 time: 0.486666 Apr 09 21:00:53.113279 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 859/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:52 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1614 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:53.121568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:53.122870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:53.139638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.147112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.156855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.157743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.207548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.224393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.226690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.228049 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2fc441e4-d2ec-483c-a2e1-1a037913d0ea tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 200 len: 1483 microversion: 2.25 time: 0.345082 Apr 09 21:00:53.228747 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 930/1789] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:52 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 1483 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:53.244260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:53.244260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:53.263920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.264545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.265484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.266063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.711628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.719533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9709f1c6-02f1-47c6-b3df-28e6eac1426f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1518 microversion: 2.1 time: 0.604856 Apr 09 21:00:53.725722 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 860/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:53 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:53.739801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.743893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:53.744476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:53.752024 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76250bed-1b43-4255-a64e-cba72219e62e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.521971 Apr 09 21:00:53.752628 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 931/1791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:53 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:53.761300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.762101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.763111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.763701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.764693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:53.769851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:53.782689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.783199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.784077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:53.784546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:53.969006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0997b8a27edd4cc88479af11c71e53e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2f1362b9454910aca78105376f906b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:53.969884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] flavor_id is None. Assuming migration. {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 09 21:00:53.970337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:00:54.174285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:54.181769 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fece2c5f-c88d-4116-aea4-f88ad227c3bb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.425602 Apr 09 21:00:54.182364 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 932/1792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:53 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:54.196072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-23697768-b245-4fad-bd21-328ac6451bdf req-52779c14-a9ab-49ae-96e7-094edd538790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea967e2-2ce1-496d-9d15-58e58f3b57a0", "name": "network-vif-deleted", "tag": "4101014a-f45a-4573-a194-f9b7022a29b0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:54.217486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-23697768-b245-4fad-bd21-328ac6451bdf req-52779c14-a9ab-49ae-96e7-094edd538790 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.218701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-23697768-b245-4fad-bd21-328ac6451bdf req-52779c14-a9ab-49ae-96e7-094edd538790 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.242389 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-23697768-b245-4fad-bd21-328ac6451bdf req-52779c14-a9ab-49ae-96e7-094edd538790 service nova] Creating event network-vif-deleted:4101014a-f45a-4573-a194-f9b7022a29b0 for instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 on nch1-master-1 Apr 09 21:00:54.252621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-23697768-b245-4fad-bd21-328ac6451bdf req-52779c14-a9ab-49ae-96e7-094edd538790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060111 Apr 09 21:00:54.253927 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 933/1793] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:54.262546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:54.268066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:54.285901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.286778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.288824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.290358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.332637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'flavor' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:00:54.568962 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11a80498-ffc1-4049-925e-aa298d266fad tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action" status: 200 len: 32 microversion: 2.1 time: 0.309460 Apr 09 21:00:54.569871 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 934/1794] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:54 2022] POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:00:54.586099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:54.588363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:54.604718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.608418 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-08ed42c9-e412-4438-91ae-524722ce7d52 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7/action" status: 202 len: 0 microversion: 2.1 time: 0.880980 Apr 09 21:00:54.609895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 861/1795] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:00:53 2022] POST /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7/action => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:00:54.619897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.623719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:54.624335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.625319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 7ea967e2-2ce1-496d-9d15-58e58f3b57a0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:54.627330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.636454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.637208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.638319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.639133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.657804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] HTTP exception thrown: Instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 could not be found. Apr 09 21:00:54.658725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Returning 404 to user: Instance 7ea967e2-2ce1-496d-9d15-58e58f3b57a0 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:00:54.660288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-817fd6ad-0709-4a91-bc79-a748501006aa tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0" status: 404 len: 111 microversion: 2.25 time: 0.044233 Apr 09 21:00:54.664607 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 862/1796] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:54 2022] GET /compute/v2.1/servers/7ea967e2-2ce1-496d-9d15-58e58f3b57a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:00:54.670791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:54.671759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:54.679224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.679675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:54.680459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:54.680891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.061749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:55.078716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-07215384-8fe1-4f06-ab69-337c6e618ecc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.412261 Apr 09 21:00:55.079273 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 863/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:54 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:55.085145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:55.085759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:55.104148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.106282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.107790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.108737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.159711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:55.176948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9508fe82-dd53-40e9-9328-47068fb3c6fc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.604923 Apr 09 21:00:55.180273 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 935/1798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:54 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:55.199036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:55.201298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:55.211595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.212229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.213967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.214659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.468546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:55.477560 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16fcb5e7-5201-4ef6-b533-52148e981e59 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1472 microversion: 2.1 time: 0.396067 Apr 09 21:00:55.478684 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 864/1799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:55 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:55.487309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:55.489160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:55.512929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:55.530259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.530721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.531534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.531977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.534118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c57495ff-0e89-4d4b-9b3b-53971a6095dd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.352648 Apr 09 21:00:55.549267 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 936/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:55 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:55.679990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2a2a54a8-652b-439f-b1df-ffb728870dfb req-1debb302-d9ec-4762-93e0-4d9ebc441c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46fcb37-e8b8-47d8-bf95-d38db3ed80f9", "name": "network-vif-plugged", "status": "completed", "tag": "f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:55.702659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2a2a54a8-652b-439f-b1df-ffb728870dfb req-1debb302-d9ec-4762-93e0-4d9ebc441c9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:55.704130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2a2a54a8-652b-439f-b1df-ffb728870dfb req-1debb302-d9ec-4762-93e0-4d9ebc441c9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:55.758205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:55.766016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d1e9369c-6ead-415f-a5f9-27efb277c556 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.282602 Apr 09 21:00:55.766607 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 865/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:55 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:55.768692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2a2a54a8-652b-439f-b1df-ffb728870dfb req-1debb302-d9ec-4762-93e0-4d9ebc441c9d service nova] Creating event network-vif-plugged:f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721 for instance d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 on nch2-master-1 Apr 09 21:00:55.774683 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2a2a54a8-652b-439f-b1df-ffb728870dfb req-1debb302-d9ec-4762-93e0-4d9ebc441c9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102311 Apr 09 21:00:55.775628 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 937/1802] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:00:56.096267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:56.096881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:56.106123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.106573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.118635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.119162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.195585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:56.196286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:56.207763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.213181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.217477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.218243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.465575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:56.476390 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-19bddbd6-326a-4f04-9240-8251738ea54a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.383791 Apr 09 21:00:56.477393 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 866/1803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:56 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:56.485819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e94f544-180a-47fe-9df7-06afcdf7ca2d", "name": "network-vif-unplugged", "status": "completed", "tag": "1af61b32-e6ec-4d29-b14a-ebb1c3a817f0"}, {"name": "network-changed", "server_uuid": "7e94f544-180a-47fe-9df7-06afcdf7ca2d", "tag": "1af61b32-e6ec-4d29-b14a-ebb1c3a817f0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:56.503553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.504447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.523090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:56.525268 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] Creating event network-vif-unplugged:1af61b32-e6ec-4d29-b14a-ebb1c3a817f0 for instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d on nch2-master-1 Apr 09 21:00:56.526100 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] Creating event network-changed:1af61b32-e6ec-4d29-b14a-ebb1c3a817f0 for instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d on nch2-master-1 Apr 09 21:00:56.534223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-585bae31-42e1-479d-9979-fb785ca31e74 req-fa2ec795-2b9f-4e23-8f79-a73d77fd19a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.055246 Apr 09 21:00:56.535101 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 867/1804] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:56.535243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bad583ef-82c5-40c1-a815-8da705a56865 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.343629 Apr 09 21:00:56.539288 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 938/1805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:56 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:56.542100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9ad232aa-a5be-4ee8-94bc-5f1cd8d2fdbd req-b692cbf9-dd75-4af4-8aeb-2b5a93341ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f0b900-a8be-424c-be26-d266ce3db2aa", "tag": "481b9036-1f2d-4ed1-8401-4454c5eca990"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:00:56.545000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:56.545804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:56.552547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.553572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.554333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.554769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.556833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ad232aa-a5be-4ee8-94bc-5f1cd8d2fdbd req-b692cbf9-dd75-4af4-8aeb-2b5a93341ef4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.557672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ad232aa-a5be-4ee8-94bc-5f1cd8d2fdbd req-b692cbf9-dd75-4af4-8aeb-2b5a93341ef4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.575785 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9ad232aa-a5be-4ee8-94bc-5f1cd8d2fdbd req-b692cbf9-dd75-4af4-8aeb-2b5a93341ef4 service nova] Creating event network-changed:481b9036-1f2d-4ed1-8401-4454c5eca990 for instance 99f0b900-a8be-424c-be26-d266ce3db2aa on nch2-master-1 Apr 09 21:00:56.591040 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9ad232aa-a5be-4ee8-94bc-5f1cd8d2fdbd req-b692cbf9-dd75-4af4-8aeb-2b5a93341ef4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054062 Apr 09 21:00:56.592513 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 868/1806] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:00:56.613784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:56.614992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:56.625442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.626225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.627076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.627667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.878411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:56.886878 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45329847-48ce-47f2-9884-8fb8d16e0474 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1472 microversion: 2.1 time: 0.346112 Apr 09 21:00:56.887737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 939/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:56 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:56.893224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:56.893827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:56.900373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.900821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.901723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:56.902418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:56.905621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:56.913542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c2742c4-bd93-4499-9d8d-79bfec7fd52c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.306678 Apr 09 21:00:56.914734 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 869/1808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:56 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:57.039555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:57.040410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:57.049617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.050222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.051687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.052331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.079440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:00:57.115241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:57.131095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-514208c6-1cf1-463e-8a9f-d52b734a8beb tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.241652 Apr 09 21:00:57.132568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 940/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:56 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:57.177736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fde277e3-f41f-4d73-82fe-643813bf496b tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 204 len: 0 microversion: 2.25 time: 0.141151 Apr 09 21:00:57.177922 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 870/1810] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:00:57 2022] DELETE /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:00:57.195520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:57.196162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:57.202613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.202933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.203732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.204170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.494954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:57.495854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:57.504333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.505545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.506819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.507909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.796086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:57.814185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:57.816011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:57.817201 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-255c064e-b711-40f1-a241-fbe0c58072f9 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1562 microversion: 2.25 time: 0.626929 Apr 09 21:00:57.828033 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 941/1811] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:57 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1562 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:57.835741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:57.837184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:57.846502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.847141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:57.847924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:57.848507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.003506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:58.012762 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d33418d3-1edd-4297-87f5-590689157444 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.522052 Apr 09 21:00:58.013252 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 871/1812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:57 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:58.027515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:58.028144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:58.034878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.035497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.036335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.036785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.158003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:58.166339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f39062f0-59c0-49a0-9cbd-575b74f9cbaf tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.336942 Apr 09 21:00:58.166924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 942/1813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:57 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:58.176134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:58.176134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:58.183966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.185121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.185917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.186355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.335615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:58.343794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99b11001-ecd3-4bf8-ad9c-090cb67bd7e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1472 microversion: 2.1 time: 0.329425 Apr 09 21:00:58.344375 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 872/1814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:58 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1472 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:58.349157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:58.349950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:58.356813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.357295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.358356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.358991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.519623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:58.529829 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-871e029c-c327-44c2-bd83-64ad473893e4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.361385 Apr 09 21:00:58.530423 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 943/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:58 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:58.603698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:58.614056 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a71e4f1d-6c3a-4124-8a1d-7b3927d2be04 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1314 microversion: 2.1 time: 0.268539 Apr 09 21:00:58.614659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 873/1816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:58 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:58.834747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:58.835353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:58.841953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.842380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:58.843150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:58.843578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.030235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.030825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:59.037457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.037914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.038704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.039279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.098976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.110006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.113292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.115287 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7161b10e-cf37-433a-9f41-828b87b344ef tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1562 microversion: 2.25 time: 0.284519 Apr 09 21:00:59.115927 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 944/1817] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:00:58 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1562 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:00:59.184406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.185939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:59.193171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.194113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.196423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.198023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.198023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.209764 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-196ae17e-a86d-48c5-8d45-cfe887e1d368 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.184155 Apr 09 21:00:59.220293 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 874/1818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:59.339487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.347778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4d01decc-b6bf-4e63-882b-dcb306eb9dd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.168849 Apr 09 21:00:59.348988 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 945/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:59.361668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.362299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:59.369167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.369724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.370522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.370965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.547742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.552337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:59.556680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.557265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.558120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.558819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.625752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.633989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17768e51-50a8-482b-8eef-59d7f1a3fe45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.276738 Apr 09 21:00:59.643909 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 875/1820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:59.648027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.648656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:00:59.655041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.655513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.656294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.656734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.857650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.873121 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-536eb998-bdc2-4e21-b3ba-d1a5b58151ba tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.329679 Apr 09 21:00:59.875278 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 946/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:00:59.894807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:00:59.902465 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d8ec4dd-ce6f-4228-a428-c603b7529617 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1463 microversion: 2.1 time: 0.258368 Apr 09 21:00:59.903065 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 876/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:00:59.972802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Calling method '.version_select at 0x7fb08eb7ed30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:00:59.982800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:00:59.983269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:00:59.999540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.000306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.017755 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-13e23373-e7c0-4913-ba69-2f346f78cf5a tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/fb7b11a68b314c95b8ecc93cd51356b0?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133" status: 200 len: 695 microversion: 2.1 time: 0.101957 Apr 09 21:01:00.018346 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 947/1823] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Apr 9 21:00:59 2022] GET /compute/v2.1/os-simple-tenant-usage/fb7b11a68b314c95b8ecc93cd51356b0?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:00.032476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '.version_select at 0x7fb08f0a44c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.045271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.045729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.062193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.062885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.086069 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-88e6d379-dfbc-4261-bd37-132dc64f5bd0 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/fb7b11a68b314c95b8ecc93cd51356b0?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133" status: 200 len: 695 microversion: 2.1 time: 0.058032 Apr 09 21:01:00.087009 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 877/1824] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/os-simple-tenant-usage/fb7b11a68b314c95b8ecc93cd51356b0?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133 => generated 695 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:00.102805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Calling method '.version_select at 0x7fb08f450820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.111632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.112422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.129253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.130857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.134777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.135497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.143033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.143636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.144545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.144983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.229730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a432214-6f5e-47e7-9eba-3d0d7f8edb2f tempest-TenantUsagesTestJSON-2035834075 tempest-TenantUsagesTestJSON-2035834075-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133&detailed=1" status: 200 len: 21015 microversion: 2.1 time: 0.130952 Apr 09 21:01:00.230367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 948/1825] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-08T21%3A00%3A59.912133&end=2022-04-10T21%3A00%3A59.912133&detailed=1 => generated 21015 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:01:00.234928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.235539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.241555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.242163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.242949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.243391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.326217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.334479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.336039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.337881 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30cf200c-3cfc-4f92-a471-8534fa96e189 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1562 microversion: 2.25 time: 0.208533 Apr 09 21:01:00.340741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 878/1826] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:00.349641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.350144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.356695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.357233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.358012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.358628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.384269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:01:00.396654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.404766 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b516c049-045e-4cc6-a22f-27f85da2948d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.173400 Apr 09 21:01:00.409091 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 949/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:00.410978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.411596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.418331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.418786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.419578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.420104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.485302 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b464792-cb9d-41a2-a6f4-c0e333a34ba6 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 204 len: 0 microversion: 2.1 time: 0.143415 Apr 09 21:01:00.486006 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 879/1828] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:01:00 2022] DELETE /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:01:00.496762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.497472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.505954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.506626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.507416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.508009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.597863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.607033 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5805e64d-9efa-4307-a463-c4af14631ab7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.200066 Apr 09 21:01:00.607543 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 950/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:00.652325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.653138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.660287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.661319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.662268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.663150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.663663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.667713 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-44f06d3c-a847-4e15-8e2d-6592ebcb8c55 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1469 microversion: 2.1 time: 0.177521 Apr 09 21:01:00.668622 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 880/1830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:00.805481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:00.813726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c57e979-db3d-4854-a2a7-46bcd8eb8646 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.166036 Apr 09 21:01:00.814720 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 951/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:00.892044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:00.892783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:00.899123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.899567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:00.900341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:00.900774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.033406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:01.041246 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0a5cfd20-32b9-4aff-a749-b5fdfa60440c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.153341 Apr 09 21:01:01.041835 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 881/1832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:00 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:01.355822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:01.356873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:01.364673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.365497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.366687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.367326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.462380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-361677824", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:01.529574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:01.534679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:01:01.538643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:01.540354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:01.541580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8719b1e-b216-4ee3-a33c-288488a50cb5 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1562 microversion: 2.25 time: 0.191119 Apr 09 21:01:01.542148 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 882/1833] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:01 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:01.556588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:01.557761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:01.563723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.564174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.565194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.565989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.798754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:01:01.799619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:01:01.800201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:01:01.803671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:01.806505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:01:01.807024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:01:01.812702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61e5acc1-87ab-4cee-93b3-30fcb9bf14cb tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.269265 Apr 09 21:01:01.813460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 883/1834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:01 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:01.816858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.817470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.818343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.818841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.819453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:01.820580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:01.827525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.828078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.829248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.830026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.840026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Getting quotas for project 34832c64cfe049768207fb5cb0dfc2a7. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:01:01.844511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Getting quotas for user 702df47948994dd085132f3264ff66f5 and project 34832c64cfe049768207fb5cb0dfc2a7. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:01:01.856893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:01:01.859376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:01:01.908138 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f083d335-fad1-4ec6-9dac-e1e2d7b825a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621600 Apr 09 21:01:01.909136 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 952/1835] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:01:01.914288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:01.915154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:01.921930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.922806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:01.923755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:01.924345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.052722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.063676 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1dd5ce97-2417-4a92-be38-2423c8dfdedc tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.248780 Apr 09 21:01:02.064197 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 884/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:01 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:02.082189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:02.082819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:02.104346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.104919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.105626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.106126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.163114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.172124 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d47fa3c1-b732-4c2f-ba4b-3909bb49687f tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1469 microversion: 2.1 time: 0.261603 Apr 09 21:01:02.173870 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 953/1837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:01 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:02.179448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b665f65b-7e4b-49af-bce1-bc1643d28167 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:02.180375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b665f65b-7e4b-49af-bce1-bc1643d28167 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:02.259148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b665f65b-7e4b-49af-bce1-bc1643d28167 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.267205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b665f65b-7e4b-49af-bce1-bc1643d28167 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1216 microversion: 2.1 time: 0.092039 Apr 09 21:01:02.268108 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 954/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:02 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:02.281476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:02.282357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:02.289267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.290044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.290839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.291715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.316630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.325743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6cf6c20b-b665-41d1-9f37-5e702011fa88 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.247214 Apr 09 21:01:02.340489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 885/1839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:02 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:02.353558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b3072374-0580-4414-b8cf-cc2bfd0046c7 req-7839d79f-2240-484c-9428-d9763481fcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e461201-9323-4eed-a58c-bfd395b8913f", "name": "network-vif-deleted", "tag": "146c43f4-1b2c-4bf3-bc91-df1e1247e407"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:02.381090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b3072374-0580-4414-b8cf-cc2bfd0046c7 req-7839d79f-2240-484c-9428-d9763481fcdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.381590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b3072374-0580-4414-b8cf-cc2bfd0046c7 req-7839d79f-2240-484c-9428-d9763481fcdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.397375 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b3072374-0580-4414-b8cf-cc2bfd0046c7 req-7839d79f-2240-484c-9428-d9763481fcdb service nova] Creating event network-vif-deleted:146c43f4-1b2c-4bf3-bc91-df1e1247e407 for instance 6e461201-9323-4eed-a58c-bfd395b8913f on nch2-master-1 Apr 09 21:01:02.402936 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b3072374-0580-4414-b8cf-cc2bfd0046c7 req-7839d79f-2240-484c-9428-d9763481fcdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059886 Apr 09 21:01:02.404302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 886/1840] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:02.466999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.476758 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8f9fa0d5-adb9-4719-8ff1-b2955a20e451 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.207432 Apr 09 21:01:02.477445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 955/1841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:02 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:02.560851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:02.561514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:02.568604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.569080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.569867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.570307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.601252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.601710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.602166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lazy-loading 'fault' on Instance uuid 6e461201-9323-4eed-a58c-bfd395b8913f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:01:02.646368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.654919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.656444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.657753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a52e9e4-e60a-429c-915d-70e80712830f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 200 len: 1351 microversion: 2.25 time: 0.101556 Apr 09 21:01:02.658337 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 887/1842] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:02 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:02.829587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:02.830206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:02.836937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.837459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.838248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:02.838689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:02.969471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:02.977653 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1be11b06-bef6-4854-b4f6-5aed7c9496db tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.152133 Apr 09 21:01:02.978201 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 956/1843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:02 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.081569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.082237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.090223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.091151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.092237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.092916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.196312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.197503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.210528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.211206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.212732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.214147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.338131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:03.347110 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b475015-281a-41cb-8530-fdc35d30f7b0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.270031 Apr 09 21:01:03.348149 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 888/1844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.354333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.355205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.362029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.362561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.363413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.363924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.461896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:03.470763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75164c54-a262-405a-8324-ca3768949dc8 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1274 microversion: 2.1 time: 0.121042 Apr 09 21:01:03.472167 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 889/1845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.477568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.478282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.484539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.485303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.486296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.487044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.489148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:03.503028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-550b7222-8065-4063-a5b6-dca914569c2b tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1469 microversion: 2.1 time: 0.314280 Apr 09 21:01:03.512267 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 957/1846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.512267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.512267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.522381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.522973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.523967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.524544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.783237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:03.797835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:03.810331 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16b28798-f7b4-4103-926d-d560d3abe4ff tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.335644 Apr 09 21:01:03.812118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23659d47-2cd2-416e-914b-3a785dab47b2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.306858 Apr 09 21:01:03.813890 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 890/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.818305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 958/1848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:03.820912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.821810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 6e461201-9323-4eed-a58c-bfd395b8913f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.829013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.833584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.834631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.835229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.838415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e5005114-ced2-467d-a18f-c0a995912387 req-34096cc7-cab1-4edb-a438-3fcd2d16d57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f0b900-a8be-424c-be26-d266ce3db2aa", "name": "network-vif-plugged", "status": "completed", "tag": "481b9036-1f2d-4ed1-8401-4454c5eca990"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:03.857247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e5005114-ced2-467d-a18f-c0a995912387 req-34096cc7-cab1-4edb-a438-3fcd2d16d57f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.857857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e5005114-ced2-467d-a18f-c0a995912387 req-34096cc7-cab1-4edb-a438-3fcd2d16d57f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.860094 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] HTTP exception thrown: Instance 6e461201-9323-4eed-a58c-bfd395b8913f could not be found. Apr 09 21:01:03.863557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Returning 404 to user: Instance 6e461201-9323-4eed-a58c-bfd395b8913f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:03.865406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a791b1b-bda3-484e-8da1-114ed98e7d43 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f" status: 404 len: 111 microversion: 2.25 time: 0.050038 Apr 09 21:01:03.869920 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 891/1849] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/6e461201-9323-4eed-a58c-bfd395b8913f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:01:03.874065 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e5005114-ced2-467d-a18f-c0a995912387 req-34096cc7-cab1-4edb-a438-3fcd2d16d57f service nova] Creating event network-vif-plugged:481b9036-1f2d-4ed1-8401-4454c5eca990 for instance 99f0b900-a8be-424c-be26-d266ce3db2aa on nch2-master-1 Apr 09 21:01:03.878442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.879699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:03.881565 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e5005114-ced2-467d-a18f-c0a995912387 req-34096cc7-cab1-4edb-a438-3fcd2d16d57f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061832 Apr 09 21:01:03.888135 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 959/1850] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:03.889199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.890215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.891156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:03.891702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:03.943451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:01:03.998185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:03.999210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:04.006145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.007025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.008056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.008651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.049577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4f77998-4522-486f-bc67-ac3aa13c3021 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "DELETE /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 204 len: 0 microversion: 2.25 time: 0.177478 Apr 09 21:01:04.051154 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 892/1851] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:01:03 2022] DELETE /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:01:04.062070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:04.063001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:04.078967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.079780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.083618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.084213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.680355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:04.692722 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e66f234-f59c-4b11-8e52-929b05960872 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.699486 Apr 09 21:01:04.694552 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 960/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:03 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:04.700190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:04.701268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:04.710848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:04.711093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.712087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.713596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.715055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.719812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:04.721469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:04.724275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-41c91085-82b9-41a2-88ac-2e04093f9d99 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1547 microversion: 2.25 time: 0.668165 Apr 09 21:01:04.735227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 893/1853] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:04 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1547 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:04.735227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ed618ff5-381d-4ba0-9f27-54f9bc1d0bae req-f9d01d05-55e0-492c-aa47-fe6a0f575f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46fcb37-e8b8-47d8-bf95-d38db3ed80f9", "name": "network-vif-deleted", "tag": "f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:04.743397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ed618ff5-381d-4ba0-9f27-54f9bc1d0bae req-f9d01d05-55e0-492c-aa47-fe6a0f575f3b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.744308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ed618ff5-381d-4ba0-9f27-54f9bc1d0bae req-f9d01d05-55e0-492c-aa47-fe6a0f575f3b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.759478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ed618ff5-381d-4ba0-9f27-54f9bc1d0bae req-f9d01d05-55e0-492c-aa47-fe6a0f575f3b service nova] Creating event network-vif-deleted:f0f6cf0a-7c2e-4c11-a4fe-7e2eca56c721 for instance d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 on nch2-master-1 Apr 09 21:01:04.766102 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ed618ff5-381d-4ba0-9f27-54f9bc1d0bae req-f9d01d05-55e0-492c-aa47-fe6a0f575f3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039262 Apr 09 21:01:04.766791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 894/1854] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:04.773255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:04.774278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:04.780925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.781494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:04.782348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:04.782846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.052698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:05.057541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:05.062583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-13d94a24-9d1e-4796-95f2-78134d784374 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.366559 Apr 09 21:01:05.063458 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 961/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:04 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:05.065931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a8d93a8-933b-4b0d-838c-2e00f3fbb7ce tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.297742 Apr 09 21:01:05.068562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:05.069190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:05.075132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 895/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:04 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:05.076417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.076858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.077907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.078340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.080820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:05.081491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:05.087791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.088411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.089259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.089947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.187816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce74147326849bc8bf26bcfa9e30276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7b11a68b314c95b8ecc93cd51356b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:05.197562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f028872f-ecd5-4cb6-a108-7a66c4b9d276 tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 200 len: 1299 microversion: 2.1 time: 0.132656 Apr 09 21:01:05.198475 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 962/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:05 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:05.204738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:05.205609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:05.215883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.216533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.217519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.217976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.471445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:05.486335 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ebd4a35a-e6f9-408c-9322-d13856081ef9 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.409649 Apr 09 21:01:05.489146 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 896/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:05 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:05.542384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:05.553643 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6016d7c1-7175-4e54-96f2-0c6a0276df14 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1307 microversion: 2.1 time: 0.353632 Apr 09 21:01:05.554902 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 963/1859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:05 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:05.710576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:05.711444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:05.718398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.718849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.719646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.720079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.745537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:05.746488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:05.759955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.760504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:05.761754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:05.762491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.141078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.149065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-62fdca3f-bf22-4e5a-bc35-f574df56ddca tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.442341 Apr 09 21:01:06.149649 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 897/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:05 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:06.155292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.155918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.162201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.162661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.163455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.163923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.190708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.200185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.201786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.202941 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8376d30-b57d-40da-872c-c22b353b4594 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 200 len: 1547 microversion: 2.25 time: 0.463469 Apr 09 21:01:06.203513 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 964/1861] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:05 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 1547 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:06.207844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.208476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.218320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.218769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.219582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.219987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.429508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.439445 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ddc81da-e08c-43ef-a020-b890c4bc8167 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1550 microversion: 2.1 time: 0.288427 Apr 09 21:01:06.442183 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 898/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1550 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:06.448029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.448882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] [instance: d46fcb37-e8b8-47d8-bf95-d38db3ed80f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.460833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.461702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.462597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.463177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.465891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.474465 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-77bb8649-d8f9-45d6-bd98-8d21492a85d4 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.269955 Apr 09 21:01:06.475365 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 965/1863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:06.484543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] HTTP exception thrown: Instance d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 could not be found. Apr 09 21:01:06.484543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] Returning 404 to user: Instance d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:06.484543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e95297f-f7fc-4c89-ab16-576dbfe0013e tempest-TenantUsagesTestJSON-1246794752 tempest-TenantUsagesTestJSON-1246794752-project] 10.222.0.30 "GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9" status: 404 len: 111 microversion: 2.1 time: 0.037485 Apr 09 21:01:06.484543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 899/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/d46fcb37-e8b8-47d8-bf95-d38db3ed80f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:06.505542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.506112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.512479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.512927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.514626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.515087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.577007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.577995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.585363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.585821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.586619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.587060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.763784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.774483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9cb6ce6d-c2ef-4488-bcb3-4d94b5c7cd19 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.272777 Apr 09 21:01:06.785353 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 900/1865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:06.790465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5b5fda0d-93fc-4fe2-aaa9-a05597519af6 req-5292df1a-6736-4ec0-975f-6e99ed93ad57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082a1f8a-dbf4-4bc4-8773-874a5d0f41d0", "name": "network-vif-deleted", "tag": "bda24322-5977-4986-922a-0fbb3eec9523"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:06.794894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:06.800605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b5fda0d-93fc-4fe2-aaa9-a05597519af6 req-5292df1a-6736-4ec0-975f-6e99ed93ad57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.801406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b5fda0d-93fc-4fe2-aaa9-a05597519af6 req-5292df1a-6736-4ec0-975f-6e99ed93ad57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.803961 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae600615-15c2-4425-bb16-7acf5e8e1822 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1486 microversion: 2.1 time: 0.236022 Apr 09 21:01:06.804548 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 966/1866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:06.808969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-53525a47-56df-410f-8b17-aab4a11ba923 req-2a839c80-4807-4a73-a326-cb0e79fcbc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:06.817844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53525a47-56df-410f-8b17-aab4a11ba923 req-2a839c80-4807-4a73-a326-cb0e79fcbc9a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.818282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53525a47-56df-410f-8b17-aab4a11ba923 req-2a839c80-4807-4a73-a326-cb0e79fcbc9a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.824247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5b5fda0d-93fc-4fe2-aaa9-a05597519af6 req-5292df1a-6736-4ec0-975f-6e99ed93ad57 service nova] Creating event network-vif-deleted:bda24322-5977-4986-922a-0fbb3eec9523 for instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 on nch2-master-1 Apr 09 21:01:06.829879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5b5fda0d-93fc-4fe2-aaa9-a05597519af6 req-5292df1a-6736-4ec0-975f-6e99ed93ad57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043133 Apr 09 21:01:06.830622 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 901/1867] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:06.836752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-53525a47-56df-410f-8b17-aab4a11ba923 req-2a839c80-4807-4a73-a326-cb0e79fcbc9a service nova] Creating event network-changed:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:01:06.836895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:06.837677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.842697 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-53525a47-56df-410f-8b17-aab4a11ba923 req-2a839c80-4807-4a73-a326-cb0e79fcbc9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036948 Apr 09 21:01:06.843311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 967/1868] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:06.844127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.844642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.845509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.846116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.868347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lazy-loading 'flavor' on Instance uuid 99f0b900-a8be-424c-be26-d266ce3db2aa {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:01:06.975807 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52a8c364-843f-434e-9a04-29dea71e0c4e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.143112 Apr 09 21:01:06.976398 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 902/1869] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:06 2022] POST /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:06.987097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:06.987823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:06.994460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.994914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:06.995694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:06.996320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.148574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.161179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08bde19d-fff0-4bf7-bc67-619841765f1c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1494 microversion: 2.1 time: 0.178988 Apr 09 21:01:07.167276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.167996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.171533 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 968/1870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:06 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1494 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:07.176986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.177482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.178370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.178816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.224180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.225906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.235472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.236497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.237383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.238151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.255502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] HTTP exception thrown: Instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 could not be found. Apr 09 21:01:07.256399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Returning 404 to user: Instance 082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:07.257898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d990b713-c8af-4368-a4f1-feba18740dbf tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0" status: 404 len: 111 microversion: 2.25 time: 0.038495 Apr 09 21:01:07.258988 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 969/1871] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/082a1f8a-dbf4-4bc4-8773-874a5d0f41d0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:01:07.268332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.268988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.276695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.277106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.278677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.279307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.310271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:01:07.412562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9af56a6e-867f-4a37-8e65-ceb42fc2a790 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 204 len: 0 microversion: 2.25 time: 0.147648 Apr 09 21:01:07.416194 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 970/1872] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:01:07 2022] DELETE /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:01:07.417203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.428168 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7805f85-2c9f-4743-8370-93b58c277fdc tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.265303 Apr 09 21:01:07.429595 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 903/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:07.439432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.439432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.440124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.440571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.441401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.441837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.458747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.459372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.469679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.470342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.471134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.473480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.763035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.778738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.781315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.783611 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57f1e2fd-d947-437a-9172-09f54bc726e2 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1563 microversion: 2.25 time: 0.356921 Apr 09 21:01:07.784961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 971/1874] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1563 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:07.789446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:07.789917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.790695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.797565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.798143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.799807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.800464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.803589 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f910e299-9c7b-4e24-a2bd-3fabd6640109 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1540 microversion: 2.1 time: 0.348464 Apr 09 21:01:07.804837 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 904/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1540 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:07.811500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:07.828242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:07.836910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.837423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:07.838383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:07.839194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.120834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:08.128885 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ff31d68-bf8b-43b2-bd4e-3e864f513756 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.342776 Apr 09 21:01:08.130485 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 972/1876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:08.135897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bda543cd-5d94-4754-af16-0feeb98b052d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '.version_select at 0x7fb08f008310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.145419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:08.146693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bda543cd-5d94-4754-af16-0feeb98b052d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.153616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bda543cd-5d94-4754-af16-0feeb98b052d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.157426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c67bfb8-147a-4413-b7cb-9a30f1c5e389 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.351229 Apr 09 21:01:08.158135 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 905/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:07 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:08.176341 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bda543cd-5d94-4754-af16-0feeb98b052d tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3123 microversion: 2.1 time: 0.044019 Apr 09 21:01:08.177844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.178458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.184237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 973/1878] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/os-migrations => generated 3123 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:08.187585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.188047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.188935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.189714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.206112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.206741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.216992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.217471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.218263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.218758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.520937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:08.528964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6418dd06-13a7-48d5-be80-306ac1214c5b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 200 len: 1477 microversion: 2.1 time: 0.355057 Apr 09 21:01:08.529850 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 906/1879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 1477 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:08.535165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.536063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.548044 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0df2d975-3d8b-4310-8b3c-eed7a678f6f5 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1691 microversion: 2.1 time: 0.352762 Apr 09 21:01:08.549836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 974/1880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1691 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:08.554962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-589232932"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:08.556320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.557414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.558955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.562784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.563275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.564760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.565280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.566074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.567296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.818687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:08.833295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e82cd50f-668a-4aef-8b1c-0bce3eda13e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.301924 Apr 09 21:01:08.843675 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 907/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:08.851170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.852148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.860608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.861717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.862966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.863853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.967388 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-808aa5bc-b029-4e54-81e2-ceebd94f9974 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.415090 Apr 09 21:01:08.968151 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 975/1882] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:08 2022] POST /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:01:08.979914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:08.981497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:08.995140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.996543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:08.997635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:08.998243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.128186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:09.144857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:09.147803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c775742dfc04cec8559f9e4d13239b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c23a8d6534a4426b2ea106417c8b68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:09.149890 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd068629-be5c-4300-b452-f45841e1648f tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 200 len: 1521 microversion: 2.25 time: 0.179091 Apr 09 21:01:09.152934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 976/1883] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:01:09.159916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6e00f23-62a9-4605-9430-ecd8f1eae9a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984bec10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:09.217753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e70f7f4d-c146-4bf5-b342-d082b846c932 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1691 microversion: 2.1 time: 0.372201 Apr 09 21:01:09.234730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6e00f23-62a9-4605-9430-ecd8f1eae9a6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.080313 Apr 09 21:01:09.235637 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 977/1884] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:09 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:09.242501 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 908/1885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:08 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1691 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:09.245837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dd9142de-be17-4323-afd1-1284f0fcaf8e req-30cc0bf9-35bf-403f-b41f-e9150b70a9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bb8bb5-bfe6-45ed-8c3e-31e7d4719680", "name": "network-vif-deleted", "tag": "c8cc001c-614d-4bb1-934a-dd12049b69f8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:09.257401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:09.259364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:09.264894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd9142de-be17-4323-afd1-1284f0fcaf8e req-30cc0bf9-35bf-403f-b41f-e9150b70a9fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.265408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd9142de-be17-4323-afd1-1284f0fcaf8e req-30cc0bf9-35bf-403f-b41f-e9150b70a9fc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.289522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.292441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.293661 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dd9142de-be17-4323-afd1-1284f0fcaf8e req-30cc0bf9-35bf-403f-b41f-e9150b70a9fc service nova] Creating event network-vif-deleted:c8cc001c-614d-4bb1-934a-dd12049b69f8 for instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 on nch2-master-1 Apr 09 21:01:09.296440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.298415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.304761 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dd9142de-be17-4323-afd1-1284f0fcaf8e req-30cc0bf9-35bf-403f-b41f-e9150b70a9fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065661 Apr 09 21:01:09.313784 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 978/1886] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:09.321302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:09.322116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:09.328940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.329441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.330226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.330661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.904572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:09.913591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bbb7e67b-2565-48dd-8c2d-ddf194720775 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.668766 Apr 09 21:01:09.914194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 909/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:09 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:09.934481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:09.946576 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79bde4e9-6aee-4c7a-9222-b30cce150e1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.630340 Apr 09 21:01:09.947690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 979/1888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:09 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:09.949862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:09.958252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:09.969863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:09.970746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:09.972197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.972658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.978079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.978670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.978837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.979515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:09.981261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:09.982434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.108521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lazy-loading 'services' on Instance uuid 7e94f544-180a-47fe-9df7-06afcdf7ca2d {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:01:10.146816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:10.156134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57725053-cd76-4ab6-b2c5-93c5768514e4 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.194716 Apr 09 21:01:10.157529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 980/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:09 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:10.174546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:10.178129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] [instance: 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:10.191883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.192534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.193569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.194205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.210177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments/e65996e1-1e66-4a23-ac8b-882a962e48df" status: 202 len: 0 microversion: 2.1 time: 0.284809 Apr 09 21:01:10.211456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 910/1890] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:01:09 2022] DELETE /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments/e65996e1-1e66-4a23-ac8b-882a962e48df => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:10.212863 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] HTTP exception thrown: Instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 could not be found. Apr 09 21:01:10.213857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] Returning 404 to user: Instance 08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:10.215472 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-179fe490-d6fd-4c59-bdc7-93c253c759e1 tempest-LiveAutoBlockMigrationV225Test-403680615 tempest-LiveAutoBlockMigrationV225Test-403680615-project] 10.222.0.30 "GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680" status: 404 len: 111 microversion: 2.25 time: 0.046932 Apr 09 21:01:10.216469 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 981/1891] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:01:10 2022] GET /compute/v2.1/servers/08bb8bb5-bfe6-45ed-8c3e-31e7d4719680 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:01:10.223324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:10.225921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:10.234711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.235850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.237811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.238800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.250953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-300d22da-b6b3-440a-a7db-02d3ed43810d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee04280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:10.286777 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de93ad3f-47a7-4479-9862-9fe6f845f441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068896 Apr 09 21:01:10.288911 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 911/1892] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:01:10 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:01:10.335369 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-300d22da-b6b3-440a-a7db-02d3ed43810d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.087856 Apr 09 21:01:10.336400 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 982/1893] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:10 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:10.931326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:10.931942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:10.942548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.947610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.948908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.954477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.965657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:10.966347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:10.980583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.983758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:10.984679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:10.985149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.303540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:11.319792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa3c0488-1f4b-4c38-b650-29748a17dd3a tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.392184 Apr 09 21:01:11.320432 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 912/1894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:10 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:11.335385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:11.336071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:11.343861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:11.344323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.345161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:11.345983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.352034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:11.360083 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f34d1f3-31f5-4ae8-a520-6ecd03105889 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.399092 Apr 09 21:01:11.360788 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 983/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:10 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:11.369876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e6dbd428-ff82-463b-b56a-f9fde6c55182 req-7af7166c-200d-4521-85ab-73a0bbefd558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-plugged", "status": "completed", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:11.374025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e6dbd428-ff82-463b-b56a-f9fde6c55182 req-7af7166c-200d-4521-85ab-73a0bbefd558 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:11.374782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e6dbd428-ff82-463b-b56a-f9fde6c55182 req-7af7166c-200d-4521-85ab-73a0bbefd558 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.390380 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e6dbd428-ff82-463b-b56a-f9fde6c55182 req-7af7166c-200d-4521-85ab-73a0bbefd558 service nova] Creating event network-vif-plugged:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:01:11.396373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e6dbd428-ff82-463b-b56a-f9fde6c55182 req-7af7166c-200d-4521-85ab-73a0bbefd558 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034112 Apr 09 21:01:11.397002 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 984/1896] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:11.403633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:11.405056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:11.417026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:11.417519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.418367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:11.418911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:11.458945 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-069e24d5-e2fd-45d3-887c-487776239d1f tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060533 Apr 09 21:01:11.459915 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 985/1897] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:01:11 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:01:11.469514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29c976de-113e-47bb-8b79-c7ba3334aa41 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb09852a0d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:11.534912 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29c976de-113e-47bb-8b79-c7ba3334aa41 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.065066 Apr 09 21:01:11.536666 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 986/1898] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:11 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:11.611786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:11.621918 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17e21655-9a02-4e23-99e3-2b45ad9c2e4c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.291159 Apr 09 21:01:11.629727 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 913/1899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:11 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:12.339750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:12.341207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:12.357746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:12.358352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:12.362260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:12.363090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:12.380202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:12.382290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:12.397583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:12.399202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:12.406343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:12.407341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:12.977872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:12.991351 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c524c67e-320e-49d0-8400-a03e3857af82 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.612730 Apr 09 21:01:13.001731 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 914/1900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:12 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:13.018810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89393041-f68e-4df7-a0f8-c4f48cbfa3c3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f1c2d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:13.063993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:13.072129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08a294c6-fd37-4913-8a44-d01916e06586 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1316 microversion: 2.1 time: 0.738368 Apr 09 21:01:13.092959 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 987/1901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:12 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:13.108234 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89393041-f68e-4df7-a0f8-c4f48cbfa3c3 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.105254 Apr 09 21:01:13.108938 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 915/1902] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:13 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:13.110883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:13.111580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:13.126636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:13.127708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:13.129001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:13.129644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:13.315592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:13.326114 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1df8346d-fd94-4115-bad2-e8fd6f09e333 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.231451 Apr 09 21:01:13.328063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 988/1903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:13 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:13.887396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c0aa2bf6-5281-4afb-9e1d-28baefb22879 req-873c697c-f315-4dbe-a42b-e0fe5cce544c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f0b900-a8be-424c-be26-d266ce3db2aa", "name": "network-vif-plugged", "status": "completed", "tag": "481b9036-1f2d-4ed1-8401-4454c5eca990"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:13.927065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c0aa2bf6-5281-4afb-9e1d-28baefb22879 req-873c697c-f315-4dbe-a42b-e0fe5cce544c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:13.927519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c0aa2bf6-5281-4afb-9e1d-28baefb22879 req-873c697c-f315-4dbe-a42b-e0fe5cce544c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:13.959205 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c0aa2bf6-5281-4afb-9e1d-28baefb22879 req-873c697c-f315-4dbe-a42b-e0fe5cce544c service nova] Creating event network-vif-plugged:481b9036-1f2d-4ed1-8401-4454c5eca990 for instance 99f0b900-a8be-424c-be26-d266ce3db2aa on nch2-master-1 Apr 09 21:01:13.976952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c0aa2bf6-5281-4afb-9e1d-28baefb22879 req-873c697c-f315-4dbe-a42b-e0fe5cce544c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090912 Apr 09 21:01:13.979434 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 916/1904] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:14.013611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:14.015712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:14.032884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.033833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.034900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.035168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.092743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:14.093616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:14.104085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.104609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.110368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.113734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.369429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:14.381952 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b586470-70c0-4f26-9055-6d62ea37ae45 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.373936 Apr 09 21:01:14.385109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 989/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:14 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:14.395985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f991a50a-291d-4d37-9125-a3d4f78f0b6e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb098496ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:14.458588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:14.473403 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb36c7b7-2aa8-45e9-bb01-2e869d8105ac tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1466 microversion: 2.1 time: 0.385077 Apr 09 21:01:14.476386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f991a50a-291d-4d37-9125-a3d4f78f0b6e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.088543 Apr 09 21:01:14.477393 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 990/1906] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:14 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:14.478537 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 917/1907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:14 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1466 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:14.494846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:14.495077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-6573409", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6e4c0a84-06ca-42fe-9656-5da4d34fcdb0"}], "block_device_mapping_v2": [{"uuid": "ef3cc8f1-99be-44b9-a957-0c88e6e49410", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:14.495515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:14.502504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.503003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.503810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.504289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.608083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] validate_networks() for [('6e4c0a84-06ca-42fe-9656-5da4d34fcdb0', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:01:14.830742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:14.856848 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-948c4018-9d93-4e74-b879-73f5a53cbb7d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.362292 Apr 09 21:01:14.859595 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 918/1908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:14 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:14.885407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-202173362", "metadata": {"image_type": "test"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:14.889341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:14.933560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.934160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:14.935017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:14.942144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:15.076153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Getting quotas for project 34832c64cfe049768207fb5cb0dfc2a7. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:01:15.089386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Getting quotas for user 702df47948994dd085132f3264ff66f5 and project 34832c64cfe049768207fb5cb0dfc2a7. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:01:15.561026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:01:15.561752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:01:15.562362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:01:15.562834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:01:15.563485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:01:15.591241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:15.593193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:15.594088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:15.597844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:15.624164 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3395234-5398-47b4-8aee-a5cc0b940479 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "POST /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526/action" status: 202 len: 0 microversion: 2.1 time: 0.761350 Apr 09 21:01:15.628372 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 919/1909] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:14 2022] POST /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:01:15.644425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:15.648002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:15.663909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:01:15.664179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:15.667389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:15.668376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:15.668976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:15.676318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Getting quotas for user ceba42e80d7746e4897669084c078c09 and project 352d269ab35841c397ca9168792c1ec4. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:01:15.788159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:01:15.790496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef3cc8f1-99be-44b9-a957-0c88e6e49410',volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:01:15.958767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:15.969230 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fcd56410-eb3a-4ff3-ad45-79f435e0441f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.338720 Apr 09 21:01:15.969876 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 920/1910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:15 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:15.975984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-574b43cd-1303-4499-a215-f7ff750374c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f161550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:16.034463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-574b43cd-1303-4499-a215-f7ff750374c9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.063270 Apr 09 21:01:16.035391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 921/1911] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:15 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:16.041883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ca5bbb4-b4b6-42ab-abc6-29851b133395 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f179310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:16.055333 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b967258d-3834-4350-82a2-f6175f921513 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573853 Apr 09 21:01:16.055959 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 991/1912] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:01:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:01:16.065221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:16.066077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:16.074765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:16.075769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:16.076913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:16.077658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:16.127932 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ca5bbb4-b4b6-42ab-abc6-29851b133395 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1423 microversion: 2.1 time: 0.091052 Apr 09 21:01:16.131705 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 922/1913] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:16 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:16.145908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-91ae4e53-4413-4800-bb28-d611017ac8b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:16.148037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-91ae4e53-4413-4800-bb28-d611017ac8b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:16.284754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-91ae4e53-4413-4800-bb28-d611017ac8b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:16.296433 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-91ae4e53-4413-4800-bb28-d611017ac8b8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1050 microversion: 2.1 time: 0.160073 Apr 09 21:01:16.297552 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 923/1914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:16 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1050 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:16.398612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:16.409312 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cadcd1af-67a9-4750-bf25-e7a84f003ff9 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.348471 Apr 09 21:01:16.411263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 992/1915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:16 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:16.988330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:16.990047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:17.009883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.011194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.016409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.017083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.050662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2bb4604-fbc6-4db7-9ff8-f5da36f7bea0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984eca60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:17.187636 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2bb4604-fbc6-4db7-9ff8-f5da36f7bea0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.143229 Apr 09 21:01:17.190144 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 993/1916] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:17 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:17.208364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-be2e837c-2a3f-4fe8-9421-77fa85b6ddb0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb098487280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:17.366854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-be2e837c-2a3f-4fe8-9421-77fa85b6ddb0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1423 microversion: 2.1 time: 0.174090 Apr 09 21:01:17.368046 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 994/1917] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:17 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:17.376767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:17.379808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:17.398803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.401029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.404998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.407013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.526535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:17.542352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e67feac8-6848-4f77-b991-fd520a03cf86 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.554952 Apr 09 21:01:17.546494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 924/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:16 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:17.563874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:17.565149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:17.586759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.587434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.589908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:17.592102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:17.625370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:17.633871 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9750f501-bf24-4084-9e4b-1b4492284de2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1148 microversion: 2.1 time: 0.264459 Apr 09 21:01:17.634323 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 995/1919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:17 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1148 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:18.026453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:18.054974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a820ec3-0833-4fdc-b648-ad131b3dec0d tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.502890 Apr 09 21:01:18.056181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 925/1920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:17 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:18.084634 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2844aef1-f036-4d16-b163-72e03357601c tempest-TenantUsagesNegativeTestJSON-920967237 tempest-TenantUsagesNegativeTestJSON-920967237-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-08T21%3A01%3A17.601763&end=2022-04-10T21%3A01%3A17.601763" status: 404 len: 112 microversion: - time: 0.449189 Apr 09 21:01:18.085647 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 996/1921] 10.222.0.30 () {58 vars in 1315 bytes} [Sat Apr 9 21:01:17 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-08T21%3A01%3A17.601763&end=2022-04-10T21%3A01%3A17.601763 => generated 112 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 21:01:18.098019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1098a7c1-3ead-464c-9bf7-314becdc5b27 tempest-TenantUsagesNegativeTestJSON-920967237 tempest-TenantUsagesNegativeTestJSON-920967237-project-admin] Calling method '.version_select at 0x7fb08eccc160>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.101698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1098a7c1-3ead-464c-9bf7-314becdc5b27 tempest-TenantUsagesNegativeTestJSON-920967237 tempest-TenantUsagesNegativeTestJSON-920967237-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Apr 09 21:01:18.102499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1098a7c1-3ead-464c-9bf7-314becdc5b27 tempest-TenantUsagesNegativeTestJSON-920967237 tempest-TenantUsagesNegativeTestJSON-920967237-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:18.103992 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1098a7c1-3ead-464c-9bf7-314becdc5b27 tempest-TenantUsagesNegativeTestJSON-920967237 tempest-TenantUsagesNegativeTestJSON-920967237-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/57f80885ae94461faac0058e9c3186b9?start=2022-04-10T21%3A01%3A17.601763&end=2022-04-08T21%3A01%3A17.601763" status: 400 len: 111 microversion: 2.1 time: 0.012015 Apr 09 21:01:18.105154 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 926/1922] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage/57f80885ae94461faac0058e9c3186b9?start=2022-04-10T21%3A01%3A17.601763&end=2022-04-08T21%3A01%3A17.601763 => generated 111 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:01:18.203882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38d845cd-7ce6-47ca-afec-02f6083910a8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08ee9bdc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.308234 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38d845cd-7ce6-47ca-afec-02f6083910a8 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.109040 Apr 09 21:01:18.316609 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 927/1923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:18.363143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b16d2c5-90a9-4861-a72a-4d7e5317094f tempest-TenantUsagesNegativeTestJSON-353834656 tempest-TenantUsagesNegativeTestJSON-353834656-project] Calling method '.version_select at 0x7fb0984be0d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.367727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b16d2c5-90a9-4861-a72a-4d7e5317094f tempest-TenantUsagesNegativeTestJSON-353834656 tempest-TenantUsagesNegativeTestJSON-353834656-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '18829faf81144879b9a7713e52b36c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f80885ae94461faac0058e9c3186b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:18.368405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b16d2c5-90a9-4861-a72a-4d7e5317094f tempest-TenantUsagesNegativeTestJSON-353834656 tempest-TenantUsagesNegativeTestJSON-353834656-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:18.370818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b16d2c5-90a9-4861-a72a-4d7e5317094f tempest-TenantUsagesNegativeTestJSON-353834656 tempest-TenantUsagesNegativeTestJSON-353834656-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-08T21%3A01%3A17.601763&end=2022-04-10T21%3A01%3A17.601763&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.258673 Apr 09 21:01:18.372003 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 997/1924] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-08T21%3A01%3A17.601763&end=2022-04-10T21%3A01%3A17.601763&detailed=1 => generated 123 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:01:18.387726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f4434a3-e8b1-4037-a427-22d1afd13253 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08efc20d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.480336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f4434a3-e8b1-4037-a427-22d1afd13253 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1423 microversion: 2.1 time: 0.101403 Apr 09 21:01:18.488515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 928/1925] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:18.562808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.574599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:18.607377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:18.607844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:18.616462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:18.617143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:18.652419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:18.653068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:18.668981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:18.669924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:18.672241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:18.674129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:19.018884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:19.034994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0edc6ecd-4c1f-4b38-9d15-5f85e6817394 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1166 microversion: 2.1 time: 0.387168 Apr 09 21:01:19.035641 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 929/1926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1166 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:01:19.072631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:19.073456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:19.083751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:19.084221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:19.085116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:19.085498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:19.468757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:19.499811 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12f62641-03ec-43a3-aec9-91300f303957 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.937398 Apr 09 21:01:19.502799 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 998/1927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:18 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:19.527848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-808afe40-deac-4380-b57b-3faf8b7c885b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984ec820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:19.570017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:19.580851 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bfd3a2f2-fe12-4430-a03b-9366a03fcc0c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.512754 Apr 09 21:01:19.602782 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 930/1928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:19 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:19.627271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f10a75ab-5758-4344-8e47-65ad81a83fa2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f161f70>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:19.639257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-808afe40-deac-4380-b57b-3faf8b7c885b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1439 microversion: 2.1 time: 0.132581 Apr 09 21:01:19.641329 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 999/1929] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:19 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:19.747451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f10a75ab-5758-4344-8e47-65ad81a83fa2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1423 microversion: 2.1 time: 0.142604 Apr 09 21:01:19.748127 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 931/1930] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:19 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1423 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:20.056442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:20.057728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:20.075042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.082174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:20.084984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.088773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:20.519855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:20.520481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:20.538002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.538505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:20.539227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.539663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:20.758149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:20.773129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63449f1a-22ec-4fe7-9e9b-883e74f302f5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1196 microversion: 2.1 time: 0.724538 Apr 09 21:01:20.773924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1000/1931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:20 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1196 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:20.782161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:20.783256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:20.822476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.826090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:20.827775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:20.829883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:21.482827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:21.491554 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0276deef-ce15-4f05-86fd-b379592d141d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1477 microversion: 2.1 time: 0.976376 Apr 09 21:01:21.495002 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 932/1932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:20 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1477 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:21.520132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d33dc0d4-9d10-41ee-87b6-3d156e2ac0c6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f680af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:21.632896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:21.644987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-577ca7de-9613-44b2-891d-4205289c00fe tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1524 microversion: 2.1 time: 0.869849 Apr 09 21:01:21.647474 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1001/1933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:20 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1524 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:21.654524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3cf2f9cd-bea6-4cb3-a3f4-bd9e5ca43c15 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f2d9c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:37.719697 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:01:37.720511 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 (ip 10.222.0.30) !!! Apr 09 21:01:38.522693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d33dc0d4-9d10-41ee-87b6-3d156e2ac0c6 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1448 microversion: 2.1 time: 17.024486 Apr 09 21:01:38.523795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 933/1934] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:21 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1448 bytes in 17027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:38.535592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:38.540519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:38.559030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3cf2f9cd-bea6-4cb3-a3f4-bd9e5ca43c15 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1423 microversion: 2.1 time: 16.910177 Apr 09 21:01:38.560722 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1002/1935] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:21 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1423 bytes in 16912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:38.584223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:38.586078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:38.588902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:38.590187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:38.595615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:38.598887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:38.623513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:38.624187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:38.627979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:38.631710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:39.798391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:39.822009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7f8cb66-8a7b-4456-acff-4f730cba80d2 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1196 microversion: 2.1 time: 1.286436 Apr 09 21:01:39.829461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 934/1936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:38 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1196 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:39.831660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:39.839430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d44f4c47-4695-40b0-acd8-0908df29c6ac tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1474 microversion: 2.1 time: 1.277243 Apr 09 21:01:39.842453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:39.843331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:39.856566 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1003/1937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:38 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1474 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:39.864843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-38f30c06-0609-4418-a920-87649015d567 req-ad858a69-dd39-46d7-8e56-e550159904a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c106988-a070-4123-99d6-e94d156b42b0", "tag": "0f3e486d-5fcd-4183-97a9-2a32f168c323"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:39.868720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:39.870489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:39.872252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:39.872907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:39.898106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-38f30c06-0609-4418-a920-87649015d567 req-ad858a69-dd39-46d7-8e56-e550159904a1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:39.898557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-38f30c06-0609-4418-a920-87649015d567 req-ad858a69-dd39-46d7-8e56-e550159904a1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:39.933382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-38f30c06-0609-4418-a920-87649015d567 req-ad858a69-dd39-46d7-8e56-e550159904a1 service nova] Creating event network-changed:0f3e486d-5fcd-4183-97a9-2a32f168c323 for instance 1c106988-a070-4123-99d6-e94d156b42b0 on nch2-master-1 Apr 09 21:01:39.939063 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-38f30c06-0609-4418-a920-87649015d567 req-ad858a69-dd39-46d7-8e56-e550159904a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086689 Apr 09 21:01:39.945740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1004/1938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:39.963308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6e47dbd6-dc39-42f7-be06-d3eed66f8fae req-954726cb-facc-4d8c-ad14-f0013dbf13db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-plugged", "status": "completed", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:40.003127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e47dbd6-dc39-42f7-be06-d3eed66f8fae req-954726cb-facc-4d8c-ad14-f0013dbf13db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:40.003570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e47dbd6-dc39-42f7-be06-d3eed66f8fae req-954726cb-facc-4d8c-ad14-f0013dbf13db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:40.033429 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e47dbd6-dc39-42f7-be06-d3eed66f8fae req-954726cb-facc-4d8c-ad14-f0013dbf13db service nova] Creating event network-vif-plugged:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:01:40.042329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6e47dbd6-dc39-42f7-be06-d3eed66f8fae req-954726cb-facc-4d8c-ad14-f0013dbf13db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094005 Apr 09 21:01:40.054160 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1005/1939] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:40.063839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37a5dd37-b3dd-45d5-8f1d-b3af5a0aede4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984a8d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:40.276581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:40.288053 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e470a3b4-a945-47c7-8211-968fd466b3d3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1504 microversion: 2.1 time: 0.454654 Apr 09 21:01:40.291453 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 935/1940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:39 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:40.307800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-416758cf-dc34-4c81-90f7-cc81ae6ee41e tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb0984e5430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:43.816282 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37a5dd37-b3dd-45d5-8f1d-b3af5a0aede4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 200 len: 1448 microversion: 2.1 time: 3.759752 Apr 09 21:01:43.817792 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1006/1941] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:40 2022] GET /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 1448 bytes in 3762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:43.837543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-416758cf-dc34-4c81-90f7-cc81ae6ee41e tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1432 microversion: 2.1 time: 3.543370 Apr 09 21:01:43.847567 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 936/1942] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:40 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1432 bytes in 3554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:43.854899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6077e5c-364d-49c4-9ac7-cf0ce515f6fd tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'create', calling method: .version_select at 0x7fb0984e5160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1829635930", "description": "tempest-description-1426259215"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:44.115621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1846734644", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "7baa1819-530e-4fe9-a0b0-1cedcf135c19"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:44.216058 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6077e5c-364d-49c4-9ac7-cf0ce515f6fd tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.366338 Apr 09 21:01:44.216966 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 937/1943] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:01:43 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:44.272086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] validate_networks() for [('7baa1819-530e-4fe9-a0b0-1cedcf135c19', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:01:44.421872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:44.422665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:44.445265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:44.446143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:44.447132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:44.447760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.016496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:45.033705 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c365c2c3-438e-43c6-89dd-b88d0bb155c0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1196 microversion: 2.1 time: 0.815026 Apr 09 21:01:45.036007 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 938/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:44 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1196 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:45.044864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:45.046894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:45.059513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.062019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.063509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.064495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.441414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:01:45.441966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:45.442584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:01:45.443266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:01:45.444003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:01:45.444642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:01:45.453576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-919bbd61-92d3-45a7-afdc-aebec1b38176 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1471 microversion: 2.1 time: 0.414552 Apr 09 21:01:45.461780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.461780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.461780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.462966 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 939/1945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:45 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:45.465099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.478299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-unplugged", "status": "completed", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}, {"name": "network-changed", "server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:45.491183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Getting quotas for project bd8c462cb0354f748ec4a7bfa561be3d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:01:45.492858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.494289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.496437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Getting quotas for user c89ddff4ad7c4ef1b382b760918d6054 and project bd8c462cb0354f748ec4a7bfa561be3d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:01:45.511993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:01:45.512766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Creating event network-vif-unplugged:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch2-master-1 Apr 09 21:01:45.513439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Creating event network-changed:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch2-master-1 Apr 09 21:01:45.515132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:01:45.521203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] Instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:01:45.535831 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e2d9b352-0314-4edc-9eba-bad75f0eaf80 req-e9b2a540-74d5-4e4f-bcf7-29c35523179b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.070497 Apr 09 21:01:45.541785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 940/1946] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:45.548369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2c5e4ad7-f8e9-4b42-9aef-dbd8e129060b req-6610761e-e3ad-4b57-a563-111415f84df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c106988-a070-4123-99d6-e94d156b42b0", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e486d-5fcd-4183-97a9-2a32f168c323"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:45.560776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2c5e4ad7-f8e9-4b42-9aef-dbd8e129060b req-6610761e-e3ad-4b57-a563-111415f84df6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.562083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2c5e4ad7-f8e9-4b42-9aef-dbd8e129060b req-6610761e-e3ad-4b57-a563-111415f84df6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.578508 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2c5e4ad7-f8e9-4b42-9aef-dbd8e129060b req-6610761e-e3ad-4b57-a563-111415f84df6 service nova] Creating event network-vif-plugged:0f3e486d-5fcd-4183-97a9-2a32f168c323 for instance 1c106988-a070-4123-99d6-e94d156b42b0 on nch2-master-1 Apr 09 21:01:45.588177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2c5e4ad7-f8e9-4b42-9aef-dbd8e129060b req-6610761e-e3ad-4b57-a563-111415f84df6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044531 Apr 09 21:01:45.591794 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 941/1947] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:45.615742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e8189719-09fe-479d-8beb-15365feb96f6 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796670 Apr 09 21:01:45.625942 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1007/1948] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:01:45.631170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5441687-35a8-484c-b041-82691e9612bc tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb098494dc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:45.638621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efbef98c-947e-4a29-a435-6ccc79ba1308 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb098480ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:45.757991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5441687-35a8-484c-b041-82691e9612bc tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 200 len: 1432 microversion: 2.1 time: 0.130615 Apr 09 21:01:45.758911 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1008/1949] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:45 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 1432 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:45.784987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1829635930"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:45.788176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:45.815258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.815713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:45.823007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:45.823844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:46.212767 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.network.security_group_api [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Adding security group 8c1fbbe0-f014-455b-ac6e-bdeb28856a3a to port d3c6fdfc-8ba6-48b5-8528-4a48058d742b Apr 09 21:01:46.738636 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efbef98c-947e-4a29-a435-6ccc79ba1308 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 204 len: 0 microversion: 2.1 time: 1.143595 Apr 09 21:01:46.739159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 942/1950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:45 2022] DELETE /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:01:46.747811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:46.748776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:46.758192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:46.758971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:46.760255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:46.760994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.003656 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b41d4a3-f8c0-4fe0-8346-88c2b9ef26e0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "POST /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7/action" status: 202 len: 0 microversion: 2.1 time: 0.262310 Apr 09 21:01:47.004657 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 943/1951] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:46 2022] POST /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:47.014423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:47.015418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:47.023996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.024830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.026539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.027253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.353902 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-033580ed-d95c-40d9-96a3-4213cdc73306 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action" status: 202 len: 0 microversion: 2.1 time: 1.593794 Apr 09 21:01:47.354558 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1009/1952] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:45 2022] POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:47.359274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:47.359895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:47.360740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:47.374350 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb2bf171-eaf6-479b-80c5-9681719a3c23 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1220 microversion: 2.1 time: 0.366922 Apr 09 21:01:47.376961 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 944/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:47 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1220 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:47.396066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.398861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.402946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.406622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.409947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:47.412936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:47.422710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.423526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.424832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.425959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.911614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:47.919953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:47.929519 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0cc41db-e280-41bd-9828-5f7366372d51 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1196 microversion: 2.1 time: 0.536235 Apr 09 21:01:47.935909 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 945/1954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:47 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1196 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:47.950408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-935f41f8-8034-4515-8c26-27a4fdc32b8c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1466 microversion: 2.1 time: 0.594662 Apr 09 21:01:47.950905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:47.951273 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1010/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:47 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1466 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:47.951388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:47.957390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:47.958071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:47.965757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.967324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.968915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.969901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.970107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.970572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:47.971380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:47.971947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.024555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:01:48.183102 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a22426df-e32e-4045-8d3d-b66df87df23d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 204 len: 0 microversion: 2.1 time: 0.240544 Apr 09 21:01:48.186675 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 946/1956] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:01:47 2022] DELETE /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:01:48.208619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1829635930"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:48.209830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:48.220802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.222667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.223646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.224306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.500202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:48.511631 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c10fd74b-14ac-43d3-a86e-afcaa36701d8 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1470 microversion: 2.1 time: 0.558991 Apr 09 21:01:48.514442 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1011/1957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:47 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:48.520925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-80b1afbb-cd0a-4355-be8d-728cedd86fc9 req-c74e5a48-3874-4492-8cdf-2fb73e049ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:48.533204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-80b1afbb-cd0a-4355-be8d-728cedd86fc9 req-c74e5a48-3874-4492-8cdf-2fb73e049ad4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.534141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-80b1afbb-cd0a-4355-be8d-728cedd86fc9 req-c74e5a48-3874-4492-8cdf-2fb73e049ad4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.553055 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-80b1afbb-cd0a-4355-be8d-728cedd86fc9 req-c74e5a48-3874-4492-8cdf-2fb73e049ad4 service nova] Creating event network-changed:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:01:48.560331 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-80b1afbb-cd0a-4355-be8d-728cedd86fc9 req-c74e5a48-3874-4492-8cdf-2fb73e049ad4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042968 Apr 09 21:01:48.561350 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1012/1958] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:48.572020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-plugged", "status": "completed", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:48.584022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.588627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.600570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.network.security_group_api [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Removing security group 8c1fbbe0-f014-455b-ac6e-bdeb28856a3a from port d3c6fdfc-8ba6-48b5-8528-4a48058d742b Apr 09 21:01:48.611032 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] Creating event network-vif-plugged:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch2-master-1 Apr 09 21:01:48.632174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] Instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:01:48.649737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c2b00d9f-be5b-45f6-9b8f-1799f9cb09d6 req-766e197d-10b4-44ec-a848-b938d20f958d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082595 Apr 09 21:01:48.656949 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1013/1959] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:48.664966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e8e4203b-f939-4e51-8fff-6a57d1d1f4db tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb0984ae4c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:48.730886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e8e4203b-f939-4e51-8fff-6a57d1d1f4db tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36" status: 200 len: 784 microversion: 2.1 time: 0.071343 Apr 09 21:01:48.731981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1014/1960] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:48 2022] GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:48.737277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:48.738128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:48.745619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.746197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:48.747281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:48.747620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:49.046291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:49.054222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9dcdd012-b10a-4dd1-8397-5240125fd035 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1324 microversion: 2.1 time: 0.321027 Apr 09 21:01:49.054831 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1015/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:48 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:49.065111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-811042215", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "78a6d2d3-bb80-48c0-a446-3fd1d832ea3c"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:49.164080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] validate_networks() for [('78a6d2d3-bb80-48c0-a446-3fd1d832ea3c', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:01:49.903000 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a73d2725-69e0-4e0c-ac38-ec116735f0f1 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action" status: 202 len: 0 microversion: 2.1 time: 1.711357 Apr 09 21:01:49.926464 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 947/1962] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:48 2022] POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action => generated 0 bytes in 1720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:49.926464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c0633e96-292b-4592-91dc-39c927b2b1a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:49.940242 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c0633e96-292b-4592-91dc-39c927b2b1a0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030943 Apr 09 21:01:49.940988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 948/1963] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:01:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:49.968506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:49.971239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:49.985723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:49.986501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:49.987629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:49.989733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:50.559836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:50.571165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc85ed94-faca-42a8-88e8-c6e20e21dc26 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1379 microversion: 2.1 time: 0.618427 Apr 09 21:01:50.571777 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 949/1964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:49 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1379 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:50.584089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:50.584890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:50.604067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:50.604594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:50.605454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:50.605896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:51.084769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:01:51.085582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:01:51.085682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:01:51.086742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:01:51.087232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:01:51.103594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:51.104379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:51.105438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:51.106048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:51.177914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:01:51.183132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Getting quotas for user 33746e27054c4f1db976d4a4ae44e073 and project 333402ee57fb405f856c323a638d2b7c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:01:51.200047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:01:51.202873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:01:51.321610 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1aa9ac5-4803-4928-96af-157f785b4bf5 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264284 Apr 09 21:01:51.328119 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1016/1965] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:01:51.341116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2eee62ac-6343-4e1c-8a03-f87d1b398843 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'create', calling method: .version_select at 0x7fb0984beaf0>, body: {"pool": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:51.363083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:51.376890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8da32fa4-01e4-4ee5-975f-753a263ce0de tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1470 microversion: 2.1 time: 0.801994 Apr 09 21:01:51.377500 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 950/1966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:50 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:51.383996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-79325341-8e61-446c-9b10-4a4af7c9e9e2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f680430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:52.339297 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-79325341-8e61-446c-9b10-4a4af7c9e9e2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "DELETE /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 204 len: 0 microversion: 2.1 time: 0.960434 Apr 09 21:01:52.339951 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 951/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:51 2022] DELETE /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 0 bytes in 962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:01:52.345066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:52.345784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:52.352611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.353370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.354623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.355311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.605797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:52.615407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-282bbb47-74e3-48ae-a0d7-a7d16c1ba936 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1324 microversion: 2.1 time: 0.274114 Apr 09 21:01:52.616198 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 952/1968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:52 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:52.621646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7b43ea28-910c-43dd-8d61-92037a21f63d req-9c9a0a83-f500-41ca-b71d-0fdf0d89e2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:52.631407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7b43ea28-910c-43dd-8d61-92037a21f63d req-9c9a0a83-f500-41ca-b71d-0fdf0d89e2b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.632004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7b43ea28-910c-43dd-8d61-92037a21f63d req-9c9a0a83-f500-41ca-b71d-0fdf0d89e2b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.646671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7b43ea28-910c-43dd-8d61-92037a21f63d req-9c9a0a83-f500-41ca-b71d-0fdf0d89e2b9 service nova] Creating event network-changed:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:01:52.652143 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7b43ea28-910c-43dd-8d61-92037a21f63d req-9c9a0a83-f500-41ca-b71d-0fdf0d89e2b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 Apr 09 21:01:52.656546 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 953/1969] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:52.662151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:52.662815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:52.669848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.670698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.671673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.672267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.946664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d84302f8-ad9e-4508-86fd-fb6bf8102f87 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1530 microversion: 2.1 time: 0.288555 Apr 09 21:01:52.948000 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 954/1970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:52 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1530 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:52.953470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f0b900-a8be-424c-be26-d266ce3db2aa", "name": "network-vif-unplugged", "status": "completed", "tag": "481b9036-1f2d-4ed1-8401-4454c5eca990"}, {"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-unplugged", "status": "completed", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:52.966213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:52.966874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:52.982153 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] Creating event network-vif-unplugged:481b9036-1f2d-4ed1-8401-4454c5eca990 for instance 99f0b900-a8be-424c-be26-d266ce3db2aa on nch2-master-1 Apr 09 21:01:52.982705 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] Creating event network-vif-unplugged:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:01:52.993333 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-805f2e5d-b33e-4933-912e-baff78eac668 req-f3fd59e5-5d38-48f1-bb78-85dd0321db19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043690 Apr 09 21:01:52.994062 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 955/1971] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:53.001194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4a06ec2a-c809-47a1-b0e3-138c5d3b52ff req-e935bd20-0145-46e1-bf0f-a58b4d4aea38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:53.013845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4a06ec2a-c809-47a1-b0e3-138c5d3b52ff req-e935bd20-0145-46e1-bf0f-a58b4d4aea38 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.014978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4a06ec2a-c809-47a1-b0e3-138c5d3b52ff req-e935bd20-0145-46e1-bf0f-a58b4d4aea38 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.028279 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4a06ec2a-c809-47a1-b0e3-138c5d3b52ff req-e935bd20-0145-46e1-bf0f-a58b4d4aea38 service nova] Creating event network-changed:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:01:53.034037 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4a06ec2a-c809-47a1-b0e3-138c5d3b52ff req-e935bd20-0145-46e1-bf0f-a58b4d4aea38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037891 Apr 09 21:01:53.035175 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 956/1972] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:53.041029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:53.042066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:53.050000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.050664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.051768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.052459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.171773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:53.183733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8554cc24-c465-4a32-abb1-eba4201fc8d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1211 microversion: 2.1 time: 0.147048 Apr 09 21:01:53.185137 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 957/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:53 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:53.191050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3f8dd24-9c1d-4332-b1f2-d1974b16f9f7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f161700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:53.217983 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d3f8dd24-9c1d-4332-b1f2-d1974b16f9f7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] HTTP exception thrown: Image not found. Apr 09 21:01:53.218654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3f8dd24-9c1d-4332-b1f2-d1974b16f9f7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:01:53.219703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3f8dd24-9c1d-4332-b1f2-d1974b16f9f7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 404 len: 62 microversion: 2.1 time: 0.033307 Apr 09 21:01:53.221194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 958/1974] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:53 2022] GET /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:01:53.372852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:53.373770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:53.382284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.383028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.384024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.384676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.744298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:53.763629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6904072-81b2-40d8-aef8-386b91fdeaed tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1470 microversion: 2.1 time: 0.541082 Apr 09 21:01:53.764195 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 959/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:53 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:53.769416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:53.770274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:53.794064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.794727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:53.795729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:53.796175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.153760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15a3938c-dc82-4bc3-b4bb-561671b3555a tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1530 microversion: 2.1 time: 0.388208 Apr 09 21:01:54.157787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 960/1976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:53 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1530 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:54.173307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-917370812"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:54.174764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:54.185239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2eee62ac-6343-4e1c-8a03-f87d1b398843 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.860667 Apr 09 21:01:54.186225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1017/1977] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 21:01:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:54.187772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.189712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.190705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.196353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:54.197274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.197421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:54.210605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.211220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.212980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.214669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.435525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:54.452908 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-728e2709-dc85-42df-95be-527517195578 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1324 microversion: 2.1 time: 0.264747 Apr 09 21:01:54.463469 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1018/1978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:54 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:54.468568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:54.470389 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:01:54.470389 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:01:54.472108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.472739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.474967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.475723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.508038 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-497b5fde-2d3b-4c44-a407-eab6fd15b196 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043129 Apr 09 21:01:54.509326 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1019/1979] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 21:01:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:54.514821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.144"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:54.516180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:54.523008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.523406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.524189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.524808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.550783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Acquired lock "refresh_cache-caa1ac0b-76eb-4a3e-8430-59674f1ecf27" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:01:54.624456 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6efc8e6b-8f6a-4e45-b8d8-34657a816896 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "POST /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526/action" status: 202 len: 0 microversion: 2.1 time: 0.464897 Apr 09 21:01:54.636661 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 961/1980] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:54 2022] POST /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:01:54.642658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:54.643354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:54.667585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.668906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.669980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.670726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.817388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:54.826970 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdd89368-05fc-4384-bdbf-5ea559369fdd tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1265 microversion: 2.1 time: 0.188421 Apr 09 21:01:54.827783 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 962/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:54 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:54.833717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:54.835138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:54.842601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.843274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.844547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:54.845187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:54.874679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lazy-loading 'flavor' on Instance uuid 1c106988-a070-4123-99d6-e94d156b42b0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:01:54.889825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Going to try to live migrate instance to nch1-master-1 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 21:01:56.808933 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c46149aa-e5f1-480c-b726-2a40308a37dd tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0/action" status: 202 len: 0 microversion: 2.1 time: 1.979755 Apr 09 21:01:56.811174 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 963/1982] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:54 2022] POST /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0/action => generated 0 bytes in 1982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:01:56.818835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa658e6e-e32c-4eb8-886a-7815e5341976 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f161e50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:56.926122 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa658e6e-e32c-4eb8-886a-7815e5341976 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1428 microversion: 2.1 time: 0.112894 Apr 09 21:01:56.927647 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 964/1983] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:01:56 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:56.935683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a52a15ea-db10-48d5-9442-7316b6979bc4 req-23d1c117-23e0-4d6e-bacf-8cc4c7c55760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f0b900-a8be-424c-be26-d266ce3db2aa", "name": "network-vif-deleted", "tag": "481b9036-1f2d-4ed1-8401-4454c5eca990"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:01:56.965354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a52a15ea-db10-48d5-9442-7316b6979bc4 req-23d1c117-23e0-4d6e-bacf-8cc4c7c55760 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:56.967831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a52a15ea-db10-48d5-9442-7316b6979bc4 req-23d1c117-23e0-4d6e-bacf-8cc4c7c55760 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:57.007585 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a52a15ea-db10-48d5-9442-7316b6979bc4 req-23d1c117-23e0-4d6e-bacf-8cc4c7c55760 service nova] Creating event network-vif-deleted:481b9036-1f2d-4ed1-8401-4454c5eca990 for instance 99f0b900-a8be-424c-be26-d266ce3db2aa on nch2-master-1 Apr 09 21:01:57.015743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a52a15ea-db10-48d5-9442-7316b6979bc4 req-23d1c117-23e0-4d6e-bacf-8cc4c7c55760 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084664 Apr 09 21:01:57.024853 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 965/1984] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:01:57.031881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:57.034334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:57.045478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:57.046333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:57.047460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:57.048068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:58.247168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:58.257770 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-850c9a6c-f957-4052-b47f-c88bc40a102a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1470 microversion: 2.1 time: 1.234068 Apr 09 21:01:58.268489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 966/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:57 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1470 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:58.274049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:58.274901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:58.281843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:58.282543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:58.283564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:58.284166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:58.896680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:58.909964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42f4df96-8ec7-4848-879c-3bcdab7e94d8 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1324 microversion: 2.1 time: 0.639229 Apr 09 21:01:58.910579 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 967/1986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:58 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1324 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:58.931119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:58.931800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:58.975679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:58.976409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:58.978097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:58.978697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:59.803822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:01:59.816890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f70b009-3b01-4da0-985b-b6bf9990584d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1307 microversion: 2.1 time: 0.903820 Apr 09 21:01:59.817964 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 968/1987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:58 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1307 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:01:59.825346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:01:59.826175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:01:59.837915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:59.840368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:01:59.841451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:01:59.842331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:00.476569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:02:01.045161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:01.058080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f784c04-db2e-4a98-b941-33db19c74ed1 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 1.238226 Apr 09 21:02:01.059923 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 969/1988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:01:59 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:01.083761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-unplugged", "status": "completed", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:01.113090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:01.113826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:01.148958 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] Creating event network-vif-unplugged:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:02:01.166857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] Instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:02:01.199885 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-551443ff-2f12-4f88-a234-8405202ac5f9 req-a3abe96a-7f5d-4668-8dc5-3c6c47c08ccf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132609 Apr 09 21:02:01.203080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 970/1989] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:01.216245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-72e6161b-d3d1-490f-88af-24719bc6f598 req-6f1210ba-64a7-437a-888c-6f4ce390b140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:01.237130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72e6161b-d3d1-490f-88af-24719bc6f598 req-6f1210ba-64a7-437a-888c-6f4ce390b140 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:01.237958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72e6161b-d3d1-490f-88af-24719bc6f598 req-6f1210ba-64a7-437a-888c-6f4ce390b140 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:01.263869 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-72e6161b-d3d1-490f-88af-24719bc6f598 req-6f1210ba-64a7-437a-888c-6f4ce390b140 service nova] Creating event network-vif-plugged:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:02:01.278977 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-72e6161b-d3d1-490f-88af-24719bc6f598 req-6f1210ba-64a7-437a-888c-6f4ce390b140 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073853 Apr 09 21:02:01.284701 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 971/1990] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:01.298581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab4ef19d-9241-4f87-9889-da6f359539f0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f2af820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:02.997559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Updating instance_info_cache with network_info: [{"id": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b", "address": "fa:16:3e:59:cf:6f", "network": {"id": "61e5f5f4-430e-4ab0-b6e0-c7f372b7c7b4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-878228555-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8584541985ac44cc923c89a5a518ec32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd3c6fdfc-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:02:03.015474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Releasing lock "refresh_cache-caa1ac0b-76eb-4a3e-8430-59674f1ecf27" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:02:03.016453 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0eb38ac6-b9ca-4048-81b8-bdb1964fe9ed tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action" status: 202 len: 0 microversion: 2.1 time: 8.505857 Apr 09 21:02:03.020627 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1020/1991] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:01:54 2022] POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action => generated 0 bytes in 8510 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:02:03.025488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:03.026425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:03.033387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.034099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.035093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.035687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.194739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:03.207126 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f83c78db-f99b-4d27-bf44-d1f20d7492e7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1470 microversion: 2.1 time: 0.185177 Apr 09 21:02:03.208781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1021/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:03 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:03.218578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:03.219475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:03.228976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.229702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.230668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.231411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.494781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:03.510723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba1fc6e7-330e-4649-8d4f-ca80ba7e5c4a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1324 microversion: 2.1 time: 0.299028 Apr 09 21:02:03.521261 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1022/1993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:03 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:03.529099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:03.530058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:03.538254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.538967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.540074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.540785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.790826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:03.806021 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9183c4b2-fa92-404b-bb38-6221c1fde149 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1307 microversion: 2.1 time: 0.276247 Apr 09 21:02:03.807456 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1023/1994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:03 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:03.823548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:03.824460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:03.833683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.834489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:03.835446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:03.836093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:04.037223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:04.050816 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9eec2f0e-541c-44f6-acb8-ca18d96f41a7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 0.230783 Apr 09 21:02:04.051762 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1024/1995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:03 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:04.073382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Action: 'action', calling method: .version_select at 0x7fb0958ce040>, body: {"removeFloatingIp": {"address": "172.35.0.144"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:04.271062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:04.278719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:04.279558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:04.280607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:04.282267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:04.612255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Acquired lock "refresh_cache-caa1ac0b-76eb-4a3e-8430-59674f1ecf27" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:02:06.860503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:02:08.035694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Updating instance_info_cache with network_info: [{"id": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b", "address": "fa:16:3e:59:cf:6f", "network": {"id": "61e5f5f4-430e-4ab0-b6e0-c7f372b7c7b4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-878228555-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8584541985ac44cc923c89a5a518ec32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd3c6fdfc-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:02:08.054053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Releasing lock "refresh_cache-caa1ac0b-76eb-4a3e-8430-59674f1ecf27" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:02:08.067124 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e4d71070-de51-4fb0-af66-373df97f979c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action" status: 202 len: 0 microversion: 2.1 time: 3.995739 Apr 09 21:02:08.070666 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1025/1996] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:02:04 2022] POST /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27/action => generated 0 bytes in 4008 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:02:08.097839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}, {"name": "network-changed", "server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}, {"name": "network-changed", "server_uuid": "f7ed45b6-7a60-4c33-83d6-db2a14b21bed", "tag": "462aa770-8d57-4511-8729-466cb3c11cb7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:08.138904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.139902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:08.184020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Creating event network-changed:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:02:08.184843 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Creating event network-changed:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:02:08.185538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] Creating event network-changed:462aa770-8d57-4511-8729-466cb3c11cb7 for instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed on nch2-master-1 Apr 09 21:02:08.212444 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2d46a91a-3c99-4cf0-8d24-6d207b7d853c req-efe7e557-e3f7-4168-a105-007fbd6dea50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.134947 Apr 09 21:02:08.214008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1026/1997] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:08.245958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-234de798-f79b-4d12-ad60-7fa8a0077aea req-3a2de775-862e-41a1-99de-3d9c4ad71400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-plugged", "status": "completed", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:08.272621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-234de798-f79b-4d12-ad60-7fa8a0077aea req-3a2de775-862e-41a1-99de-3d9c4ad71400 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.276183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-234de798-f79b-4d12-ad60-7fa8a0077aea req-3a2de775-862e-41a1-99de-3d9c4ad71400 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:08.294973 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-234de798-f79b-4d12-ad60-7fa8a0077aea req-3a2de775-862e-41a1-99de-3d9c4ad71400 service nova] Creating event network-vif-plugged:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:02:08.304710 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-234de798-f79b-4d12-ad60-7fa8a0077aea req-3a2de775-862e-41a1-99de-3d9c4ad71400 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089130 Apr 09 21:02:08.306257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1027/1998] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:08.314707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:08.317751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:08.330525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.331937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:08.333274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.334172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:08.904755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab4ef19d-9241-4f87-9889-da6f359539f0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1428 microversion: 2.1 time: 7.618354 Apr 09 21:02:08.906116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 972/1999] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:01 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1428 bytes in 7621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:08.918053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:08.919856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:08.928229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.928989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:08.930019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:08.930625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.154746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:09.171408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7be03a76-3eab-4565-93d0-6645e09894b0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1463 microversion: 2.1 time: 0.863517 Apr 09 21:02:09.175752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1028/2000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:08 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1463 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:09.189929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:09.194333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:09.210135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:09.213740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.217294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:09.218753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.315220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:09.336342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3043716-97f7-4719-a151-d8e6eb02abe4 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1520 microversion: 2.1 time: 0.422165 Apr 09 21:02:09.336342 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 973/2001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:08 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:09.367651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:09.368407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:09.399784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:09.401001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.404114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:09.404790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.641785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:09.652692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a57bfb22-8e65-4195-9c95-1cc9cec3942b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1307 microversion: 2.1 time: 0.475368 Apr 09 21:02:09.665977 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1029/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:09 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1307 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:09.671875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b0757a94-1997-4393-ad99-667b32412cfa req-90d174c2-a44d-4e5c-8ca2-1e7f5c69c800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c106988-a070-4123-99d6-e94d156b42b0", "name": "network-vif-unplugged", "status": "completed", "tag": "0f3e486d-5fcd-4183-97a9-2a32f168c323"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:09.709822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b0757a94-1997-4393-ad99-667b32412cfa req-90d174c2-a44d-4e5c-8ca2-1e7f5c69c800 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:09.714740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b0757a94-1997-4393-ad99-667b32412cfa req-90d174c2-a44d-4e5c-8ca2-1e7f5c69c800 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:09.747605 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b0757a94-1997-4393-ad99-667b32412cfa req-90d174c2-a44d-4e5c-8ca2-1e7f5c69c800 service nova] Creating event network-vif-unplugged:0f3e486d-5fcd-4183-97a9-2a32f168c323 for instance 1c106988-a070-4123-99d6-e94d156b42b0 on nch2-master-1 Apr 09 21:02:09.762889 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b0757a94-1997-4393-ad99-667b32412cfa req-90d174c2-a44d-4e5c-8ca2-1e7f5c69c800 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094600 Apr 09 21:02:09.766516 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1030/2003] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:09.778936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed1d3a2b-fa15-4574-87a2-7f3004b77418 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '.version_select at 0x7fb0984b7820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:09.795313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:09.811384 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bdecc2b0-2748-4b1c-b333-22c4ac5bf078 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 0.475093 Apr 09 21:02:09.812925 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 974/2004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:09 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:10.018441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Action: 'create', calling method: .version_select at 0x7fb0984804c0>, body: {"keypair": {"name": "tempest-keypair-1965686660"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:10.050728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for project 5d288e617526417680b8d375cf87e380. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:10.062182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for user dd753dc1202f4e138094f0f50b83b2f4 and project 5d288e617526417680b8d375cf87e380. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:10.314345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for project 5d288e617526417680b8d375cf87e380. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:10.325515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for user dd753dc1202f4e138094f0f50b83b2f4 and project 5d288e617526417680b8d375cf87e380. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:10.341583 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e025bd17-86c2-410f-9973-7ffc61e75df8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.526967 Apr 09 21:02:10.342635 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 975/2005] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:02:09 2022] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:10.347626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:10.349229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:10.356680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:10.357445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:10.358271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:10.359570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:10.736335 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43aea00f-5cf0-48d6-8fe2-68961632f342 tempest-MigrationsAdminTest-648520172 tempest-MigrationsAdminTest-648520172-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1614 microversion: 2.1 time: 0.389578 Apr 09 21:02:10.737493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 976/2006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:10 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1614 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:10.749590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6a6f9a5-e4ae-4b48-b68d-0fbdb49455f9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'create', calling method: .version_select at 0x7fb08ec02d30>, body: {"pool": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:11.884849 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed1d3a2b-fa15-4574-87a2-7f3004b77418 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/0139cf8f-46ce-48f9-b8a6-842a61d536cd" status: 202 len: 0 microversion: 2.1 time: 2.116262 Apr 09 21:02:11.885910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1031/2007] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:02:09 2022] DELETE /compute/v2.1/os-floating-ips/0139cf8f-46ce-48f9-b8a6-842a61d536cd => generated 0 bytes in 2118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:11.892816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-046a15a1-2554-41bd-86a2-f065e53fd4f6 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb098494700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:11.972022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-046a15a1-2554-41bd-86a2-f065e53fd4f6 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1428 microversion: 2.1 time: 0.084737 Apr 09 21:02:11.979477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1032/2008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:11 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:11.984837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d4183fc1-f798-40c2-ab50-e83d3d2d2769 req-3fdea8d7-70fd-4746-954b-2d4c3c3660f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:11.996557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d4183fc1-f798-40c2-ab50-e83d3d2d2769 req-3fdea8d7-70fd-4746-954b-2d4c3c3660f8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:11.997209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d4183fc1-f798-40c2-ab50-e83d3d2d2769 req-3fdea8d7-70fd-4746-954b-2d4c3c3660f8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.013409 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d4183fc1-f798-40c2-ab50-e83d3d2d2769 req-3fdea8d7-70fd-4746-954b-2d4c3c3660f8 service nova] Creating event network-changed:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:02:12.021025 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d4183fc1-f798-40c2-ab50-e83d3d2d2769 req-3fdea8d7-70fd-4746-954b-2d4c3c3660f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040118 Apr 09 21:02:12.022451 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1033/2009] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:12.031859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-53478f2c-7f22-4692-8136-37161debb551 req-86ee972d-544a-48f8-a37e-977f820480d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ed45b6-7a60-4c33-83d6-db2a14b21bed", "name": "network-vif-plugged", "status": "completed", "tag": "462aa770-8d57-4511-8729-466cb3c11cb7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:12.066990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53478f2c-7f22-4692-8136-37161debb551 req-86ee972d-544a-48f8-a37e-977f820480d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.068892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53478f2c-7f22-4692-8136-37161debb551 req-86ee972d-544a-48f8-a37e-977f820480d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.087849 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-53478f2c-7f22-4692-8136-37161debb551 req-86ee972d-544a-48f8-a37e-977f820480d2 service nova] Creating event network-vif-plugged:462aa770-8d57-4511-8729-466cb3c11cb7 for instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed on nch2-master-1 Apr 09 21:02:12.106028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-53478f2c-7f22-4692-8136-37161debb551 req-86ee972d-544a-48f8-a37e-977f820480d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077811 Apr 09 21:02:12.107428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1034/2010] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:12.230111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:12.231693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:12.242430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.243160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.250634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.251197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.578102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:12.599416 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89a05840-273b-4c16-a815-fe67a718a1ad tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1307 microversion: 2.1 time: 0.490470 Apr 09 21:02:12.602283 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1035/2011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:12 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1307 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:12.614978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:12.615925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:12.629446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.630960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.632386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.633633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.681848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:12.852866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79f821c9-3a93-47ea-be66-2457354cffd7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "DELETE /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 204 len: 0 microversion: 2.1 time: 0.246331 Apr 09 21:02:12.857327 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1036/2012] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:12 2022] DELETE /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:12.860992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:12.862691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:12.885558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.887105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:12.888191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:12.888870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:13.307812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:13.317939 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ff933be-d2ac-475f-8112-0ffdd1c4022a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 0.462061 Apr 09 21:02:13.321578 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1037/2013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:12 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:13.328184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1c7a6684-0fe4-4cd3-87b2-739c1bef0250 req-9e98c9cf-27cf-470f-ac80-4f27be3f6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c106988-a070-4123-99d6-e94d156b42b0", "tag": "0f3e486d-5fcd-4183-97a9-2a32f168c323"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:13.343553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1c7a6684-0fe4-4cd3-87b2-739c1bef0250 req-9e98c9cf-27cf-470f-ac80-4f27be3f6f5e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:13.344002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1c7a6684-0fe4-4cd3-87b2-739c1bef0250 req-9e98c9cf-27cf-470f-ac80-4f27be3f6f5e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:13.356642 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1c7a6684-0fe4-4cd3-87b2-739c1bef0250 req-9e98c9cf-27cf-470f-ac80-4f27be3f6f5e service nova] Creating event network-changed:0f3e486d-5fcd-4183-97a9-2a32f168c323 for instance 1c106988-a070-4123-99d6-e94d156b42b0 on nch2-master-1 Apr 09 21:02:13.363467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1c7a6684-0fe4-4cd3-87b2-739c1bef0250 req-9e98c9cf-27cf-470f-ac80-4f27be3f6f5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040249 Apr 09 21:02:13.365806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1038/2014] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:13.374110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-00da69e5-7041-494c-91ea-b84f35592a6c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '.version_select at 0x7fb0984c6430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:13.790119 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-00da69e5-7041-494c-91ea-b84f35592a6c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8c1fbbe0-f014-455b-ac6e-bdeb28856a3a" status: 202 len: 0 microversion: 2.1 time: 0.420818 Apr 09 21:02:13.791263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1039/2015] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:13 2022] DELETE /compute/v2.1/os-security-groups/8c1fbbe0-f014-455b-ac6e-bdeb28856a3a => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:13.798858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:13.801186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:13.818740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:13.819579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:13.821240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:13.822242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:14.171769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:14.187300 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6a6f9a5-e4ae-4b48-b68d-0fbdb49455f9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.448425 Apr 09 21:02:14.188261 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 977/2016] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 21:02:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:14.192025 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65f8b411-6ec3-4c13-8fa1-790a5d9d3842 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1469 microversion: 2.1 time: 0.397549 Apr 09 21:02:14.193754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1048968417", "imageRef": "ad48a1be-96fe-4bfd-b2cf-95ccfcf68f0d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "08b7112f-413f-4fd7-98f3-1757fa9cef25"}], "security_groups": [{"name": "tempest-securitygroup--511015790"}], "key_name": "tempest-keypair-1965686660", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:14.203535 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1040/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:13 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:14.210096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9dce4704-0271-4035-8158-f944f29512e6 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb0984ec700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:14.316058 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9dce4704-0271-4035-8158-f944f29512e6 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1428 microversion: 2.1 time: 0.100076 Apr 09 21:02:14.323431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1041/2018] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:14 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:14.329838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:14.330472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:14.339662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:14.340590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:14.343235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:14.343945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:14.406581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] validate_networks() for [('08b7112f-413f-4fd7-98f3-1757fa9cef25', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:02:14.941909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:14.952065 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-068d184c-6ab6-4ad4-be89-815e9e1ea2d9 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1487 microversion: 2.1 time: 0.632656 Apr 09 21:02:14.952655 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1042/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:14 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1487 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:14.976120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:14.978389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:14.998231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:14.999094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.000112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.007032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.077913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:15.279442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dbfe798a-debf-4fdb-91c6-3c72967ce17e tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "DELETE /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 204 len: 0 microversion: 2.1 time: 0.311519 Apr 09 21:02:15.280728 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1043/2020] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:14 2022] DELETE /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:15.287671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a68eef9d-d434-4e38-8aae-52dd022bae78 req-f305476e-ca0c-4866-aaf8-f5f82d8aedf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-plugged", "status": "completed", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:15.299373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a68eef9d-d434-4e38-8aae-52dd022bae78 req-f305476e-ca0c-4866-aaf8-f5f82d8aedf0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.299811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a68eef9d-d434-4e38-8aae-52dd022bae78 req-f305476e-ca0c-4866-aaf8-f5f82d8aedf0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.328686 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a68eef9d-d434-4e38-8aae-52dd022bae78 req-f305476e-ca0c-4866-aaf8-f5f82d8aedf0 service nova] Creating event network-vif-plugged:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:02:15.336014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a68eef9d-d434-4e38-8aae-52dd022bae78 req-f305476e-ca0c-4866-aaf8-f5f82d8aedf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053694 Apr 09 21:02:15.336608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1044/2021] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:15.352182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1596692362", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "7baa1819-530e-4fe9-a0b0-1cedcf135c19"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:15.463340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] validate_networks() for [('7baa1819-530e-4fe9-a0b0-1cedcf135c19', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:02:15.521532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:02:15.522695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:02:15.523851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:02:15.525117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:02:15.525961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:02:15.542445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.543191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.544172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.544764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.573296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for project 5d288e617526417680b8d375cf87e380. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:15.579193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Getting quotas for user dd753dc1202f4e138094f0f50b83b2f4 and project 5d288e617526417680b8d375cf87e380. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:15.608342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:02:15.613896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad48a1be-96fe-4bfd-b2cf-95ccfcf68f0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:02:15.771379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7c8119e-0a7f-4a83-854f-6e3867847ea8 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.581684 Apr 09 21:02:15.786463 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 978/2022] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:02:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:02:15.799725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:15.800419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:15.825257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.825913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:15.827002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:15.827610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.160069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.167819 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d126e0e2-6c0c-4b0a-be61-f501fd00579c tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 0.380205 Apr 09 21:02:16.177371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 979/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:15 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.182869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-516969440"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:16.183962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.190474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.190916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.191906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.192494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.205121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:02:16.206036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:02:16.207669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:02:16.208080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:02:16.208706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:02:16.221842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.222310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.223761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.224933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.246764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Getting quotas for project bd8c462cb0354f748ec4a7bfa561be3d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:16.251135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Getting quotas for user c89ddff4ad7c4ef1b382b760918d6054 and project bd8c462cb0354f748ec4a7bfa561be3d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:16.264674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:02:16.267919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:02:16.335966 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e4930fcd-7583-4327-a0b3-198a7ce1bae7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995033 Apr 09 21:02:16.337276 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1045/2024] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:02:16.343388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.344012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.351427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.351931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.352983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.353449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.435157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.444529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fee31668-8e20-4cf4-8ba8-90f8a8f138fd tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1427 microversion: 2.1 time: 0.105005 Apr 09 21:02:16.444983 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1046/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.449749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.450358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.459437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.460043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.460959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.461647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.506907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05a2c6d6-7902-400b-bd3d-e4e2f8ebe141 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "POST /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed/action" status: 202 len: 0 microversion: 2.1 time: 0.327486 Apr 09 21:02:16.509485 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 980/2026] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:02:16 2022] POST /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:02:16.516934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d6da445-80ec-4bbd-b7f1-3157d3d24223 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08ec02280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.571107 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d6da445-80ec-4bbd-b7f1-3157d3d24223 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1437 microversion: 2.1 time: 0.059943 Apr 09 21:02:16.571888 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 981/2027] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.578138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-953121bf-52c9-4503-928f-f70c27f12363 req-40eec26e-bb00-4a28-a705-18cef0f02a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ec7623-1c2c-4348-bf3b-eddaadd243b7", "name": "network-vif-deleted", "tag": "79de6324-3cb0-4989-8e84-896636fe0a0e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:16.588537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-953121bf-52c9-4503-928f-f70c27f12363 req-40eec26e-bb00-4a28-a705-18cef0f02a57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.589254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-953121bf-52c9-4503-928f-f70c27f12363 req-40eec26e-bb00-4a28-a705-18cef0f02a57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.605143 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-953121bf-52c9-4503-928f-f70c27f12363 req-40eec26e-bb00-4a28-a705-18cef0f02a57 service nova] Creating event network-vif-deleted:79de6324-3cb0-4989-8e84-896636fe0a0e for instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 on nch1-master-1 Apr 09 21:02:16.611125 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-953121bf-52c9-4503-928f-f70c27f12363 req-40eec26e-bb00-4a28-a705-18cef0f02a57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Apr 09 21:02:16.612257 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 982/2028] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:16.617888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.618762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.625805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.626261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.627084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.627635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.635361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.643018 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d3887a6a-b642-479d-96a5-48d269219821 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1510 microversion: 2.1 time: 0.197044 Apr 09 21:02:16.643924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1047/2029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.648992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3f10778-911c-4a38-a8f6-c94913d016b5 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.650089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3f10778-911c-4a38-a8f6-c94913d016b5 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.722309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.723402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3f10778-911c-4a38-a8f6-c94913d016b5 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.731778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3f10778-911c-4a38-a8f6-c94913d016b5 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1224 microversion: 2.1 time: 0.086542 Apr 09 21:02:16.741354 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1048/2030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.741543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0de10b09-3177-47be-a735-679fea2f0315 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1250 microversion: 2.1 time: 0.121134 Apr 09 21:02:16.741543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 983/2031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1250 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.741767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f367b2c-a0c1-42ee-8695-19e44a22554e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984a83a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.741864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-111c0d16-962e-4b64-ad3a-6d9fb4fbe075 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb08f1790d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.793934 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f367b2c-a0c1-42ee-8695-19e44a22554e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835" status: 200 len: 1413 microversion: 2.1 time: 0.059912 Apr 09 21:02:16.794512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1049/2032] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.794757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-111c0d16-962e-4b64-ad3a-6d9fb4fbe075 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 200 len: 1437 microversion: 2.1 time: 0.058208 Apr 09 21:02:16.795433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 984/2033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.807645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9d062bd-d053-4469-9081-0fdd73049a9a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08f398d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.811972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.813565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:16.820751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.821436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.823734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:16.824366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:16.852942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9d062bd-d053-4469-9081-0fdd73049a9a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835" status: 200 len: 1413 microversion: 2.1 time: 0.050095 Apr 09 21:02:16.853557 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1050/2034] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835 => generated 1413 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.864581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-216423af-be7b-45d4-8c08-9402bbb2990e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984b7b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:16.960118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:16.968812 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54e3ae62-8943-4c01-8db2-eac5b767b141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1479 microversion: 2.1 time: 0.162895 Apr 09 21:02:16.969668 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 985/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1479 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:16.996842 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-216423af-be7b-45d4-8c08-9402bbb2990e tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835" status: 204 len: 0 microversion: 2.1 time: 0.135861 Apr 09 21:02:16.997456 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1051/2036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:16 2022] DELETE /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:02:17.006044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d10caf8c-be1a-4cb6-894f-3b724b76361c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08eccc280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.029015 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d10caf8c-be1a-4cb6-894f-3b724b76361c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Image not found. Apr 09 21:02:17.029670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d10caf8c-be1a-4cb6-894f-3b724b76361c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:17.030581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d10caf8c-be1a-4cb6-894f-3b724b76361c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835" status: 404 len: 62 microversion: 2.1 time: 0.028771 Apr 09 21:02:17.031187 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 986/2037] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:17.039549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.040173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.047050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.047556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.048375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.048878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.184965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.185758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.186439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.193601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.194163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.195156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.195332 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d24876aa-a63d-44db-a547-806aba0e235c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1499 microversion: 2.1 time: 0.159517 Apr 09 21:02:17.195731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.195931 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1052/2038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:17.334515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.343022 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa6df940-937f-480a-858d-ce8c3ac878b7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1389 microversion: 2.1 time: 0.162452 Apr 09 21:02:17.343592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 987/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:17.461107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.461730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.468795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.469265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.470046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.470478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.571672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.581139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a90982ce-15c5-4342-9577-abeb633f90fe tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 200 len: 1427 microversion: 2.1 time: 0.123926 Apr 09 21:02:17.581731 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1053/2040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:17.660880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.661878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.669096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.669656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.670522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.671193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.749318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.750174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.758266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.758718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.759658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.760093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.838465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.846127 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d01cd87-266c-438d-81e9-073cff3217cf tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1220 microversion: 2.1 time: 0.101016 Apr 09 21:02:17.856756 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1054/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:17.856756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.857223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.859240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.866139 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fba5e223-00b0-4665-b10b-83f59494f4e3 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1510 microversion: 2.1 time: 0.207653 Apr 09 21:02:17.878579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.881414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.882082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 988/2042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:17.882413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.882863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.950828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:17.958763 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a695a36a-6a1e-4003-af65-4ecb3f4297e9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1242 microversion: 2.1 time: 0.110900 Apr 09 21:02:17.959681 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1055/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:17.986962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:17.987679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:17.994208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.994742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:17.995610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:17.996124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.211904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.212509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.218710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.219263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.220180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.220518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.257900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:18.268294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d6e3f42-3737-4d90-b238-35822e4c8f6d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1479 microversion: 2.1 time: 0.285058 Apr 09 21:02:18.270416 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 989/2044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:17 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1479 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:18.361669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.362566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.370881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.371237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.372032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.372463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.500379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:18.516006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66e1b136-d5da-40df-b4f8-198aeb4af99c tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1499 microversion: 2.1 time: 0.306228 Apr 09 21:02:18.517959 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1056/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:18.599204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.600312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 09ec7623-1c2c-4348-bf3b-eddaadd243b7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.606953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.607521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.608555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.609263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.617817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:18.626042 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fcd7a340-85ad-4000-8a4a-1695ddaf50ac tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1379 microversion: 2.1 time: 0.268513 Apr 09 21:02:18.626241 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] HTTP exception thrown: Instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 could not be found. Apr 09 21:02:18.626555 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 990/2046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1379 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:18.628258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Returning 404 to user: Instance 09ec7623-1c2c-4348-bf3b-eddaadd243b7 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:18.628258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2bf90c42-8dc7-4e90-9c98-5b8829d103d1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7" status: 404 len: 111 microversion: 2.1 time: 0.033089 Apr 09 21:02:18.637316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1057/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/servers/09ec7623-1c2c-4348-bf3b-eddaadd243b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:18.642888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9c1a6e8-9dc7-4216-b4f0-90a205f13793 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '.version_select at 0x7fb08f2b9820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.645657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c1a6e8-9dc7-4216-b4f0-90a205f13793 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.646105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c1a6e8-9dc7-4216-b4f0-90a205f13793 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.646216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.646777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.657323 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9c1a6e8-9dc7-4216-b4f0-90a205f13793 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2730 microversion: 2.1 time: 0.017868 Apr 09 21:02:18.659664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.660271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.661221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.661769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.665495 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 991/2048] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/os-migrations => generated 2730 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:18.670418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.671035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.678055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.678502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.679372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.679792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.691154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:18.817773 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd30e6ff-e243-45c9-9d90-54c96be6686d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 204 len: 0 microversion: 2.1 time: 0.169919 Apr 09 21:02:18.821848 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1058/2049] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:18 2022] DELETE /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:02:18.831240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:18.833227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:18.853059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.855794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:18.863819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:18.864467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.021353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c8b3ec3-6ff6-4054-9d54-55a468381839 tempest-LiveMigrationTest-1367615552 tempest-LiveMigrationTest-1367615552-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1530 microversion: 2.1 time: 0.354725 Apr 09 21:02:19.021943 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 992/2050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1530 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.026833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.027664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.038007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.038458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.039841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.039841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.074799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.082547 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a1aedbf-3e04-4e44-bc6d-997c3073a2ef tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.258140 Apr 09 21:02:19.083159 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1059/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:18 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.088650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.089442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.096016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.096455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.097363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.097823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.107161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.114799 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6f8f3dd7-4f96-4c27-a4a0-b5f7de4d4497 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1284 microversion: 2.1 time: 0.091620 Apr 09 21:02:19.115499 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 993/2052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.119973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.120696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.127259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.127668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.128458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.128940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.207832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.212989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.216263 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30af3c24-1430-4b88-b6b2-07abf0685f8a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1468 microversion: 2.1 time: 0.132051 Apr 09 21:02:19.216879 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1060/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1468 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.221727 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8e2f7d32-00ef-4fd0-b8a4-21e7ab1070bf tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1304 microversion: 2.1 time: 0.105214 Apr 09 21:02:19.222316 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 994/2054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.222575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7c76dad3-28c7-4037-83fb-e68b3048888c req-56f50c42-3f8f-4f53-8da6-3eeae64c9ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa1ac0b-76eb-4a3e-8430-59674f1ecf27", "name": "network-vif-deleted", "tag": "d3c6fdfc-8ba6-48b5-8528-4a48058d742b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:19.227719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.228329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.234978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.235435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.236652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.236652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.240174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7c76dad3-28c7-4037-83fb-e68b3048888c req-56f50c42-3f8f-4f53-8da6-3eeae64c9ea8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.240812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7c76dad3-28c7-4037-83fb-e68b3048888c req-56f50c42-3f8f-4f53-8da6-3eeae64c9ea8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.254230 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7c76dad3-28c7-4037-83fb-e68b3048888c req-56f50c42-3f8f-4f53-8da6-3eeae64c9ea8 service nova] Creating event network-vif-deleted:d3c6fdfc-8ba6-48b5-8528-4a48058d742b for instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 on nch1-master-1 Apr 09 21:02:19.259383 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7c76dad3-28c7-4037-83fb-e68b3048888c req-56f50c42-3f8f-4f53-8da6-3eeae64c9ea8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041158 Apr 09 21:02:19.259970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1061/2055] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:19.276374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:19.292178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.292893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.300544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.301063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.301944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.302433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.370668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 204 len: 0 microversion: 2.1 time: 0.146986 Apr 09 21:02:19.371706 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 995/2056] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:19 2022] DELETE /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:19.381111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.381892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.391466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.392014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.392925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.393489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.506904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.515167 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8a56081-cb76-462e-889d-22f93facf10c tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1466 microversion: 2.1 time: 0.230400 Apr 09 21:02:19.515750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1062/2057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1466 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:19.534027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.534641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:19.546475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.547255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.548021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:19.548461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:19.554562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.562519 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4cd247b-9a23-41da-bee0-bf7e6a0ec63e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.186209 Apr 09 21:02:19.563675 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 996/2058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:19.568540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-119a18d4-e466-4959-8d2d-505c7fd37cf0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb098486310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:19.709456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:19.717907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c23ef6d-c96e-4d46-93c2-b82f2a26fa2b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1505 microversion: 2.1 time: 0.187666 Apr 09 21:02:19.718497 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1063/2059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.027809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-119a18d4-e466-4959-8d2d-505c7fd37cf0 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "DELETE /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a" status: 204 len: 0 microversion: 2.1 time: 0.462679 Apr 09 21:02:20.028396 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 997/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:19 2022] DELETE /compute/v2.1/images/d27a3dba-929b-4ee7-9452-d62051a0076a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:20.036976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b95bc9c-8bf9-4942-baac-8ad9378465c1 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '.version_select at 0x7fb0984a8430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.062253 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-1b95bc9c-8bf9-4942-baac-8ad9378465c1 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] HTTP exception thrown: Image not found. Apr 09 21:02:20.062836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b95bc9c-8bf9-4942-baac-8ad9378465c1 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:20.063680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b95bc9c-8bf9-4942-baac-8ad9378465c1 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "DELETE /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d" status: 404 len: 62 microversion: 2.1 time: 0.030847 Apr 09 21:02:20.064234 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1064/2061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] DELETE /compute/v2.1/images/b0d4d4dd-9883-4af7-be6a-aee976c9cc1d => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:20.072428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.072927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.079986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.080701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.081671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.082151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.102210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.102975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.124758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:20.130200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.130671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.132336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.133322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.234656 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d90fc740-c374-42e9-b1ae-a070d3a52141 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 204 len: 0 microversion: 2.1 time: 0.164672 Apr 09 21:02:20.234656 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 998/2062] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:20 2022] DELETE /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:20.239264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.239963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.245956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.246403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.247184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.247620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.297973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.306058 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d485ac3-58d0-4183-ab1d-bcde8d7f1c58 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.209823 Apr 09 21:02:20.307660 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1065/2063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.316961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.316961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.317543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.324366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.324547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4031fbef-3bcc-454c-a5d7-b86ab1b7d442 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1294 microversion: 2.1 time: 0.089215 Apr 09 21:02:20.324812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.325416 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 999/2064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.325632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.326058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.329996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.330594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.336528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.337617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.339209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.339726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.399614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.408425 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-742cfc14-0908-4ede-825e-a86037f64541 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1294 microversion: 2.1 time: 0.099735 Apr 09 21:02:20.409360 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1066/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.422104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.423045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.429712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.436009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.436722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.437959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.439177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.457507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6f6a0cd5-24dd-4cb2-9efd-e09bdf5b0e05 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1304 microversion: 2.1 time: 0.130622 Apr 09 21:02:20.460254 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1000/2066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.581744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.582386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.589345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.590018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.590909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.591495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.716799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.731595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c4ecd4a-4d40-4c23-baae-44a8521f299f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.321035 Apr 09 21:02:20.734502 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1067/2067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.743393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:20.746233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:20.753829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.754956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.755901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:20.756491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:20.789938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.798528 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-55e571c8-683a-4a34-b3dd-da1d424e8fd7 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.222233 Apr 09 21:02:20.801640 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1001/2068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:20.913941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:20.921585 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c65e1df4-3e06-408b-907b-e5f74d82eafe tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1505 microversion: 2.1 time: 0.182070 Apr 09 21:02:20.922536 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1068/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:20 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.324086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.324714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.331990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.332774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.333616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.334048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.341839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.342552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.353129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.353977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.355824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.356816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.437138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.453594 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-39e1be3e-403f-485a-b12c-6ec039153164 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.115637 Apr 09 21:02:21.454771 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1069/2070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.460190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.461006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.467982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.468423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.470458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.470458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.502284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.502745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.503196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:21.503440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.510808 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-341c1b47-8d4c-4dda-b432-95003a67ab1f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.190753 Apr 09 21:02:21.511391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1002/2071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.524778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.525427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.531427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.531873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.532651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.533103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.543813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.551564 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-afe97c5e-4746-4a75-aa26-4e2779945966 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.095550 Apr 09 21:02:21.552229 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1070/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.663222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.671239 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-50efd969-7324-4cfb-936f-9597ecdcbf66 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.150082 Apr 09 21:02:21.671905 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1003/2073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.749402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.750061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.757347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.757805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.758589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.759027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.818611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.819271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.826986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.827468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.828463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.828904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.926235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.935568 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5543f00-860b-4f6e-ab5b-cc2cda8feb46 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.190167 Apr 09 21:02:21.936148 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1071/2074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:21.940764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:21.941532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:21.947823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.948730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.949627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:21.950212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:21.985179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:21.994330 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1727cfca-4b96-4ccb-8a22-7a542ab9c441 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.180313 Apr 09 21:02:21.995428 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1004/2075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:22.081880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:22.089520 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a7eb433-a66c-49ff-a09b-6ce4f8b4eee7 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1505 microversion: 2.1 time: 0.152282 Apr 09 21:02:22.090095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1072/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:21 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:22.472313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:22.473345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:22.480354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.480843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.481709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.482120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.528111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:22.529023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:22.537797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.539038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.540005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.540585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.562130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:22.571401 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-964364c9-b8ce-4fae-8997-64975b00bc34 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.103704 Apr 09 21:02:22.573267 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1005/2077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:22 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:22.578745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:22.579692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:22.586572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.590280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.591429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.592266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.631535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.632113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.632659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:22.705777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:22.714619 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f52e62e-9e65-44e0-a865-8d53f5ba15a7 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.139938 Apr 09 21:02:22.715948 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1006/2078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:22 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:22.720826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:22.721538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:22.728204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.728893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.729930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.730529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.748221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:22.767501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-44114caa-ae30-41c8-94b5-1d94e7c7a0d5 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.242155 Apr 09 21:02:22.768227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1073/2079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:22 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:22.921100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:22.930839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-74845318-f596-4a88-8a87-96a8f72364f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.213603 Apr 09 21:02:22.931661 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1007/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:22 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:22.954495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:22.955473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:22.965920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.967293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:22.969302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:22.972109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.013969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.014546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.038985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.039448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.045063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.045574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.159171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:23.177719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4bfb0623-0fa2-4648-b6d3-0d05b5fb6a3f tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.223876 Apr 09 21:02:23.180639 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1074/2081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:22 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:23.189561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.192884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.226565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.229650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.230771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.231374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.298303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:23.309213 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-247a4c9b-781d-47ba-a9cf-7d43c21e05d8 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.300972 Apr 09 21:02:23.313344 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1008/2082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:23.318248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-787ddda0-2a0a-418e-ad7f-63d975a802c0 req-a3db64f5-3afe-4dbb-a8bf-0d423cc0f57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ed45b6-7a60-4c33-83d6-db2a14b21bed", "name": "network-vif-plugged", "status": "completed", "tag": "462aa770-8d57-4511-8729-466cb3c11cb7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:23.342434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-787ddda0-2a0a-418e-ad7f-63d975a802c0 req-a3db64f5-3afe-4dbb-a8bf-0d423cc0f57e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.345486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-787ddda0-2a0a-418e-ad7f-63d975a802c0 req-a3db64f5-3afe-4dbb-a8bf-0d423cc0f57e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.369023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-787ddda0-2a0a-418e-ad7f-63d975a802c0 req-a3db64f5-3afe-4dbb-a8bf-0d423cc0f57e service nova] Creating event network-vif-plugged:462aa770-8d57-4511-8729-466cb3c11cb7 for instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed on nch2-master-1 Apr 09 21:02:23.383298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-787ddda0-2a0a-418e-ad7f-63d975a802c0 req-a3db64f5-3afe-4dbb-a8bf-0d423cc0f57e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068573 Apr 09 21:02:23.384656 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1009/2083] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:23.489989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:23.498193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88682e93-2770-4d3f-ab49-5eca4ab59206 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1500 microversion: 2.1 time: 0.316372 Apr 09 21:02:23.498789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1075/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1500 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:23.592748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.593585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.605027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.605584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.606626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.607358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.726296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:23.733708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.734255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.749375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.754080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.755227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.756239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.758254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c7c3da4-b738-452a-8861-268730b1a5a0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.170251 Apr 09 21:02:23.759921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1010/2085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:23.790270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.795587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.803080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.803866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.804868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.805906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.824450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.825099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.827923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:23.914147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:23.923474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff1f6560-bc97-4ce9-a261-670022ea0e40 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.195245 Apr 09 21:02:23.932848 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1076/2086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:23.948240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:23.948781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:23.960807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.961292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:23.962247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:23.962726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.097100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.108116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d83d4b8-2810-4adc-83f7-e70e2666b2d2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.324032 Apr 09 21:02:24.113960 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1011/2087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:24.166215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.174852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a2fffd9-2676-451f-86ea-96ab313db26a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.230726 Apr 09 21:02:24.175444 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1077/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:23 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:24.196890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.197776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.205377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.206081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.206881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.207315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.330749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.331280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.339183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.339534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.340370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.343888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.358214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.368224 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-465bd6d5-ed11-437b-aa07-4ec15ee3f8fe tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.176130 Apr 09 21:02:24.379357 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1012/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:24.498151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.506941 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f288755-a371-486e-aed6-873eea73f19a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.181163 Apr 09 21:02:24.507883 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1078/2090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:24.520815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.521454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.528070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.528431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.529245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.529683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.677799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.686315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e1caeab-6c9d-4c5f-9f7a-56fddd92137d tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1487 microversion: 2.1 time: 0.173919 Apr 09 21:02:24.687047 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1013/2091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:24.703911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.704415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.710954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.711409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.712321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.712834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.740996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:24.779097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.779724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.787583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.788323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.789250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.789839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.858189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1787b113-ef43-47ae-bd38-5ebaf2c6a987 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 204 len: 0 microversion: 2.1 time: 0.157747 Apr 09 21:02:24.861249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1079/2092] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:24 2022] DELETE /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:24.872392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:24.876332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15c24a6d-9ecf-46c0-9a67-deb33ffc71d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984a8ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.880680 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87fd0da8-d1ef-4334-8c2a-e486ae71371f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.107197 Apr 09 21:02:24.890818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1014/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:24.917530 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-15c24a6d-9ecf-46c0-9a67-deb33ffc71d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Image not found. Apr 09 21:02:24.918132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15c24a6d-9ecf-46c0-9a67-deb33ffc71d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:24.919171 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-15c24a6d-9ecf-46c0-9a67-deb33ffc71d4 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835" status: 404 len: 62 microversion: 2.1 time: 0.050047 Apr 09 21:02:24.919766 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1080/2094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] DELETE /compute/v2.1/images/fde55354-53c9-4ae4-b8be-b15ced578835 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:24.927961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.928505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.935847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.936297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.937340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.937772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.941116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:24.943254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:24.951244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.951875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.952713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:24.953406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:24.975836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:24.999124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.001079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.001079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:25.052200 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Instance is already in deleting state, ignoring this request Apr 09 21:02:25.053111 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7cf4762a-a198-40d5-9d56-d383061f1b72 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 204 len: 0 microversion: 2.1 time: 0.129166 Apr 09 21:02:25.056639 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1015/2095] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:24 2022] DELETE /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:02:25.063858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.064473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.075022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.075455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.076318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.076785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.088776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:25.105827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f58bea8-ede0-4795-a289-2b9304294253 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.169798 Apr 09 21:02:25.108815 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1081/2096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:24 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:25.140657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.144761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.154645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.155783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.156939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.157773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.291403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:25.309699 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f05b1829-a22e-4d42-bc85-6996580872a2 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1493 microversion: 2.1 time: 0.251651 Apr 09 21:02:25.310712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1016/2097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1493 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:25.315609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.316379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.323181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.323605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.324422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.324891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.371355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:25.384940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d69298b-0035-4405-94e9-f5fd34a9e4b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.254393 Apr 09 21:02:25.396367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1082/2098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:25.396367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.396367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.399307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.400726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.401213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.401660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.584471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:25.593596 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18f3804a-a9ee-4e78-8596-332bed4c3226 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.281659 Apr 09 21:02:25.594626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1017/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:25.601074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-unplugged", "status": "completed", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}, {"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-unplugged", "status": "completed", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:25.612361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.612827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.629720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] Creating event network-vif-unplugged:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:02:25.630258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] Creating event network-vif-unplugged:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:02:25.639418 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ca312cad-d6a0-449d-b000-d91c27eac6b7 req-015f84a0-5c14-4511-bede-b6ca832d38e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043167 Apr 09 21:02:25.640404 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1018/2100] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:25.645884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.646963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.650141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:25.653929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.654421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.655867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.656462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.659574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23baa9a0-a0a7-4ca6-81b3-94ce270805e7 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.272007 Apr 09 21:02:25.660739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1083/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:25.899958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:25.901800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:25.916489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.917723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:25.918852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:25.919297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.163117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.175832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c266370-7e8d-4dbe-bc37-cc6bd7bd502e tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.531418 Apr 09 21:02:26.179039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.186620 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1019/2102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:26.192233 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-54040561-3b53-40b0-a575-5ebabac5a81f tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.297728 Apr 09 21:02:26.201884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:26.202113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1084/2103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:25 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:26.202227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:26.202227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.202227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.202227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.202630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.238008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.238457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.238908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:26.296546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.304815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b49750f-ed48-46e0-8de0-e3a3cdae6c7f tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.116205 Apr 09 21:02:26.314499 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1020/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:26 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:26.327835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:26.328464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:26.335472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.336100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.336934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.337450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.405061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:26.406097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:26.413936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.414525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.415475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.417546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.559062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.567095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-acc96647-745c-4158-8520-817dc41bb016 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1493 microversion: 2.1 time: 0.243709 Apr 09 21:02:26.567883 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1085/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:26 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1493 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:26.613139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:26.613851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:26.625013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.625635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.626629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.627076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.643375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.653528 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db4e4f6b-0cce-428e-9881-4633708d37cc tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.253371 Apr 09 21:02:26.654742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1021/2106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:26 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:26.677941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:26.678485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:26.685091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.685836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.686788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:26.687397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:26.896586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.910501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4fd19bf5-942a-4541-83e5-19990c22985b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.236874 Apr 09 21:02:26.911355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1022/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:26 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:26.930742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:26.945269 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2ce13ed-2bc0-41f7-8bb4-8a172b40c8c6 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.337102 Apr 09 21:02:26.947055 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1086/2108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:26 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:27.193952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.194560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.210700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.210960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.214850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.215333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.216189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.216631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.226426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.226885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.227698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.228141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.396825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:27.408506 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d40697ab-16dd-4a7b-910a-c1c3c204356a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.202223 Apr 09 21:02:27.418481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1087/2109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:27.425325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.429118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.466028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.467302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.469101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.469777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.528864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.529967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.530579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:27.536390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:27.544793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7546486c-5cf6-4704-b12e-cf5d08c48c4b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.355245 Apr 09 21:02:27.545438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1023/2110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:27.558404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1caf5282-cdf6-473f-bf16-b44df112cfd0 req-a32a407f-e1c8-44a7-b6f8-01ab255f3ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ed45b6-7a60-4c33-83d6-db2a14b21bed", "name": "network-vif-deleted", "tag": "462aa770-8d57-4511-8729-466cb3c11cb7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:27.574824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1caf5282-cdf6-473f-bf16-b44df112cfd0 req-a32a407f-e1c8-44a7-b6f8-01ab255f3ba3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.577543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1caf5282-cdf6-473f-bf16-b44df112cfd0 req-a32a407f-e1c8-44a7-b6f8-01ab255f3ba3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.589968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:27.599678 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1caf5282-cdf6-473f-bf16-b44df112cfd0 req-a32a407f-e1c8-44a7-b6f8-01ab255f3ba3 service nova] Creating event network-vif-deleted:462aa770-8d57-4511-8729-466cb3c11cb7 for instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed on nch2-master-1 Apr 09 21:02:27.600734 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d02120a-ad2a-48bb-b61b-eccdc579ce96 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.189809 Apr 09 21:02:27.601805 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1088/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:27.606439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1caf5282-cdf6-473f-bf16-b44df112cfd0 req-a32a407f-e1c8-44a7-b6f8-01ab255f3ba3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059698 Apr 09 21:02:27.606961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.607721 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1024/2112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:27.611022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.619866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.620802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.621883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.622278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.665705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2a6eb2c1-68f6-4454-bd67-0bd781f3d1a6 req-5d57cc23-11db-418d-b37d-31ef5305c542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ed45b6-7a60-4c33-83d6-db2a14b21bed", "name": "network-vif-unplugged", "status": "completed", "tag": "462aa770-8d57-4511-8729-466cb3c11cb7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:27.670204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.670688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.671169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lazy-loading 'fault' on Instance uuid f7ed45b6-7a60-4c33-83d6-db2a14b21bed {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:27.681898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a6eb2c1-68f6-4454-bd67-0bd781f3d1a6 req-5d57cc23-11db-418d-b37d-31ef5305c542 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.682833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a6eb2c1-68f6-4454-bd67-0bd781f3d1a6 req-5d57cc23-11db-418d-b37d-31ef5305c542 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.698654 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2a6eb2c1-68f6-4454-bd67-0bd781f3d1a6 req-5d57cc23-11db-418d-b37d-31ef5305c542 service nova] Creating event network-vif-unplugged:462aa770-8d57-4511-8729-466cb3c11cb7 for instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed on nch2-master-1 Apr 09 21:02:27.710426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2a6eb2c1-68f6-4454-bd67-0bd781f3d1a6 req-5d57cc23-11db-418d-b37d-31ef5305c542 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055095 Apr 09 21:02:27.716248 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1025/2113] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:02:27.724037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.725131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.733955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.734698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.735794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.736426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.747978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33746e27054c4f1db976d4a4ae44e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333402ee57fb405f856c323a638d2b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:27.764043 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9cae52e7-bdd7-46f3-b601-06d261afa490 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 200 len: 1297 microversion: 2.1 time: 0.157804 Apr 09 21:02:27.766686 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1089/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 1297 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:27.904293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:27.917336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c160093-76ea-41d2-a42a-530b5fa24168 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.198785 Apr 09 21:02:27.919195 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1026/2115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:27.934467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.935404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.951094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.951718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.952973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.953480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.964189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:27.965230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:27.978009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.978635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:27.979855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:27.985488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.270257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:28.279379 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5843625c-d29e-452b-97a4-62046a873e4b tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.350160 Apr 09 21:02:28.289267 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1090/2116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:28.291159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:28.300345 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85aea265-db3b-43f2-a1f7-cfe71bd359f3 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.341174 Apr 09 21:02:28.301171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1027/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:27 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:28.426398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.427204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.437904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.438517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.439548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.440014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.524882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:28.534948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-163e994b-4cf5-4def-ba9b-0458a84a7378 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.112457 Apr 09 21:02:28.535874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1091/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:28.563219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.564046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.572549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.573247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.574091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.574799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.618548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.619181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.632335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.632855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.633671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.634113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.673571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.674050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.675219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:28.781881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:28.791316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8316176-5881-4c69-8b88-93fa5f48df84 tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.176416 Apr 09 21:02:28.792583 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1092/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:28.798206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.799064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: f7ed45b6-7a60-4c33-83d6-db2a14b21bed] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.807069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.808383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.810486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.811551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.831730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed could not be found. Apr 09 21:02:28.832741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance f7ed45b6-7a60-4c33-83d6-db2a14b21bed could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:28.833963 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4bd2efee-0215-4c35-b25c-482846a43bf0 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed" status: 404 len: 111 microversion: 2.1 time: 0.040188 Apr 09 21:02:28.834754 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1093/2120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/f7ed45b6-7a60-4c33-83d6-db2a14b21bed => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:28.844622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ae28111-adf0-469c-a1a4-b6017c5e997a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb098494700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.856149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:28.872687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2eab4eda-95a8-4c76-a13f-a909cb99c1ed tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.314777 Apr 09 21:02:28.874237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1028/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:28.876862 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7ae28111-adf0-469c-a1a4-b6017c5e997a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Image not found. Apr 09 21:02:28.877399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ae28111-adf0-469c-a1a4-b6017c5e997a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:28.878245 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ae28111-adf0-469c-a1a4-b6017c5e997a tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8" status: 404 len: 62 microversion: 2.1 time: 0.038358 Apr 09 21:02:28.878947 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1094/2122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] DELETE /compute/v2.1/images/fdd1eb7d-77ca-4086-82cb-e473ab6462d8 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:28.888913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.889632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.897095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.897618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.898609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.899200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.917353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance 99f0b900-a8be-424c-be26-d266ce3db2aa could not be found. Apr 09 21:02:28.917953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance 99f0b900-a8be-424c-be26-d266ce3db2aa could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:28.918814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-224fd5e0-180a-4837-a144-2d84d0ab72dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 404 len: 111 microversion: 2.1 time: 0.035450 Apr 09 21:02:28.919913 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1029/2123] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:28 2022] DELETE /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:28.929945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.930474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 99f0b900-a8be-424c-be26-d266ce3db2aa] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.936273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:28.936959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:28.945593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.946201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.946412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.946874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.947166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.947922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:28.948469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.948583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:28.972056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance 99f0b900-a8be-424c-be26-d266ce3db2aa could not be found. Apr 09 21:02:28.977259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance 99f0b900-a8be-424c-be26-d266ce3db2aa could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:28.977259 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72d997a8-3695-4b1d-9a63-343404abff07 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa" status: 404 len: 111 microversion: 2.1 time: 0.049423 Apr 09 21:02:28.977259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1095/2124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/99f0b900-a8be-424c-be26-d266ce3db2aa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:28.990397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42b89fca-153f-42fb-a205-fdac01b378dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb0984a8ca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.015551 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-42b89fca-153f-42fb-a205-fdac01b378dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Image not found. Apr 09 21:02:29.016604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42b89fca-153f-42fb-a205-fdac01b378dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.017946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-42b89fca-153f-42fb-a205-fdac01b378dc tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c" status: 404 len: 62 microversion: 2.1 time: 0.037719 Apr 09 21:02:29.018765 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1096/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] DELETE /compute/v2.1/images/adc1c445-0dce-493a-8081-33bf732f7c6c => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:29.028749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.030281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.045821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.046771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.048596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.049521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.078387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a could not be found. Apr 09 21:02:29.079149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.080194 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f655e0b-2d54-43a8-9b22-04279dc67647 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 404 len: 111 microversion: 2.1 time: 0.056315 Apr 09 21:02:29.080896 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1097/2126] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:29 2022] DELETE /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:29.090372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.091241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: 51b2094d-9261-4ac8-990d-b7103bd8ba3a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.108500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.110085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.111156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.111919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.131010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:29.136373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a could not be found. Apr 09 21:02:29.137602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance 51b2094d-9261-4ac8-990d-b7103bd8ba3a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.138710 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-39790c90-f6d0-46c7-9794-9b6d9588f99b tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a" status: 404 len: 111 microversion: 2.1 time: 0.053830 Apr 09 21:02:29.140419 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1098/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/51b2094d-9261-4ac8-990d-b7103bd8ba3a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:02:29.143700 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-490288fe-f481-46e3-a90c-aa9aced065e1 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.207981 Apr 09 21:02:29.144352 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1030/2128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:28 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:29.157185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-748f5c48-fec7-493a-83c8-3ac555b5029f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '.version_select at 0x7fb08e4cfca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.186050 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-748f5c48-fec7-493a-83c8-3ac555b5029f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Image not found. Apr 09 21:02:29.186659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-748f5c48-fec7-493a-83c8-3ac555b5029f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.187677 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-748f5c48-fec7-493a-83c8-3ac555b5029f tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80" status: 404 len: 62 microversion: 2.1 time: 0.042974 Apr 09 21:02:29.188062 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1099/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] DELETE /compute/v2.1/images/113d1381-aef8-44d9-823c-993c71fecf80 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 09 21:02:29.197988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.198896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.206674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.207218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.208071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.208568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.226553 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance de66be7a-97fe-4f7d-94fb-645e9b367f42 could not be found. Apr 09 21:02:29.227173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance de66be7a-97fe-4f7d-94fb-645e9b367f42 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.228134 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d013fc4-aadd-4381-9ee3-0e6ec114f519 tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 404 len: 111 microversion: 2.1 time: 0.035446 Apr 09 21:02:29.229082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1031/2130] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:29 2022] DELETE /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:29.238452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.239205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] [instance: de66be7a-97fe-4f7d-94fb-645e9b367f42] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.249569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.250866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.251672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.252117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.271760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] HTTP exception thrown: Instance de66be7a-97fe-4f7d-94fb-645e9b367f42 could not be found. Apr 09 21:02:29.272278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] Returning 404 to user: Instance de66be7a-97fe-4f7d-94fb-645e9b367f42 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:29.274896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd42ef25-d950-4d5f-ac2b-f8b0a0d95ced tempest-ImagesTestJSON-2014465865 tempest-ImagesTestJSON-2014465865-project] 10.222.0.30 "GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42" status: 404 len: 111 microversion: 2.1 time: 0.039825 Apr 09 21:02:29.279155 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1100/2131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/de66be7a-97fe-4f7d-94fb-645e9b367f42 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:29.297593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.298920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.306053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.307290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.307901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.308497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.318420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.319356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.328228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.329080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.330006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.330681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.556981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:29.568930 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f0fb62a-2012-453a-83a7-806840fa7ce2 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.276003 Apr 09 21:02:29.571953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1032/2132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:29.591337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.592881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.600914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.601495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.602494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.603327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.624175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:29.636621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9514a485-b407-489f-9e14-7306f48e6c87 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.323046 Apr 09 21:02:29.642289 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1101/2133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:29.706790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:29.717494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb8cdcd4-7495-4eb5-9a6f-ad6232eb68de tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.144188 Apr 09 21:02:29.718775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1033/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:29.812570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.813156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.819333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.819774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.820553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.820982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.865666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.866081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.866691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:29.891529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:29.892456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:29.907176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.907957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.909005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:29.909775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:29.919212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:29.929443 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-54c8e730-5329-4c9e-ba56-c0a5125fe76c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.121083 Apr 09 21:02:29.931563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1102/2135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:30.125270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:30.137349 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a003957a-c78a-442f-aea8-7e77b76b5bd3 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 0.249747 Apr 09 21:02:30.147993 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1034/2136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:29 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:30.164794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:30.165534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:30.174638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.175096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:30.175910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.176430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:30.348398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:30.356561 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61fe4db2-6ed2-4c24-890d-1b14033e8787 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1535 microversion: 2.1 time: 0.196537 Apr 09 21:02:30.357252 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1103/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:30 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1535 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:30.587931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:30.588778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:30.596354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.596802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:30.597976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.598460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:30.658618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:30.659268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:30.665470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.665926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:30.667437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:30.667437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.000951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:31.012161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a72c7b9-eee1-4817-92ff-3f3b6798bc95 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.428177 Apr 09 21:02:31.013529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1035/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:30 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:31.026754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:31.028330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:31.044699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.046081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.048654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.049687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.155443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:31.184011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b95fc82-5be0-44c5-8f95-673e6f199985 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.529448 Apr 09 21:02:31.187325 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1104/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:30 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:31.197509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:31.199574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:31.207464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.208295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.209497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.210329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.280552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:31.281169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.282342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.284144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lazy-loading 'fault' on Instance uuid caa1ac0b-76eb-4a3e-8430-59674f1ecf27 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:31.293381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30c14cbe-5f2c-40ce-bdc2-212470c12d40 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.278608 Apr 09 21:02:31.305181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1036/2140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:31 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:31.319997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:31.323837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:31.331493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.344015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.345002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.347914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.448059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08995e63d5ec446bbcf643822d5f37c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8584541985ac44cc923c89a5a518ec32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:31.460340 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bcd76d9f-94b8-4371-b280-6629459e3a8c tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 200 len: 1313 microversion: 2.1 time: 0.267894 Apr 09 21:02:31.462338 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1105/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:31 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:31.473516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:31.474553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:31.483978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.484652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.485699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.486344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.773249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:31.787207 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc4b6a69-d946-4a0f-833e-645224bff95d tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 200 len: 1493 microversion: 2.1 time: 0.323520 Apr 09 21:02:31.800562 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1106/2142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:31 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:31.815505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cb63ef3f-dce2-4fff-b3cd-bfcd014b05e0 req-731730a4-5d7a-47b7-8159-fae1ccb27831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd75b541-d45b-4a01-a4fb-7122b67286c1", "name": "network-vif-deleted", "tag": "4fed88cf-abe4-4b22-a8ee-09e62dda9535"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:31.842926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cb63ef3f-dce2-4fff-b3cd-bfcd014b05e0 req-731730a4-5d7a-47b7-8159-fae1ccb27831 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:31.844495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cb63ef3f-dce2-4fff-b3cd-bfcd014b05e0 req-731730a4-5d7a-47b7-8159-fae1ccb27831 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:31.880766 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cb63ef3f-dce2-4fff-b3cd-bfcd014b05e0 req-731730a4-5d7a-47b7-8159-fae1ccb27831 service nova] Creating event network-vif-deleted:4fed88cf-abe4-4b22-a8ee-09e62dda9535 for instance dd75b541-d45b-4a01-a4fb-7122b67286c1 on nch1-master-1 Apr 09 21:02:31.894316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-cb63ef3f-dce2-4fff-b3cd-bfcd014b05e0 req-731730a4-5d7a-47b7-8159-fae1ccb27831 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092170 Apr 09 21:02:31.895642 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1107/2143] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:32.038922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.040148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.050870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.051719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.052770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.053461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.347136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:32.365397 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba522d92-0fc7-439c-8d51-57b133c839a4 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1385 microversion: 2.1 time: 1.056119 Apr 09 21:02:32.367011 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1037/2144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:31 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1385 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:32.374368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.375258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.384812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.385854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.387965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.388697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.599379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:32.606881 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d1906f4-f5a4-4150-98b2-b25f6f54370d tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1472 microversion: 2.1 time: 0.575085 Apr 09 21:02:32.607467 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1108/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1472 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:32.612079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.612885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.619172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.619672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.620481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.620910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.838743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:32.847048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6504c210-28c9-4994-8b74-0bc3860feaad tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1282 microversion: 2.1 time: 0.238349 Apr 09 21:02:32.848606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1109/2146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1282 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:32.859036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.859036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] [instance: caa1ac0b-76eb-4a3e-8430-59674f1ecf27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.864869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.865343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.866135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.866565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.881323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] HTTP exception thrown: Instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 could not be found. Apr 09 21:02:32.882373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] Returning 404 to user: Instance caa1ac0b-76eb-4a3e-8430-59674f1ecf27 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:32.883505 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4057fa5-b246-4e66-8d23-ee71987f848a tempest-ServerRescueTestJSONUnderV235-859686725 tempest-ServerRescueTestJSONUnderV235-859686725-project] 10.222.0.30 "GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27" status: 404 len: 111 microversion: 2.1 time: 0.033652 Apr 09 21:02:32.884060 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1110/2147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/caa1ac0b-76eb-4a3e-8430-59674f1ecf27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:32.892920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.893942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: dd75b541-d45b-4a01-a4fb-7122b67286c1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.907064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.907519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.908440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.908913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.924361 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] HTTP exception thrown: Instance dd75b541-d45b-4a01-a4fb-7122b67286c1 could not be found. Apr 09 21:02:32.925470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Returning 404 to user: Instance dd75b541-d45b-4a01-a4fb-7122b67286c1 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:32.926492 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60d8c5df-e8e1-4384-9743-fad6675112d6 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1" status: 404 len: 111 microversion: 2.1 time: 0.037730 Apr 09 21:02:32.927416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1111/2148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/dd75b541-d45b-4a01-a4fb-7122b67286c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:32.932381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:32.932993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:32.939498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.939946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:32.940720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:32.941182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.009341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:33.017805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f433f94-81a3-4cd4-b211-4f07b55886c5 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.649563 Apr 09 21:02:33.020557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1038/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:33.025329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:33.026150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:33.034093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.034677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.035595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.036135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.068226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:33.187288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea2058d3-a6b6-4507-976f-c70fb6051a2a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "DELETE /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 204 len: 0 microversion: 2.1 time: 0.164221 Apr 09 21:02:33.187288 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1039/2150] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:33 2022] DELETE /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:33.194536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c45efa44-5de0-4496-96c3-af1e346aa5f8 req-162a4823-6423-4cd3-8d38-8c322c453ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e010922-7acd-4bde-8f7a-f6b06554a526", "name": "network-vif-deleted", "tag": "d7c527cb-9011-4ef5-8cea-8a678536f481"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:33.205609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c45efa44-5de0-4496-96c3-af1e346aa5f8 req-162a4823-6423-4cd3-8d38-8c322c453ba4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.206247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c45efa44-5de0-4496-96c3-af1e346aa5f8 req-162a4823-6423-4cd3-8d38-8c322c453ba4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.223250 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c45efa44-5de0-4496-96c3-af1e346aa5f8 req-162a4823-6423-4cd3-8d38-8c322c453ba4 service nova] Creating event network-vif-deleted:d7c527cb-9011-4ef5-8cea-8a678536f481 for instance 7e010922-7acd-4bde-8f7a-f6b06554a526 on nch1-master-1 Apr 09 21:02:33.230529 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c45efa44-5de0-4496-96c3-af1e346aa5f8 req-162a4823-6423-4cd3-8d38-8c322c453ba4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041630 Apr 09 21:02:33.232047 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1040/2151] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:33.238112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:33.238924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:33.246482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.247231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.248362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.248942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.292292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:33.317518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:33.319477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:33.321232 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ee517c0-48ec-4071-b776-55340e3edfd2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2947 microversion: 2.32 time: 0.392609 Apr 09 21:02:33.322844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1112/2152] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:32 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2947 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:33.362854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:33.364040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:33.371420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.372219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.373766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:33.374404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:33.989583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3ad9046-2e04-4a37-b943-8b94730c2200 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.631594 Apr 09 21:02:33.998767 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1113/2153] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:02:33 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390/os-interface => generated 1830 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:02:34.003893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:34.004708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:34.014456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.015162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.016164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.016768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.127542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:34.135669 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bae86530-81fb-44ba-ba9a-2fcf509fd208 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1343 microversion: 2.1 time: 0.135545 Apr 09 21:02:34.136666 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1114/2154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:33 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1343 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:34.141261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:34.141868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:34.148290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.148290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.149120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.149555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.165857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:34.174939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9291bf91-a418-487f-9a68-a5d0f365d585 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1468 microversion: 2.1 time: 0.941425 Apr 09 21:02:34.176222 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1041/2155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:33 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:34.182449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:34.183348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:34.191433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.192231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.193302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.194271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.302659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:34.310956 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c09705f-1638-457d-be22-5171b692e7d3 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1301 microversion: 2.1 time: 0.173174 Apr 09 21:02:34.311860 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1115/2156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:34 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:34.316695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-444af735-1d6e-42ee-a5a8-cea9125070a7 req-e356dde8-d4c0-47af-b3b3-03495afbaa18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38771bd6-54dc-448e-9f9e-be97fabb46b6", "tag": "61d1421c-05ab-4e1a-8af5-088db0beffa3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:34.325701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-444af735-1d6e-42ee-a5a8-cea9125070a7 req-e356dde8-d4c0-47af-b3b3-03495afbaa18 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.326495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-444af735-1d6e-42ee-a5a8-cea9125070a7 req-e356dde8-d4c0-47af-b3b3-03495afbaa18 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.338257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-444af735-1d6e-42ee-a5a8-cea9125070a7 req-e356dde8-d4c0-47af-b3b3-03495afbaa18 service nova] Creating event network-changed:61d1421c-05ab-4e1a-8af5-088db0beffa3 for instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 on nch1-master-1 Apr 09 21:02:34.343373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-444af735-1d6e-42ee-a5a8-cea9125070a7 req-e356dde8-d4c0-47af-b3b3-03495afbaa18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 Apr 09 21:02:34.344127 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1116/2157] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:34.349845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:34.350528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:34.356809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.357306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.358118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:34.358478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:34.504571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:34.529586 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da1fd2d8-98f5-4beb-8458-8343d98c92f0 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.351709 Apr 09 21:02:34.530822 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1042/2158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:34 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:34.572003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:34.579899 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06cfb19b-9385-45d2-a1c3-5c0c0ac7e59a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.234384 Apr 09 21:02:34.580702 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1117/2159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:34 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:35.162326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:35.163881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:35.179552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.180139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.183131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.186458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.193777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:35.195704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:35.214178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.214703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.223696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.224198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.684978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:35.700753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17e294ee-fb39-43fa-b2d1-327a4f7b1cbd tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 200 len: 1181 microversion: 2.1 time: 0.548087 Apr 09 21:02:35.701988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1043/2160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:35 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 1181 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:35.712623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:35.721221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:35.746831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.750704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.751584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.759340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.851548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:35.852455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:35.853224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lazy-loading 'fault' on Instance uuid 7e010922-7acd-4bde-8f7a-f6b06554a526 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:36.030680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702df47948994dd085132f3264ff66f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34832c64cfe049768207fb5cb0dfc2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:36.041792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-828273f5-d868-405b-aa61-b045252842ad tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 200 len: 1306 microversion: 2.1 time: 0.337743 Apr 09 21:02:36.046436 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1044/2161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:35 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 1306 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:36.060907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:36.062209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:36.070344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:36.071225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:36.072660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:36.073383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:36.357584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:36.381120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae0d0b6f-6205-4df7-a97a-f35719a83ec0 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1468 microversion: 2.1 time: 1.190782 Apr 09 21:02:36.382309 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1118/2162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:35 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1468 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:36.392674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2b6f8ad4-970e-4590-829f-672ef7867aff req-5adc71c5-6fa4-4abf-b012-2897ffbd5722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c106988-a070-4123-99d6-e94d156b42b0", "name": "network-vif-deleted", "tag": "0f3e486d-5fcd-4183-97a9-2a32f168c323"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:36.407262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b6f8ad4-970e-4590-829f-672ef7867aff req-5adc71c5-6fa4-4abf-b012-2897ffbd5722 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:36.407816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b6f8ad4-970e-4590-829f-672ef7867aff req-5adc71c5-6fa4-4abf-b012-2897ffbd5722 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:36.424081 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2b6f8ad4-970e-4590-829f-672ef7867aff req-5adc71c5-6fa4-4abf-b012-2897ffbd5722 service nova] Creating event network-vif-deleted:0f3e486d-5fcd-4183-97a9-2a32f168c323 for instance 1c106988-a070-4123-99d6-e94d156b42b0 on nch1-master-1 Apr 09 21:02:36.431362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2b6f8ad4-970e-4590-829f-672ef7867aff req-5adc71c5-6fa4-4abf-b012-2897ffbd5722 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045127 Apr 09 21:02:36.434677 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1119/2163] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:36.447611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:36.449009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:36.462328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:36.463379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:36.464405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:36.466030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:36.862089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:36.869728 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7924a28b-95f2-4bd9-958b-5f4b70cd3994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.821707 Apr 09 21:02:36.870274 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1045/2164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:36 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:37.092652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1070576065", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "2acdcdfe-c4fc-46e9-aafe-ac2fc5194554"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:37.162353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] validate_networks() for [('2acdcdfe-c4fc-46e9-aafe-ac2fc5194554', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:02:37.270350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:37.281740 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49225c1e-c1dd-44e7-a15b-f111e64fb3f9 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.845079 Apr 09 21:02:37.283018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1120/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:36 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:37.290376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:37.291367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 1c106988-a070-4123-99d6-e94d156b42b0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:37.299477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.300206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:37.302020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.302631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:37.320271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] HTTP exception thrown: Instance 1c106988-a070-4123-99d6-e94d156b42b0 could not be found. Apr 09 21:02:37.320967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Returning 404 to user: Instance 1c106988-a070-4123-99d6-e94d156b42b0 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:37.322012 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab2a6336-425d-41bc-bf25-57e837bd687a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0" status: 404 len: 111 microversion: 2.1 time: 0.037645 Apr 09 21:02:37.323055 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1121/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:37 2022] GET /compute/v2.1/servers/1c106988-a070-4123-99d6-e94d156b42b0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:37.330657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:37.331769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] [instance: 7e010922-7acd-4bde-8f7a-f6b06554a526] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:37.348120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.348900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:37.349898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.350868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:37.367445 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] HTTP exception thrown: Instance 7e010922-7acd-4bde-8f7a-f6b06554a526 could not be found. Apr 09 21:02:37.368115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] Returning 404 to user: Instance 7e010922-7acd-4bde-8f7a-f6b06554a526 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:37.368967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aed5aef6-02a1-4853-9f62-61bcb2125422 tempest-ImagesOneServerTestJSON-1283171141 tempest-ImagesOneServerTestJSON-1283171141-project] 10.222.0.30 "GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526" status: 404 len: 111 microversion: 2.1 time: 0.044532 Apr 09 21:02:37.370128 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1122/2167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:37 2022] GET /compute/v2.1/servers/7e010922-7acd-4bde-8f7a-f6b06554a526 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:37.400655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:37.402216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:37.416757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.417250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:37.418059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:37.418503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:38.333758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:38.348313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0a968a7-3ef5-41d2-9514-edb2f13e8b8f tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1468 microversion: 2.1 time: 0.952699 Apr 09 21:02:38.357738 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1123/2168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:37 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1468 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:38.368956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d2c3c2d5-df3b-4c13-a1c0-a6c6450a0262 req-45921dda-ca36-44dd-b495-a9f28e0b5bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38771bd6-54dc-448e-9f9e-be97fabb46b6", "name": "network-vif-plugged", "status": "completed", "tag": "61d1421c-05ab-4e1a-8af5-088db0beffa3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:38.405607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d2c3c2d5-df3b-4c13-a1c0-a6c6450a0262 req-45921dda-ca36-44dd-b495-a9f28e0b5bb9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:38.408422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d2c3c2d5-df3b-4c13-a1c0-a6c6450a0262 req-45921dda-ca36-44dd-b495-a9f28e0b5bb9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:38.444392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d2c3c2d5-df3b-4c13-a1c0-a6c6450a0262 req-45921dda-ca36-44dd-b495-a9f28e0b5bb9 service nova] Creating event network-vif-plugged:61d1421c-05ab-4e1a-8af5-088db0beffa3 for instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 on nch1-master-1 Apr 09 21:02:38.457326 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d2c3c2d5-df3b-4c13-a1c0-a6c6450a0262 req-45921dda-ca36-44dd-b495-a9f28e0b5bb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097956 Apr 09 21:02:38.457947 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1124/2169] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:38.463109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:38.475238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:38.487214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:38.487988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:38.488975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:38.489610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:38.973428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:38.983484 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e661a9a0-48d9-4abe-abf8-bc626c50d39a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.524204 Apr 09 21:02:38.989412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1125/2170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:38 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:38.998718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:39.000537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:39.009229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.012078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.014208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.015206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.080115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:02:39.080645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:02:39.080990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:02:39.081426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:02:39.081832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:02:39.116750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.117581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.118955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.120558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.177099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:39.182224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for user f6869f687bd8411ea81a24f566fef6b2 and project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:39.195868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:02:39.198698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:02:39.203451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:39.211801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f76b7ce-30b5-4e9b-a069-add2ef1b3b98 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.219487 Apr 09 21:02:39.221984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1126/2171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:38 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:39.228755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-624dfe84-8924-4694-9e98-186c8b09df49 req-2669bb02-8bc9-40b1-afe0-2bd419711a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f1ce29-b2a9-4ecb-af40-e50a34dde574", "tag": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:39.239873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-624dfe84-8924-4694-9e98-186c8b09df49 req-2669bb02-8bc9-40b1-afe0-2bd419711a02 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.240333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-624dfe84-8924-4694-9e98-186c8b09df49 req-2669bb02-8bc9-40b1-afe0-2bd419711a02 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.253009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-624dfe84-8924-4694-9e98-186c8b09df49 req-2669bb02-8bc9-40b1-afe0-2bd419711a02 service nova] Creating event network-changed:455d580c-41d3-4b94-874f-5a7e5ca3ad6f for instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 on nch1-master-1 Apr 09 21:02:39.260143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-624dfe84-8924-4694-9e98-186c8b09df49 req-2669bb02-8bc9-40b1-afe0-2bd419711a02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035872 Apr 09 21:02:39.265352 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1127/2172] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:39.271695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:39.272508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:39.280950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.282085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.283089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.283533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.297944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3b3c184f-c2a3-40be-ab08-19003d3292fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.426349 Apr 09 21:02:39.299504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1046/2173] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:02:39.309467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ff6e0ad-6bc6-4506-8b28-0c7d0bdd81bc tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:39.310395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ff6e0ad-6bc6-4506-8b28-0c7d0bdd81bc tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:39.314589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:39.391285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ff6e0ad-6bc6-4506-8b28-0c7d0bdd81bc tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:39.412475 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ff6e0ad-6bc6-4506-8b28-0c7d0bdd81bc tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1225 microversion: 2.1 time: 0.107293 Apr 09 21:02:39.416899 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1047/2174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:39 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:39.432909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:39.448676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:39.493845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.505355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.507206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.509427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.549637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6e32ed9-3c57-415f-a90c-d00e5a7176ae tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 204 len: 0 microversion: 2.1 time: 0.279775 Apr 09 21:02:39.557593 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1128/2175] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:39 2022] DELETE /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:39.575033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:39.577634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:39.592635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.593119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.599686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.600186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.608993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:39.612616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:39.613388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lazy-loading 'fault' on Instance uuid 87355ccc-05d7-430d-aafc-b3bea4e08127 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:40.040794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:40.048198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43307142-b815-4f93-9945-b3111cf18131 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 200 len: 1302 microversion: 2.1 time: 0.629845 Apr 09 21:02:40.048780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1048/2176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:39 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 1302 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:40.054264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:40.065089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:40.075052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.077537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.078517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.079114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.266345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:40.274349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:40.279362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bfce8373-8a10-4530-b4b3-adbbb4ed0d3b tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1500 microversion: 2.1 time: 0.714465 Apr 09 21:02:40.282487 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1129/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:39 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1500 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:40.284705 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43873063-c54c-48c2-bc42-173b8282681a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.234060 Apr 09 21:02:40.294659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:40.294974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:40.295427 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1049/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:40 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:40.310787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.311767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.313197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.314137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.433224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:40.442920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:40.456127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.456844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.457845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:40.458432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:40.546988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:40.557644 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-761bbe5c-98fb-4e3e-b010-99241fdae860 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1277 microversion: 2.1 time: 0.129435 Apr 09 21:02:40.559124 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1050/2179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:40 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:40.562130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:40.572344 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f85a54f-8d4c-413e-bd80-83c53e13f3e0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1371 microversion: 2.1 time: 0.287674 Apr 09 21:02:40.573465 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1130/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:40 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:41.064862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:41.065540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: 87355ccc-05d7-430d-aafc-b3bea4e08127] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:41.072162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.072798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.073793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.074226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.087828 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] HTTP exception thrown: Instance 87355ccc-05d7-430d-aafc-b3bea4e08127 could not be found. Apr 09 21:02:41.088814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Returning 404 to user: Instance 87355ccc-05d7-430d-aafc-b3bea4e08127 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:41.089669 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e35d5cbc-9762-4e79-bbee-f7ad0b576594 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127" status: 404 len: 111 microversion: 2.1 time: 0.028961 Apr 09 21:02:41.090234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1051/2181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:41 2022] GET /compute/v2.1/servers/87355ccc-05d7-430d-aafc-b3bea4e08127 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:41.098924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:41.099416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:41.105951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.106402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.107169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.107600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.135542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:41.227599 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c11fa3f-b933-4ab2-80f6-fd620483fe0a tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 204 len: 0 microversion: 2.1 time: 0.132659 Apr 09 21:02:41.228932 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1131/2182] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:41 2022] DELETE /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:02:41.238971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:41.239602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:41.247372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.248408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.249368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.249757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.281270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-acde9f71-b8ff-42e5-9475-ff52cc6b63c3 req-4e52a79b-b063-4d7c-bc90-60c9da1d961c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87355ccc-05d7-430d-aafc-b3bea4e08127", "name": "network-vif-deleted", "tag": "cc886072-17df-443d-8237-a748bd33f221"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:41.300681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-acde9f71-b8ff-42e5-9475-ff52cc6b63c3 req-4e52a79b-b063-4d7c-bc90-60c9da1d961c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.301612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-acde9f71-b8ff-42e5-9475-ff52cc6b63c3 req-4e52a79b-b063-4d7c-bc90-60c9da1d961c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.334567 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-acde9f71-b8ff-42e5-9475-ff52cc6b63c3 req-4e52a79b-b063-4d7c-bc90-60c9da1d961c service nova] Creating event network-vif-deleted:cc886072-17df-443d-8237-a748bd33f221 for instance 87355ccc-05d7-430d-aafc-b3bea4e08127 on nch1-master-1 Apr 09 21:02:41.357420 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-acde9f71-b8ff-42e5-9475-ff52cc6b63c3 req-4e52a79b-b063-4d7c-bc90-60c9da1d961c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083437 Apr 09 21:02:41.358537 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1132/2183] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:41.365766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:41.367072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:41.375252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.376152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.377605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.378323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.701190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:41.710974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c7231f4c-4a6e-4ca1-aef7-06cc927d5447 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1468 microversion: 2.1 time: 0.477861 Apr 09 21:02:41.712085 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1052/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:41 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1468 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:41.718650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:41.719486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:41.724250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:41.728673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.729545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.730511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:41.731518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:41.739928 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-55d43839-e494-4054-a319-e4e0ab586318 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 200 len: 1500 microversion: 2.1 time: 0.379931 Apr 09 21:02:41.741253 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1133/2185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:41 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:41.914415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92a7c808-1818-40ca-b9fc-06f44ea807ec tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08e4c14c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-11008466", "description": "tempest-description-2062310022"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:42.013761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:42.021247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3588e004-1f33-4ee9-a7cf-b699d692de31 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.307872 Apr 09 21:02:42.021843 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1053/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:41 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:42.036301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:42.037300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:42.043958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.044693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.045827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.046258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.157372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:42.169765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b011e35-932f-4a3e-8a27-83989c9254f3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1283 microversion: 2.1 time: 0.137043 Apr 09 21:02:42.170673 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1054/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:42 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:42.186168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:42.187134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:42.196397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.197347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.198367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.199066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.401305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-92a7c808-1818-40ca-b9fc-06f44ea807ec tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.658667 Apr 09 21:02:42.402546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1134/2188] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:41 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:42.415093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3576ce45-db3d-42fb-b3d1-a0b97729a5b2 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb098496d30>, body: {"security_group_rule": {"parent_group_id": "423c764d-bcbf-4da6-a78e-87591df4d7ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:42.589227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:42.605073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8df76af0-97a0-4600-88fa-103cc6e74b0c tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1558 microversion: 2.1 time: 0.422976 Apr 09 21:02:42.616591 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1055/2189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:42 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1558 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:42.622129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c08dac68-a93b-4cd9-a889-9295769270f0 req-9686dae5-0ace-4d68-907e-e33c5052aee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e94f544-180a-47fe-9df7-06afcdf7ca2d", "name": "network-vif-deleted", "tag": "1af61b32-e6ec-4d29-b14a-ebb1c3a817f0"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:42.630446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c08dac68-a93b-4cd9-a889-9295769270f0 req-9686dae5-0ace-4d68-907e-e33c5052aee9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.630904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c08dac68-a93b-4cd9-a889-9295769270f0 req-9686dae5-0ace-4d68-907e-e33c5052aee9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.642734 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c08dac68-a93b-4cd9-a889-9295769270f0 req-9686dae5-0ace-4d68-907e-e33c5052aee9 service nova] Creating event network-vif-deleted:1af61b32-e6ec-4d29-b14a-ebb1c3a817f0 for instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d on nch1-master-1 Apr 09 21:02:42.649723 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c08dac68-a93b-4cd9-a889-9295769270f0 req-9686dae5-0ace-4d68-907e-e33c5052aee9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Apr 09 21:02:42.651949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1056/2190] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:42.768282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-336744319", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "48364b8b-15f5-4ae3-a8e5-50fe934e9d5e"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:42.849411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3576ce45-db3d-42fb-b3d1-a0b97729a5b2 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.439363 Apr 09 21:02:42.850172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] validate_networks() for [('48364b8b-15f5-4ae3-a8e5-50fe934e9d5e', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:02:42.851310 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1135/2191] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:02:42.857150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:42.857776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:42.867584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.868420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:42.869928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:42.870961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.068888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4dd896df-e7c6-4163-8236-8baf7455b188 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216286 Apr 09 21:02:43.070146 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1136/2192] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:02:42 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:43.079968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:43.080588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:43.092086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.092592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.093508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.093989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.621440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:43.634938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b28373fe-11cf-4efa-bb4b-78a6c1b4928e tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1468 microversion: 2.1 time: 0.563475 Apr 09 21:02:43.636473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1137/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:43 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1468 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:43.642601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:43.643549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7e94f544-180a-47fe-9df7-06afcdf7ca2d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:43.651978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.653499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.654593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.655756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.677660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] HTTP exception thrown: Instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d could not be found. Apr 09 21:02:43.678683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Returning 404 to user: Instance 7e94f544-180a-47fe-9df7-06afcdf7ca2d could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:43.679874 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b1cd049-1e50-4347-a6bb-386f3b5ee2db tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d" status: 404 len: 111 microversion: 2.1 time: 0.042022 Apr 09 21:02:43.681261 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1138/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:43 2022] GET /compute/v2.1/servers/7e94f544-180a-47fe-9df7-06afcdf7ca2d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:43.688473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2d3fe59-4538-4f4d-be00-6e4f3ec66a89 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08eadc040>, body: {"security_group_rule": {"parent_group_id": "423c764d-bcbf-4da6-a78e-87591df4d7ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:43.895237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c2d3fe59-4538-4f4d-be00-6e4f3ec66a89 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: This rule already exists in group 423c764d-bcbf-4da6-a78e-87591df4d7ef Apr 09 21:02:43.896365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2d3fe59-4538-4f4d-be00-6e4f3ec66a89 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: This rule already exists in group 423c764d-bcbf-4da6-a78e-87591df4d7ef {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:43.897521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2d3fe59-4538-4f4d-be00-6e4f3ec66a89 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.214283 Apr 09 21:02:43.898286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1139/2195] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:43 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:02:43.906010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:43.906782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:43.914479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.915226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:43.916151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:43.916816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.128442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:02:44.129899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:02:44.130590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:02:44.131169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:02:44.132944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:02:44.150053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.151298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.152328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.152948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.184044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Getting quotas for project 8e0bf14b8dad4360adb4727282b63237. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:44.189333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Getting quotas for user 57553270540e4163aad06138d03f9cb4 and project 8e0bf14b8dad4360adb4727282b63237. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:44.207008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:02:44.210022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:02:44.222512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:44.234665 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b4f72b0-9b71-4857-8d32-68b8a6b3b47d tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.334381 Apr 09 21:02:44.236330 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1140/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:43 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:44.255119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:44.256377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:44.268762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.269251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.272361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.272813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.319839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05fbcdf2-1dfd-47ef-b155-5fa152154c9d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.665271 Apr 09 21:02:44.325453 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1057/2197] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:02:44.330343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:44.330851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:44.347546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.348882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.349929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:44.350550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:44.386181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:44.488084 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a276a570-2f87-4c5c-850d-1daa3d7ed846 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 204 len: 0 microversion: 2.1 time: 0.161169 Apr 09 21:02:44.488643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1058/2198] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:44 2022] DELETE /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:44.496871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-08b3ee57-2b35-4504-bbb3-1e70a5ec36a1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb09847df70>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:44.662453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:44.671350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-868762be-4e8a-47cc-acbf-5df8a03e923b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.432625 Apr 09 21:02:44.673065 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1141/2199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:44 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:44.680311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:44.681342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:45.081083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.088974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.090658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.091907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-943eff8f-ce96-4077-81a4-c67558416b3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1261 microversion: 2.26 time: 0.415402 Apr 09 21:02:45.092511 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1142/2200] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:44 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1261 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:45.100845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-77f11284-b0e9-481f-aaf6-fe96cdb1ab84 req-93f0939d-cea5-440b-88c2-be45098d23b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a167d292-5835-4442-8310-bb9bf77d8eaf", "name": "network-vif-deleted", "tag": "b7b8b380-38b4-4d50-b45e-54a377c8ba29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.106119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-77f11284-b0e9-481f-aaf6-fe96cdb1ab84 req-93f0939d-cea5-440b-88c2-be45098d23b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.106586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-77f11284-b0e9-481f-aaf6-fe96cdb1ab84 req-93f0939d-cea5-440b-88c2-be45098d23b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.117872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-77f11284-b0e9-481f-aaf6-fe96cdb1ab84 req-93f0939d-cea5-440b-88c2-be45098d23b8 service nova] Creating event network-vif-deleted:b7b8b380-38b4-4d50-b45e-54a377c8ba29 for instance a167d292-5835-4442-8310-bb9bf77d8eaf on nch2-master-1 Apr 09 21:02:45.122976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-77f11284-b0e9-481f-aaf6-fe96cdb1ab84 req-93f0939d-cea5-440b-88c2-be45098d23b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029254 Apr 09 21:02:45.123579 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1143/2201] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:45.128629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:45.129344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:45.135620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.136074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.136842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.137303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.266942 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-08b3ee57-2b35-4504-bbb3-1e70a5ec36a1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/662da04a-2981-4848-905b-9a2fe38334be" status: 202 len: 0 microversion: 2.1 time: 0.773927 Apr 09 21:02:45.267521 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1059/2202] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Apr 9 21:02:44 2022] DELETE /compute/v2.1/os-security-group-rules/662da04a-2981-4848-905b-9a2fe38334be => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:45.273481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:45.274199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:45.281410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.281875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.282746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.283187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.367136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.374966 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d8ad445-03e9-4624-b355-f28e0eb49242 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1426 microversion: 2.1 time: 0.106065 Apr 09 21:02:45.375607 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1060/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:45 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:45.380147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e0a23a87-0db8-4cd1-bd6d-d0d1258786c2 req-5d49113d-75ec-4e30-8b92-8b5846207c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63967e76-ec68-47b4-bb9c-e0b7f0262227", "tag": "cfc19c1a-ea22-4416-9f28-df0bea28eaf8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.387966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.388201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e0a23a87-0db8-4cd1-bd6d-d0d1258786c2 req-5d49113d-75ec-4e30-8b92-8b5846207c0b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.388769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e0a23a87-0db8-4cd1-bd6d-d0d1258786c2 req-5d49113d-75ec-4e30-8b92-8b5846207c0b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.399684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4d04d45-4d23-41a6-8204-ba0eb7bd0ca9 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1485 microversion: 2.1 time: 0.274895 Apr 09 21:02:45.409444 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1144/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:45 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1485 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:45.410095 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e0a23a87-0db8-4cd1-bd6d-d0d1258786c2 req-5d49113d-75ec-4e30-8b92-8b5846207c0b service nova] Creating event network-changed:cfc19c1a-ea22-4416-9f28-df0bea28eaf8 for instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 on nch2-master-1 Apr 09 21:02:45.410095 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e0a23a87-0db8-4cd1-bd6d-d0d1258786c2 req-5d49113d-75ec-4e30-8b92-8b5846207c0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029264 Apr 09 21:02:45.410274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:45.410274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:45.410460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1061/2205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:45.413569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.414193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.414796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d775d35b-1a58-4eae-9c91-28d9360ac57f tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08f2af040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-99303715", "description": "tempest-description-859636105"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.415515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.416123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.681055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.689870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95703080-a8b7-4f76-9944-ab37e723cb44 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.288012 Apr 09 21:02:45.690456 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1145/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:45 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:45.695266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:45.696183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:45.702132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.702892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.703667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:45.704196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:45.756506 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d775d35b-1a58-4eae-9c91-28d9360ac57f tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.345375 Apr 09 21:02:45.757691 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1062/2207] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:45.770210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52c496ec-67c4-43bd-970e-05eb0b7a43f7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb0984b64c0>, body: {"security_group_rule": {"parent_group_id": "e44fc199-e819-4074-92a3-997ec3de9e1a", "ip_protocol": "tcp", "from_port": 659994546, "to_port": 22}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.849975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-52c496ec-67c4-43bd-970e-05eb0b7a43f7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Invalid port range 659994546:22. Former value cannot be greater than the later Apr 09 21:02:45.850592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52c496ec-67c4-43bd-970e-05eb0b7a43f7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: Invalid port range 659994546:22. Former value cannot be greater than the later {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:45.851441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52c496ec-67c4-43bd-970e-05eb0b7a43f7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.085771 Apr 09 21:02:45.852306 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1063/2208] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:02:45.862925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71d2ca8f-f194-41f1-ade1-7fc715d81aa8 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb09846f670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1542990271", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.864794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-71d2ca8f-f194-41f1-ade1-7fc715d81aa8 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Security group id should be uuid Apr 09 21:02:45.865416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71d2ca8f-f194-41f1-ade1-7fc715d81aa8 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: Security group id should be uuid {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:45.866304 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-71d2ca8f-f194-41f1-ade1-7fc715d81aa8 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008220 Apr 09 21:02:45.866775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1064/2209] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:02:45.876662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdac1f84-8860-4fbc-ada2-e1ff2e5229a7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08f27d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-903851104", "description": "tempest-description-556006044"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:45.878530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:45.887992 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a183cdc0-d5de-43f1-9109-c129460fc1af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.196263 Apr 09 21:02:45.889429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1146/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:45 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:45.996116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2cbbf080-91a0-41fd-bce5-278422a949a6 req-52388f0e-869b-45c7-b77e-712fa3488d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f1ce29-b2a9-4ecb-af40-e50a34dde574", "name": "network-vif-plugged", "status": "completed", "tag": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.005071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2cbbf080-91a0-41fd-bce5-278422a949a6 req-52388f0e-869b-45c7-b77e-712fa3488d3b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.005641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2cbbf080-91a0-41fd-bce5-278422a949a6 req-52388f0e-869b-45c7-b77e-712fa3488d3b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.023852 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdac1f84-8860-4fbc-ada2-e1ff2e5229a7 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.151694 Apr 09 21:02:46.026235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1065/2211] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:46.028976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2cbbf080-91a0-41fd-bce5-278422a949a6 req-52388f0e-869b-45c7-b77e-712fa3488d3b service nova] Creating event network-vif-plugged:455d580c-41d3-4b94-874f-5a7e5ca3ad6f for instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 on nch1-master-1 Apr 09 21:02:46.034345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2cbbf080-91a0-41fd-bce5-278422a949a6 req-52388f0e-869b-45c7-b77e-712fa3488d3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042293 Apr 09 21:02:46.040440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8cb559e-75f5-4b89-89a8-cfc79272b5c6 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb09846f040>, body: {"security_group_rule": {"parent_group_id": "7a866067-1bde-47a2-9f2a-1c99bfd70fea", "ip_protocol": "tempest-999-554683229", "from_port": 22, "to_port": 22}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.046803 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1147/2212] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:46.098027 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f8cb559e-75f5-4b89-89a8-cfc79272b5c6 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Invalid IP protocol tempest-999-554683229. Apr 09 21:02:46.098640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8cb559e-75f5-4b89-89a8-cfc79272b5c6 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: Invalid IP protocol tempest-999-554683229. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:46.099472 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8cb559e-75f5-4b89-89a8-cfc79272b5c6 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.063107 Apr 09 21:02:46.100068 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1066/2213] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 09 21:02:46.110945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-62ed54a3-08e2-44d1-b6e3-f3489f007834 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08e4f7430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1669806508", "description": "tempest-description-1457038369"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.118149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:46.122478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:46.128260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.128980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.129908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.130625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.223083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.233152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.234816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.236353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d778de8e-122e-4a26-b21d-139424efb623 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1265 microversion: 2.26 time: 0.126068 Apr 09 21:02:46.237001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1067/2214] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:46 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:46.368272 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-62ed54a3-08e2-44d1-b6e3-f3489f007834 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.260297 Apr 09 21:02:46.369095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1148/2215] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:46.381715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8305b3c9-ca27-4eed-b7c0-79c31f96636c tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb09846f670>, body: {"security_group_rule": {"parent_group_id": "9c72724e-d787-41bc-b559-e3f674baa14e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.392485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:46.393349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:46.406333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.406890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.407747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.408430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.494851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab294d1890047aababb87b3a865a14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77d97d277f245d4822a646af7d5f50d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.499127 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8305b3c9-ca27-4eed-b7c0-79c31f96636c tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Apr 09 21:02:46.499761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8305b3c9-ca27-4eed-b7c0-79c31f96636c tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:46.500634 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8305b3c9-ca27-4eed-b7c0-79c31f96636c tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.123676 Apr 09 21:02:46.501304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1068/2216] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:02:46.508140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-997f3827-3a8e-493c-8992-3ddaba03c7b7 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 200 len: 1297 microversion: 2.1 time: 0.120081 Apr 09 21:02:46.508729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1149/2217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:46 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:46.509027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:46.510143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:46.514342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fc84836-5a10-4abc-b7c9-5cf8134e6118 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08e4ceaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1787643552", "description": "tempest-description-1837986277"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.522280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.522717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.523502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.523932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.744832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.753843 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-939583b8-072b-4857-9ea8-b2a8a94ae517 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1485 microversion: 2.1 time: 0.250571 Apr 09 21:02:46.763317 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1069/2218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:46 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1485 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:46.763317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:46.763317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:46.769393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.770559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.771054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.771539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.780634 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fc84836-5a10-4abc-b7c9-5cf8134e6118 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.270280 Apr 09 21:02:46.781873 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1150/2219] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:46.792939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8d55b53-54ba-49f5-9d3c-4955200a656d tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb08e4d9550>, body: {"security_group_rule": {"parent_group_id": "efaa6497-deb7-444b-9fd6-bc304c21c636", "ip_protocol": "tcp", "from_port": 22, "to_port": 1735354482}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.880021 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d8d55b53-54ba-49f5-9d3c-4955200a656d tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Invalid port range 22:1735354482. Valid TCP ports should be between 1-65535 Apr 09 21:02:46.880654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8d55b53-54ba-49f5-9d3c-4955200a656d tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 400 to user: Invalid port range 22:1735354482. Valid TCP ports should be between 1-65535 {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:46.881587 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8d55b53-54ba-49f5-9d3c-4955200a656d tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.093149 Apr 09 21:02:46.882111 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1151/2220] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:02:46.891791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Action: 'create', calling method: .version_select at 0x7fb098453f70>, body: {"security_group_rule": {"parent_group_id": "d0d05edf-03ac-4651-ba5a-be0d13161513", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:46.919200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0d05edf-03ac-4651-ba5a-be0d13161513 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:02:46.920507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Neutron security group d0d05edf-03ac-4651-ba5a-be0d13161513 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:02:46.921076 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Security group d0d05edf-03ac-4651-ba5a-be0d13161513 does not exist Apr 09 21:02:46.921076 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-39ca1323-a21c-4b04-a27e-eb86cc2974c5'] Apr 09 21:02:46.921656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 404 to user: Security group d0d05edf-03ac-4651-ba5a-be0d13161513 does not exist Apr 09 21:02:46.921656 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-39ca1323-a21c-4b04-a27e-eb86cc2974c5'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:46.922787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da8679c1-5cec-46a6-90e8-7764108e27a4 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.034948 Apr 09 21:02:46.923363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1152/2221] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:02:46.928719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:46.929379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:46.936130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.936857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.937854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:46.938479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:46.954145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:46.962361 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0b0f72f-3eef-4ce3-bb93-44d676b4d9df tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1324 microversion: 2.1 time: 0.206691 Apr 09 21:02:46.963026 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1070/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:46 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:46.972451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb098480ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.014962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule cc439af7-5815-43c7-896a-3b4da383027c does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:02:47.015598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Neutron security group rule cc439af7-5815-43c7-896a-3b4da383027c not found {{(pid=141819) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Apr 09 21:02:47.016138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] HTTP exception thrown: Security group rule cc439af7-5815-43c7-896a-3b4da383027c does not exist Apr 09 21:02:47.016138 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-6e887e50-ecaf-4299-9fd9-5360f0a0600c'] Apr 09 21:02:47.017062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Returning 404 to user: Security group rule cc439af7-5815-43c7-896a-3b4da383027c does not exist Apr 09 21:02:47.017062 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-6e887e50-ecaf-4299-9fd9-5360f0a0600c'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:47.017907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56f76b16-1eda-4965-a813-f11cae2096e1 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/cc439af7-5815-43c7-896a-3b4da383027c" status: 404 len: 199 microversion: 2.1 time: 0.053971 Apr 09 21:02:47.018474 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1071/2223] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Apr 9 21:02:46 2022] DELETE /compute/v2.1/os-security-group-rules/cc439af7-5815-43c7-896a-3b4da383027c => generated 199 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:47.028425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0a6a4a3-42c4-4622-b2d5-c03cd311e87f tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb09847b1f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.337383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:47.349842 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c8305ff9-a3d9-422c-bf76-01aca8f6492f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.425084 Apr 09 21:02:47.355759 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1153/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:46 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:47.370373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-269a398a-55ce-492e-8971-9d5d06f0d227 req-ed68fe7f-9f79-46b5-8e7b-52886b419678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38771bd6-54dc-448e-9f9e-be97fabb46b6", "tag": "61d1421c-05ab-4e1a-8af5-088db0beffa3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:47.400027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-269a398a-55ce-492e-8971-9d5d06f0d227 req-ed68fe7f-9f79-46b5-8e7b-52886b419678 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.400800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-269a398a-55ce-492e-8971-9d5d06f0d227 req-ed68fe7f-9f79-46b5-8e7b-52886b419678 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.420422 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-269a398a-55ce-492e-8971-9d5d06f0d227 req-ed68fe7f-9f79-46b5-8e7b-52886b419678 service nova] Creating event network-changed:61d1421c-05ab-4e1a-8af5-088db0beffa3 for instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 on nch1-master-1 Apr 09 21:02:47.427958 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-269a398a-55ce-492e-8971-9d5d06f0d227 req-ed68fe7f-9f79-46b5-8e7b-52886b419678 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061194 Apr 09 21:02:47.428590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1154/2225] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:47.444266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.446768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:47.464932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.465565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.467483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.468115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.642276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:47.651297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:47.653131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:47.654307 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c65326c9-565c-42ab-9391-bb13a3ff47f5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1313 microversion: 2.26 time: 0.224505 Apr 09 21:02:47.654847 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1155/2226] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:47 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:47.671822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.672444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] [instance: a167d292-5835-4442-8310-bb9bf77d8eaf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:47.678541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.678995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.679965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.680568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.695361 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] HTTP exception thrown: Instance a167d292-5835-4442-8310-bb9bf77d8eaf could not be found. Apr 09 21:02:47.696278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] Returning 404 to user: Instance a167d292-5835-4442-8310-bb9bf77d8eaf could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:47.697371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6d4ba43-ca69-427e-9175-1508339517c2 tempest-MigrationsAdminTest-2076822343 tempest-MigrationsAdminTest-2076822343-project] 10.222.0.30 "GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf" status: 404 len: 111 microversion: 2.1 time: 0.029923 Apr 09 21:02:47.698457 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1156/2227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:47 2022] GET /compute/v2.1/servers/a167d292-5835-4442-8310-bb9bf77d8eaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:47.773782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.774802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:47.784785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.785800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.786393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.787045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.884666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:47.892269 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0a6a4a3-42c4-4622-b2d5-c03cd311e87f tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/efaa6497-deb7-444b-9fd6-bc304c21c636" status: 202 len: 0 microversion: 2.1 time: 0.867858 Apr 09 21:02:47.893410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1072/2228] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:47 2022] DELETE /compute/v2.1/os-security-groups/efaa6497-deb7-444b-9fd6-bc304c21c636 => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:47.897134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b89b8e8-769c-4a41-b0cb-d87de290fb97 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 200 len: 1443 microversion: 2.1 time: 0.127684 Apr 09 21:02:47.899355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8883efd5-6e51-4d1e-9a4c-dc41c1a024cf req-98f591d7-9c68-456d-bc2e-0d8b369a8155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d604fb79-470d-4cc5-88e6-a68d9a19a125", "name": "network-vif-deleted", "tag": "1bc4d915-ee13-4ba8-922e-b46c28ad4602"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:47.899538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1157/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:47 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 1443 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:47.911382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95ffc246-9dcc-4408-9b75-c53c46c3bfa5 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb08eadc040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.917624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8883efd5-6e51-4d1e-9a4c-dc41c1a024cf req-98f591d7-9c68-456d-bc2e-0d8b369a8155 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.918299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8883efd5-6e51-4d1e-9a4c-dc41c1a024cf req-98f591d7-9c68-456d-bc2e-0d8b369a8155 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.933004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8883efd5-6e51-4d1e-9a4c-dc41c1a024cf req-98f591d7-9c68-456d-bc2e-0d8b369a8155 service nova] Creating event network-vif-deleted:1bc4d915-ee13-4ba8-922e-b46c28ad4602 for instance d604fb79-470d-4cc5-88e6-a68d9a19a125 on nch2-master-1 Apr 09 21:02:47.939130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8883efd5-6e51-4d1e-9a4c-dc41c1a024cf req-98f591d7-9c68-456d-bc2e-0d8b369a8155 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043835 Apr 09 21:02:47.941142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1073/2230] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:47.982294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:47.983265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:47.990907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.992113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:47.993179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:47.993880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.499844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:48.517749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae7be61a-8307-4038-81f5-3120287ba767 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 200 len: 1520 microversion: 2.1 time: 0.538295 Apr 09 21:02:48.519087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1074/2231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:47 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 1520 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:48.536993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:48.538137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:48.545549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.559809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.562933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.563458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.753801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95ffc246-9dcc-4408-9b75-c53c46c3bfa5 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9c72724e-d787-41bc-b559-e3f674baa14e" status: 202 len: 0 microversion: 2.1 time: 0.852424 Apr 09 21:02:48.756045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1158/2232] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:47 2022] DELETE /compute/v2.1/os-security-groups/9c72724e-d787-41bc-b559-e3f674baa14e => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:48.763934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.111"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:48.765617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:48.776650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.777473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.778460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.778895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.821939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Acquired lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:02:48.898884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:48.907949 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9699d265-aaf0-4905-a83d-7e8d762d7e41 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.387302 Apr 09 21:02:48.910879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1075/2233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:48 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:48.917180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:48.918018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:48.925372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.925840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:48.926672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:48.927112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:49.321213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:49.331816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:49.333870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:49.335293 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2991c626-ba95-4a27-b437-a7591e0bcbcd tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1361 microversion: 2.26 time: 0.422989 Apr 09 21:02:49.336351 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1076/2234] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:48 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:49.341501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8882ce0-d035-4421-a842-f71b4d0d7147 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb098477790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:50.116131 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e8882ce0-d035-4421-a842-f71b4d0d7147 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7a866067-1bde-47a2-9f2a-1c99bfd70fea" status: 202 len: 0 microversion: 2.1 time: 0.778394 Apr 09 21:02:50.118320 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1077/2235] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:49 2022] DELETE /compute/v2.1/os-security-groups/7a866067-1bde-47a2-9f2a-1c99bfd70fea => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:50.124163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:50.125236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: d604fb79-470d-4cc5-88e6-a68d9a19a125] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:50.133169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.133832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.134983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.135590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.155549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] HTTP exception thrown: Instance d604fb79-470d-4cc5-88e6-a68d9a19a125 could not be found. Apr 09 21:02:50.156304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Returning 404 to user: Instance d604fb79-470d-4cc5-88e6-a68d9a19a125 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:50.157493 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b82aa06f-424b-4b1a-96b0-fc024ee7776a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125" status: 404 len: 111 microversion: 2.1 time: 0.037909 Apr 09 21:02:50.158048 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1078/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:50 2022] GET /compute/v2.1/servers/d604fb79-470d-4cc5-88e6-a68d9a19a125 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:50.177586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cf514a52-b338-46b2-8235-0a2f95ffe6fc req-fe3f5ce4-2161-453f-9722-3f10fe6770bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63967e76-ec68-47b4-bb9c-e0b7f0262227", "name": "network-vif-plugged", "status": "completed", "tag": "cfc19c1a-ea22-4416-9f28-df0bea28eaf8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:50.190233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cf514a52-b338-46b2-8235-0a2f95ffe6fc req-fe3f5ce4-2161-453f-9722-3f10fe6770bf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.190685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cf514a52-b338-46b2-8235-0a2f95ffe6fc req-fe3f5ce4-2161-453f-9722-3f10fe6770bf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.204576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cf514a52-b338-46b2-8235-0a2f95ffe6fc req-fe3f5ce4-2161-453f-9722-3f10fe6770bf service nova] Creating event network-vif-plugged:cfc19c1a-ea22-4416-9f28-df0bea28eaf8 for instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 on nch2-master-1 Apr 09 21:02:50.212507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cf514a52-b338-46b2-8235-0a2f95ffe6fc req-fe3f5ce4-2161-453f-9722-3f10fe6770bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052874 Apr 09 21:02:50.214359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1079/2237] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:50.225568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:50.226409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:50.233394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.234165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.235211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.235872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.588536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:50.598536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-729d8a0e-fab2-4e25-bd97-40ed9237d9fd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.382325 Apr 09 21:02:50.603513 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1080/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:50 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:50.612114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-77c3a641-6155-4760-901e-de1f0447f1c9 req-6242f49d-8348-4c00-aa73-d6609b6319b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa96a6a-ad9e-4764-b6d8-591508c71bf9", "tag": "b398b476-f8f8-407d-a3f3-11da1ed049c7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:50.620978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-77c3a641-6155-4760-901e-de1f0447f1c9 req-6242f49d-8348-4c00-aa73-d6609b6319b5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:50.621775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-77c3a641-6155-4760-901e-de1f0447f1c9 req-6242f49d-8348-4c00-aa73-d6609b6319b5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:50.633567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-77c3a641-6155-4760-901e-de1f0447f1c9 req-6242f49d-8348-4c00-aa73-d6609b6319b5 service nova] Creating event network-changed:b398b476-f8f8-407d-a3f3-11da1ed049c7 for instance 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 on nch2-master-1 Apr 09 21:02:50.639319 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-77c3a641-6155-4760-901e-de1f0447f1c9 req-6242f49d-8348-4c00-aa73-d6609b6319b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035526 Apr 09 21:02:50.640748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1081/2239] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:50.647151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-348335ad-d588-4d50-b810-99597f0f9ae5 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb098486820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:50.992931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-348335ad-d588-4d50-b810-99597f0f9ae5 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e44fc199-e819-4074-92a3-997ec3de9e1a" status: 202 len: 0 microversion: 2.1 time: 0.350591 Apr 09 21:02:50.995424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1082/2240] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:50 2022] DELETE /compute/v2.1/os-security-groups/e44fc199-e819-4074-92a3-997ec3de9e1a => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:51.004163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:51.011868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:51.019217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.019959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.020809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.022601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.032533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:02:51.058386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:02:51.144720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-680081b7-2a0e-485c-8cce-24bbb4961f2a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 204 len: 0 microversion: 2.1 time: 0.146091 Apr 09 21:02:51.145681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1083/2241] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:02:50 2022] DELETE /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:02:51.151157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:51.151873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:51.158190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.158634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.159424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.159854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.395404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:51.404975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:51.406817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:51.407963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d7599ce-0890-4813-9303-1e75ad5f4d84 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1361 microversion: 2.26 time: 0.261035 Apr 09 21:02:51.419121 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1084/2242] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:51 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:51.547748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61f1bf89-c5bd-400f-92b2-d3d9fe8b44d0 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] Calling method '.version_select at 0x7fb08e6f6dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:51.548677 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:02:51.548677 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:02:51.562324 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61f1bf89-c5bd-400f-92b2-d3d9fe8b44d0 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.152752 Apr 09 21:02:51.567909 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1085/2243] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Apr 9 21:02:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:51.572878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-80398669-60ee-42a7-ba1a-7d08f1e3fb56 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] Calling method '.version_select at 0x7fb08f3dc280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:51.691358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Updating instance_info_cache with network_info: [{"id": "b9a7f79d-1d3a-4671-b464-16baee2a1102", "address": "fa:16:3e:c4:c6:3f", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9a7f79d-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:02:51.704377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Releasing lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:02:51.705931 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-62364851-6ea7-4146-a806-f09763066048 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action" status: 202 len: 0 microversion: 2.1 time: 2.947737 Apr 09 21:02:51.710632 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1159/2244] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:02:48 2022] POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action => generated 0 bytes in 2954 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:02:51.715470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f48c0df5-9654-43aa-80ff-20928a5dc57d req-57ecfa05-8d69-455b-a814-97437cb8d4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:51.725634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f48c0df5-9654-43aa-80ff-20928a5dc57d req-57ecfa05-8d69-455b-a814-97437cb8d4b1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.726085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f48c0df5-9654-43aa-80ff-20928a5dc57d req-57ecfa05-8d69-455b-a814-97437cb8d4b1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.736823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f48c0df5-9654-43aa-80ff-20928a5dc57d req-57ecfa05-8d69-455b-a814-97437cb8d4b1 service nova] Creating event network-changed:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:02:51.742462 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f48c0df5-9654-43aa-80ff-20928a5dc57d req-57ecfa05-8d69-455b-a814-97437cb8d4b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030543 Apr 09 21:02:51.743023 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1160/2245] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:51.748267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:51.748964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:51.760847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.761354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.762145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:51.762582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:51.989522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-80398669-60ee-42a7-ba1a-7d08f1e3fb56 tempest-SecurityGroupRulesNegativeTestJSON-1285894900 tempest-SecurityGroupRulesNegativeTestJSON-1285894900-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/423c764d-bcbf-4da6-a78e-87591df4d7ef" status: 202 len: 0 microversion: 2.1 time: 0.420209 Apr 09 21:02:51.990980 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1086/2246] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:02:51 2022] DELETE /compute/v2.1/os-security-groups/423c764d-bcbf-4da6-a78e-87591df4d7ef => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:02:51.997778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-939ac26d-07bb-41b6-aa10-056a0ab32057 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] Action: 'update', calling method: .version_select at 0x7fb09847c9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:52.000235 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:02:52.000235 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:02:52.025836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:52.049889 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a193e221-f8df-4f5e-b55e-efe118df18e6 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1500 microversion: 2.1 time: 0.305321 Apr 09 21:02:52.068900 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1161/2247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:51 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1500 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:52.076102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:52.076710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:52.089266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.091522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.094264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.094932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.298689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-939ac26d-07bb-41b6-aa10-056a0ab32057 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.305582 Apr 09 21:02:52.300147 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1087/2248] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Apr 9 21:02:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:52.307105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.111"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:52.309378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:52.323723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.324433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.325715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.326286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.336041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:52.346382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0cea849-b598-44b9-957b-48ae6c427b6d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.276101 Apr 09 21:02:52.347895 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1162/2249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:52 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:52.352821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa1c5970-f4cc-476d-bdc6-03af193cd900 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] Calling method '.version_select at 0x7fb08e4d9940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:52.356284 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:02:52.356284 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:02:52.367303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Acquired lock "refresh_cache-98f1ce29-b2a9-4ecb-af40-e50a34dde574" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:02:52.377264 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa1c5970-f4cc-476d-bdc6-03af193cd900 tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027745 Apr 09 21:02:52.378078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1163/2250] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Apr 9 21:02:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:52.391055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-00a9e0a2-6121-414e-ac04-322a89858c1d tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] Action: 'update', calling method: .version_select at 0x7fb08e4f7d30>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:52.392534 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:02:52.392534 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:02:52.481410 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-00a9e0a2-6121-414e-ac04-322a89858c1d tempest-QuotaClassesAdmin257Test-1505986638 tempest-QuotaClassesAdmin257Test-1505986638-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.093941 Apr 09 21:02:52.482580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1164/2251] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Apr 9 21:02:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:52.487508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:52.488373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:52.495315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.495981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.496925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:52.497561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:52.873322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:52.885553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:52.887897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:52.889348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73c98df5-0338-41ad-83e6-ecad089d2146 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1361 microversion: 2.26 time: 0.405391 Apr 09 21:02:52.901443 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1165/2252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:52 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:53.068329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:53.069816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:53.081969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.082811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:53.084134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.084936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:53.350601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:53.359825 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37485d09-c998-458f-9138-edaae3e7f9ad tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1500 microversion: 2.1 time: 0.296288 Apr 09 21:02:53.370231 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1166/2253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:53 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1500 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:02:53.376468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:53.377504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:53.386968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.387828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:53.392422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.402285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:53.772204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:53.782948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb5f44ea-0417-4146-8285-6b7ec68c324f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1325 microversion: 2.1 time: 0.410853 Apr 09 21:02:53.784707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1167/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:53 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:53.908064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:53.908961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:53.916542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.917000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:53.920526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:53.923811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.614044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:54.626215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:54.628210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:54.630414 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa59e714-4a6f-4c69-8fce-393f0b3ed832 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1361 microversion: 2.26 time: 0.725640 Apr 09 21:02:54.631241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1168/2255] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:53 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1361 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:54.648511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:54.649862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:54.669155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.670119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.672244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.672850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.719339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.719787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.720241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lazy-loading 'fault' on Instance uuid 7669d40f-e600-49f8-af5a-b0927eae1fde {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:54.818229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceba42e80d7746e4897669084c078c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d269ab35841c397ca9168792c1ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:54.826934 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf289246-8a26-4a40-9494-6a23c478187a tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 200 len: 1301 microversion: 2.1 time: 0.193912 Apr 09 21:02:54.827535 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1169/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:54 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 1301 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:54.841806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3ad41c95-591a-460b-b7c3-3481917f74fc req-1c1aff7a-9b31-4a33-aa31-59b40df04546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7669d40f-e600-49f8-af5a-b0927eae1fde", "name": "network-vif-deleted", "tag": "5a70f221-9817-486d-a4b4-02f831c18d28"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:54.850966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ad41c95-591a-460b-b7c3-3481917f74fc req-1c1aff7a-9b31-4a33-aa31-59b40df04546 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.851691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ad41c95-591a-460b-b7c3-3481917f74fc req-1c1aff7a-9b31-4a33-aa31-59b40df04546 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.863470 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3ad41c95-591a-460b-b7c3-3481917f74fc req-1c1aff7a-9b31-4a33-aa31-59b40df04546 service nova] Creating event network-vif-deleted:5a70f221-9817-486d-a4b4-02f831c18d28 for instance 7669d40f-e600-49f8-af5a-b0927eae1fde on nch2-master-1 Apr 09 21:02:54.868921 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3ad41c95-591a-460b-b7c3-3481917f74fc req-1c1aff7a-9b31-4a33-aa31-59b40df04546 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 Apr 09 21:02:54.869807 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1170/2257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:54.876601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:54.877556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:54.885178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.885900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:54.887755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:54.888735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:55.243415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:55.261079 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-28f0e802-e54b-4531-b74c-41760d7452c3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.389990 Apr 09 21:02:55.263524 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1171/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:54 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:55.283737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:55.287726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:55.294749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:55.295412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:55.296250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:55.296781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:55.630621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:55.653733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c21f2f48-34af-4856-a93c-3623173fffcd tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.376028 Apr 09 21:02:55.655773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1172/2259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:55 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:55.950700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b415049-8d26-4409-85bf-cc81d809a76a tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb08e4a48b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2094824135", "description": "tempest-description-5358303"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:56.068695 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.network.neutron [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] re-assign floating IP 172.35.0.111 from instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 Apr 09 21:02:56.126318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Building network info cache for instance {{(pid=141819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:02:56.184131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b415049-8d26-4409-85bf-cc81d809a76a tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.527249 Apr 09 21:02:56.192117 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1173/2260] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:55 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:56.198448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0432a86a-b09b-439e-b9dc-c37b3917e2e1 req-26e3bac1-a1c2-4230-a01c-b01be52d80d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa96a6a-ad9e-4764-b6d8-591508c71bf9", "name": "network-vif-plugged", "status": "completed", "tag": "b398b476-f8f8-407d-a3f3-11da1ed049c7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:56.213646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0432a86a-b09b-439e-b9dc-c37b3917e2e1 req-26e3bac1-a1c2-4230-a01c-b01be52d80d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.214082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0432a86a-b09b-439e-b9dc-c37b3917e2e1 req-26e3bac1-a1c2-4230-a01c-b01be52d80d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.236229 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0432a86a-b09b-439e-b9dc-c37b3917e2e1 req-26e3bac1-a1c2-4230-a01c-b01be52d80d6 service nova] Creating event network-vif-plugged:b398b476-f8f8-407d-a3f3-11da1ed049c7 for instance 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 on nch2-master-1 Apr 09 21:02:56.242499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0432a86a-b09b-439e-b9dc-c37b3917e2e1 req-26e3bac1-a1c2-4230-a01c-b01be52d80d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048799 Apr 09 21:02:56.243315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1174/2261] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:56.248485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:56.249722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:56.256159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.256601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.257606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.258201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.571736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:56.580574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:56.582107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:56.583240 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48a6d01e-299e-4347-a369-20efb63a2431 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1361 microversion: 2.26 time: 0.339048 Apr 09 21:02:56.583809 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1175/2262] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:56 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:56.588667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-adc858b3-af2b-40d5-bd1b-aa77a9f7a7af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-758985394", "metadata": {"": ""}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:56.589945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-adc858b3-af2b-40d5-bd1b-aa77a9f7a7af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:56.590900 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-adc858b3-af2b-40d5-bd1b-aa77a9f7a7af tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action" status: 400 len: 170 microversion: 2.1 time: 0.005938 Apr 09 21:02:56.591858 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1176/2263] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Apr 9 21:02:56 2022] POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action => generated 170 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:02:56.596214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:56.597371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] [instance: 7669d40f-e600-49f8-af5a-b0927eae1fde] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:56.610992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.612563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.613454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.614082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.627733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] HTTP exception thrown: Instance 7669d40f-e600-49f8-af5a-b0927eae1fde could not be found. Apr 09 21:02:56.628331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] Returning 404 to user: Instance 7669d40f-e600-49f8-af5a-b0927eae1fde could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:56.629226 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2d4e53de-b3f1-4c86-a109-12181f7c60f0 tempest-LiveMigrationTest-1096887428 tempest-LiveMigrationTest-1096887428-project] 10.222.0.30 "GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde" status: 404 len: 111 microversion: 2.1 time: 0.036295 Apr 09 21:02:56.634837 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1177/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:56 2022] GET /compute/v2.1/servers/7669d40f-e600-49f8-af5a-b0927eae1fde => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:02:56.639005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7c1dc3e8-60d2-4fd3-b89f-4f49629fe5d6 req-e5482555-0521-419b-b61f-5d661d1845dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:56.647232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7c1dc3e8-60d2-4fd3-b89f-4f49629fe5d6 req-e5482555-0521-419b-b61f-5d661d1845dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:56.647791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7c1dc3e8-60d2-4fd3-b89f-4f49629fe5d6 req-e5482555-0521-419b-b61f-5d661d1845dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:56.672988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7c1dc3e8-60d2-4fd3-b89f-4f49629fe5d6 req-e5482555-0521-419b-b61f-5d661d1845dd service nova] Creating event network-changed:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:02:56.684118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7c1dc3e8-60d2-4fd3-b89f-4f49629fe5d6 req-e5482555-0521-419b-b61f-5d661d1845dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049467 Apr 09 21:02:56.684632 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1178/2265] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:56.716686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f63de9c8-8425-4a0f-9b43-55416c8fccd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb08e49f040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2033553948", "description": "tempest-description-1078502204"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:57.117968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Updating instance_info_cache with network_info: [{"id": "b9a7f79d-1d3a-4671-b464-16baee2a1102", "address": "fa:16:3e:c4:c6:3f", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9a7f79d-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:02:57.139310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Building network info cache for instance {{(pid=141819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:02:57.353220 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f63de9c8-8425-4a0f-9b43-55416c8fccd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.665926 Apr 09 21:02:57.354397 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1179/2266] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:02:56 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:57.394798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:57.397878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:57.423462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:57.423933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:57.424786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:57.428364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.190987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:58.199325 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-47f1afce-3717-4643-bef3-478764c985b2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.829948 Apr 09 21:02:58.199922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1180/2267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:57 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:58.345180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Action: 'update', calling method: .version_select at 0x7fb08e4800d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:58.425207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.425690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.426727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.426962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.481137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Updating instance_info_cache with network_info: [{"id": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f", "address": "fa:16:3e:d6:6b:2e", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap455d580c-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:02:58.494310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Releasing lock "refresh_cache-98f1ce29-b2a9-4ecb-af40-e50a34dde574" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:02:58.495629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5bcebee2-0ccf-4170-b20f-158b615ab949 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574/action" status: 202 len: 0 microversion: 2.1 time: 6.194336 Apr 09 21:02:58.495786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d14c16bc-768e-41f5-81b8-e09b4ca8c905 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b" status: 200 len: 148 microversion: 2.57 time: 0.294631 Apr 09 21:02:58.496655 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1181/2268] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Apr 9 21:02:58 2022] PUT /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b => generated 148 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:58.497115 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1088/2269] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:02:52 2022] POST /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574/action => generated 0 bytes in 6196 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:02:58.501224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-920494880", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "2862fa2b-3134-4de1-bedd-a2bf3828b8ca"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:58.502332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:58.503165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:58.509914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.510659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.511754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.512392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.560318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] validate_networks() for [('2862fa2b-3134-4de1-bedd-a2bf3828b8ca', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:02:58.764448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:58.773630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:58.775330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:58.776702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c95841cd-c6a9-4729-82c6-a1ad77477f2b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1545 microversion: 2.26 time: 0.278387 Apr 09 21:02:58.777414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1089/2270] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:02:58 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1545 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:02:58.783842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:58.784542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:58.793982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.794499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:58.795513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:58.796041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.013681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:59.021262 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14cd9727-ebbc-4edc-b23d-8c2f12db4ae8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.241433 Apr 09 21:02:59.022038 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1090/2271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:58 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:59.038195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Calling method '.version_select at 0x7fb08e6bc310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:59.073878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:02:59.074505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:02:59.074972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:02:59.075371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:02:59.075769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:02:59.084222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.084669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.085492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.085923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.103465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Getting quotas for project bc7a2d61df2b4bfda6882e74e73b6cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:02:59.108133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Getting quotas for user fbcb9088698a4f478ccebca7a65f54c4 and project bc7a2d61df2b4bfda6882e74e73b6cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:02:59.120253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:02:59.122596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:02:59.170236 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd434ba7-f442-471e-996c-a820f27e9dbf tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672462 Apr 09 21:02:59.175751 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1182/2272] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:02:59.176334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.111"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:59.283577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.284228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.284883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.285353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.313118 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-79353dbe-afff-4a74-97d0-97594099a1d4 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b/detail" status: 200 len: 463 microversion: 2.57 time: 0.279562 Apr 09 21:02:59.317096 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1091/2273] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Apr 9 21:02:59 2022] GET /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b/detail => generated 463 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:02:59.341828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a7c971f6-3960-4b84-8912-b81b2e115ec9 req-01e2dd30-c6b9-462b-9df4-57ad4897ad75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f1ce29-b2a9-4ecb-af40-e50a34dde574", "tag": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:59.371937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:59.380636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a7c971f6-3960-4b84-8912-b81b2e115ec9 req-01e2dd30-c6b9-462b-9df4-57ad4897ad75 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.381314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a7c971f6-3960-4b84-8912-b81b2e115ec9 req-01e2dd30-c6b9-462b-9df4-57ad4897ad75 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.406853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.407667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.409802 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a7c971f6-3960-4b84-8912-b81b2e115ec9 req-01e2dd30-c6b9-462b-9df4-57ad4897ad75 service nova] Creating event network-changed:455d580c-41d3-4b94-874f-5a7e5ca3ad6f for instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 on nch1-master-1 Apr 09 21:02:59.411221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.412142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.417433 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a7c971f6-3960-4b84-8912-b81b2e115ec9 req-01e2dd30-c6b9-462b-9df4-57ad4897ad75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101684 Apr 09 21:02:59.418526 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1092/2274] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:02:59.426487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e6bc0d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:59.437806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.438253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.438824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:59.452691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.456864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.457932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.458537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.497721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.498440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.531896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.532695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.588734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:02:59.608281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94a5e15c-de59-4557-b391-5818a6cf20b6 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-51470935" status: 201 len: 0 microversion: 2.26 time: 0.187891 Apr 09 21:02:59.609287 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1093/2275] 10.222.0.30 () {62 vars in 1373 bytes} [Sat Apr 9 21:02:59 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-51470935 => generated 0 bytes in 190 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Apr 09 21:02:59.614596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba335b79-e1dc-420b-8e93-5a01d56f900f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1246457652", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:59.616130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba335b79-e1dc-420b-8e93-5a01d56f900f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:59.617362 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba335b79-e1dc-420b-8e93-5a01d56f900f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action" status: 400 len: 938 microversion: 2.1 time: 0.006959 Apr 09 21:02:59.621846 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1094/2276] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Apr 9 21:02:59 2022] POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action => generated 938 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:02:59.628447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6abfc42-bdf5-45ff-a0b1-92f150a3e3f0 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:59.630224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6abfc42-bdf5-45ff-a0b1-92f150a3e3f0 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:59.762426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6abfc42-bdf5-45ff-a0b1-92f150a3e3f0 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:02:59.773287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6abfc42-bdf5-45ff-a0b1-92f150a3e3f0 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1215 microversion: 2.1 time: 0.149958 Apr 09 21:02:59.774242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1095/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:59 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:02:59.782799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3150498d-b9bd-458e-9b8d-1643edc02479 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e6bc670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:59.795754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3150498d-b9bd-458e-9b8d-1643edc02479 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.795754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3150498d-b9bd-458e-9b8d-1643edc02479 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.809936 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3150498d-b9bd-458e-9b8d-1643edc02479 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-51470935" status: 204 len: 0 microversion: 2.26 time: 0.033160 Apr 09 21:02:59.810712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1096/2278] 10.222.0.30 () {60 vars in 1354 bytes} [Sat Apr 9 21:02:59 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-51470935 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:02:59.816506 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] HTTP exception thrown: Floating IP 172.35.0.111 is not associated with instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6. Apr 09 21:02:59.817464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Returning 409 to user: Floating IP 172.35.0.111 is not associated with instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:02:59.817941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:02:59.818655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae8db1cd-f31a-4b51-900f-bbf679236557 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action" status: 409 len: 146 microversion: 2.1 time: 0.646308 Apr 09 21:02:59.819070 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1183/2279] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:02:59 2022] POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action => generated 146 bytes in 647 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:02:59.819259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:02:59.823695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Action: 'update', calling method: .version_select at 0x7fb08e4b6e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:02:59.834215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.835818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:02:59.839260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:02:59.843930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.064258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.064776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.065387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:00.066494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.066991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.073081 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b123c07-05d9-4cab-872e-5d2e4c25596d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.261100 Apr 09 21:03:00.076408 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1097/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:02:59 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:00.090200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e6bc040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:00.098452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.099099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.099578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:00.105169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.105538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.106303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.106732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.126233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.127277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.128194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.128913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.131218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.131673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.147062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:00.163063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f728070-1e0a-4b90-b908-2874cef4121d tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 204 len: 0 microversion: 2.26 time: 0.085380 Apr 09 21:03:00.163741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1098/2281] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Apr 9 21:03:00 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:00.173293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.111"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:00.192111 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fcef5a54-d2a2-4582-acc5-c33a72b9c48a tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b?user_id=8a45ad01dedf4a76839bdc85827ca8a7" status: 200 len: 148 microversion: 2.57 time: 0.371975 Apr 09 21:03:00.192921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1184/2282] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Apr 9 21:02:59 2022] PUT /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b?user_id=8a45ad01dedf4a76839bdc85827ca8a7 => generated 148 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:03:00.197764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:00.198506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:00.204406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.205058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.205957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.206486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.405092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:00.410258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.410747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.411541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.411979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.460782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:00.481160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3be9b22c-0a4d-4aa5-9363-a7292ebdc246 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.283358 Apr 09 21:03:00.482120 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1185/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:00 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:00.497676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-819ce900-53fe-48d0-878d-939ef069bb3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e49f160>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:00.512691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-819ce900-53fe-48d0-878d-939ef069bb3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.514043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-819ce900-53fe-48d0-878d-939ef069bb3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.552462 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-819ce900-53fe-48d0-878d-939ef069bb3b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 12 microversion: 2.26 time: 0.069069 Apr 09 21:03:00.553758 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1186/2284] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 21:03:00 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 12 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:00.559651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5454d4f4-09e2-44a8-b412-234529582620 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] Calling method '.version_select at 0x7fb08e49f3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:00.735124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Acquired lock "refresh_cache-98f1ce29-b2a9-4ecb-af40-e50a34dde574" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:03:00.918967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5454d4f4-09e2-44a8-b412-234529582620 tempest-QuotasAdminTestV257-324207289 tempest-QuotasAdminTestV257-324207289-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b?user_id=8a45ad01dedf4a76839bdc85827ca8a7" status: 200 len: 190 microversion: 2.57 time: 0.363884 Apr 09 21:03:00.919921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1187/2285] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Apr 9 21:03:00 2022] GET /compute/v2.1/os-quota-sets/11a658a11a784f3d83f22c1219dfb00b?user_id=8a45ad01dedf4a76839bdc85827ca8a7 => generated 190 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:03:00.933407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac30d8d1-ce30-4edc-817f-5c9db3f0735e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:00.936928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac30d8d1-ce30-4edc-817f-5c9db3f0735e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:00.938459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac30d8d1-ce30-4edc-817f-5c9db3f0735e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action" status: 400 len: 619 microversion: 2.1 time: 0.017226 Apr 09 21:03:00.943167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1188/2286] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Apr 9 21:03:00 2022] POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:03:00.950647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e4d9430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:00.960039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.960900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.961737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:00.971050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.976800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:00.978309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:00.978983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:01.016238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:01.017155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:01.027127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:01.028005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:01.071002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:01.091839 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 21:03:01.530826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Building network info cache for instance {{(pid=141819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:03:02.103663 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57788. Apr 09 21:03:02.111132 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f8e40a95-587d-411a-8271-115b3360aa28 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1954689587" status: 201 len: 0 microversion: 2.26 time: 1.166630 Apr 09 21:03:02.112168 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1189/2287] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Apr 9 21:03:00 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1954689587 => generated 0 bytes in 1168 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 09 21:03:02.117500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:02.118502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:02.125185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.125852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.126836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.127465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.247297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Updating instance_info_cache with network_info: [{"id": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f", "address": "fa:16:3e:d6:6b:2e", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap455d580c-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:03:02.268209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Releasing lock "refresh_cache-98f1ce29-b2a9-4ecb-af40-e50a34dde574" {{(pid=141819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:03:02.269764 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a953d7e-2074-4db0-8562-8e5873022416 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574/action" status: 202 len: 0 microversion: 2.1 time: 2.104836 Apr 09 21:03:02.270990 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1099/2288] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:00 2022] POST /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574/action => generated 0 bytes in 2106 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:03:02.289157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:02.291045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:02.298842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.299866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.302344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.303367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.381454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:02.392682 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-416f8888-95a1-4272-b1f9-6be50f1168c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1315 microversion: 2.1 time: 0.278454 Apr 09 21:03:02.393828 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1190/2289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:02 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:02.681434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1066919837", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:02.760324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:02.802356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:02.811393 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-029ea71c-42e3-4370-830a-b39a952646ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.538547 Apr 09 21:03:02.812313 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1100/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:02 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:02.818009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-23ebb796-daa3-4e31-8215-494771e754dc req-bc9aeec1-76b9-46de-b69e-d277bfbeb0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f1ce29-b2a9-4ecb-af40-e50a34dde574", "tag": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:02.827545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-23ebb796-daa3-4e31-8215-494771e754dc req-bc9aeec1-76b9-46de-b69e-d277bfbeb0b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.828084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-23ebb796-daa3-4e31-8215-494771e754dc req-bc9aeec1-76b9-46de-b69e-d277bfbeb0b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.840571 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-23ebb796-daa3-4e31-8215-494771e754dc req-bc9aeec1-76b9-46de-b69e-d277bfbeb0b8 service nova] Creating event network-changed:455d580c-41d3-4b94-874f-5a7e5ca3ad6f for instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 on nch1-master-1 Apr 09 21:03:02.847999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-23ebb796-daa3-4e31-8215-494771e754dc req-bc9aeec1-76b9-46de-b69e-d277bfbeb0b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033779 Apr 09 21:03:02.849552 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1101/2291] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:02.856850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e398882-bb88-473e-a251-734715df944f tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e654ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:02.869137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e398882-bb88-473e-a251-734715df944f tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.869846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e398882-bb88-473e-a251-734715df944f tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.885777 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e398882-bb88-473e-a251-734715df944f tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 36 microversion: 2.26 time: 0.033302 Apr 09 21:03:02.891364 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1102/2292] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 21:03:02 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 36 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:02.893109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:02.894235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:02.902430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.903111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.904282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:02.907688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:02.947378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:03.108278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15ca5b85-2309-4965-80b8-5e874e30aa38 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "DELETE /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 204 len: 0 microversion: 2.1 time: 0.219823 Apr 09 21:03:03.109598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1103/2293] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:02 2022] DELETE /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:03.122307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-137ec12b-319a-4002-a48f-10e6ec487822 req-914302a0-6034-497a-b83b-8876b9e4e8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34469266-eccb-4d9a-847a-455bffa2c78a", "tag": "f1f5938f-d802-4ab4-9995-8b667eecc83f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:03.130935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-137ec12b-319a-4002-a48f-10e6ec487822 req-914302a0-6034-497a-b83b-8876b9e4e8e4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.131381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-137ec12b-319a-4002-a48f-10e6ec487822 req-914302a0-6034-497a-b83b-8876b9e4e8e4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.144351 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-137ec12b-319a-4002-a48f-10e6ec487822 req-914302a0-6034-497a-b83b-8876b9e4e8e4 service nova] Creating event network-changed:f1f5938f-d802-4ab4-9995-8b667eecc83f for instance 34469266-eccb-4d9a-847a-455bffa2c78a on nch1-master-1 Apr 09 21:03:03.149934 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-137ec12b-319a-4002-a48f-10e6ec487822 req-914302a0-6034-497a-b83b-8876b9e4e8e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038658 Apr 09 21:03:03.150949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1104/2294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:03.156883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:03.157495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:03.164928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.165855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.166242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.166675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.480283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:03.480784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:03.481312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:03.481808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:03.482465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:03.491210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.491732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.492658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.493390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.496775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:03.504707 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1bef7c3a-eeae-40d5-9b59-3f2f54eabf86 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.352545 Apr 09 21:03:03.505551 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1105/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:03 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:03.511866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb09847c820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:03.513064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Getting quotas for project ab5f53583b7444188c705ed472c3cf06. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:03.518013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Getting quotas for user 35025c6fdf024e8ea7d8d53db1a3974c and project ab5f53583b7444188c705ed472c3cf06. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:03.519780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.520243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.520724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:03.526308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.526756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.527526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.527974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.532568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:03.534902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:03.550251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.550251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.583180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf981ce8-36cf-43f5-bc44-e3d6253d6d08 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188028 Apr 09 21:03:03.584481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1191/2296] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:03.591521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:03.594240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.111"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:03.596220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:03.603292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.603752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.604529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.604966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.613745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-22a008d1-ff45-4350-a14e-ffaa35e91da0 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1954689587" status: 204 len: 0 microversion: 2.26 time: 0.105814 Apr 09 21:03:03.614563 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1106/2297] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Apr 9 21:03:03 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1954689587 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:03.620584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:03.621333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:03.627763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.628461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.629225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.629739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.650567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Acquired lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:03:03.897826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:03.910470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e3d40db-849d-469d-ad70-2e4675412a76 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1315 microversion: 2.1 time: 0.294028 Apr 09 21:03:03.911693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1107/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:03 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:03.918061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-354070266"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:03.919628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:03.929483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.930275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:03.931274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:03.931952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.260047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9eb2978e-5c67-451e-83ee-21da9009d74f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action" status: 202 len: 0 microversion: 2.1 time: 0.346511 Apr 09 21:03:04.261158 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1108/2299] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:03 2022] POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:03:04.272011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.273743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:04.280526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.281478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.282520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.283382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.417686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:04.427354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a90e8a73-9148-48dc-8f13-bd793adfbcd1 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1215 microversion: 2.1 time: 0.159719 Apr 09 21:03:04.428896 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1109/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:04 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:04.434105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-162bfcda-995e-434c-9d5f-17209baa51f3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e68e700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.448071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-162bfcda-995e-434c-9d5f-17209baa51f3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.449122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-162bfcda-995e-434c-9d5f-17209baa51f3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.460103 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-162bfcda-995e-434c-9d5f-17209baa51f3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 12 microversion: 2.26 time: 0.029939 Apr 09 21:03:04.461006 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1110/2301] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 21:03:04 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:04.466203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-7993989"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:04.467308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:04.473767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.475115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.475932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.476378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.512217 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Cannot 'createImage' instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 while it is in task_state image_snapshot Apr 09 21:03:04.512926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 409 to user: Cannot 'createImage' instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 while it is in task_state image_snapshot {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:04.513708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6bbd988-00b1-491d-b043-7a93051aae9a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action" status: 409 len: 159 microversion: 2.1 time: 0.051542 Apr 09 21:03:04.514523 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1111/2302] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:04 2022] POST /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227/action => generated 159 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:03:04.519124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb09846fa60>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.529306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.530077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.530773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:04.537297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.539229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.540304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.540843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.574604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.575600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.600165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:04.617510 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05928a7e-0274-4f1e-a270-1ac2b36d355b tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 204 len: 0 microversion: 2.26 time: 0.102023 Apr 09 21:03:04.618832 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1112/2303] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Apr 9 21:03:04 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:04.626607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f6459ec-39aa-4485-ad2b-bfececcf5240 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb09847c1f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.754712 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f6459ec-39aa-4485-ad2b-bfececcf5240 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/images/9659851d-a2f8-4620-8c91-c56c297080c8" status: 204 len: 0 microversion: 2.1 time: 0.135434 Apr 09 21:03:04.755331 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1113/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:04 2022] DELETE /compute/v2.1/images/9659851d-a2f8-4620-8c91-c56c297080c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:04.762511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb09847d5e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.770567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.771026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.774713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:04.778353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.778810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.779597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.780033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.804242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.804859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.815418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.816235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.853815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:04.871784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a0a650b-0a16-4718-bcf8-b01ac23eaab4 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1291504896" status: 201 len: 0 microversion: 2.26 time: 0.114879 Apr 09 21:03:04.872670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1114/2305] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Apr 9 21:03:04 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1291504896 => generated 0 bytes in 116 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 09 21:03:04.877361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:04.877995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:04.884498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.884952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:04.886136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:04.886794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.202951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:05.211850 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ed92e09-1f5b-4ed7-a406-26c9e6c07181 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1534 microversion: 2.1 time: 0.338260 Apr 09 21:03:05.222034 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1115/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:04 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1534 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:05.222034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb09847c940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:05.228336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.228789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.229307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:05.234850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.235297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.236068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.236513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.259696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.260279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.269963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.270937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.295303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:05.309541 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9db626e9-a426-4051-b3c8-2cd824f97458 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1450244862" status: 201 len: 0 microversion: 2.26 time: 0.096133 Apr 09 21:03:05.310356 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1116/2307] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Apr 9 21:03:05 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1450244862 => generated 0 bytes in 97 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 09 21:03:05.314946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:05.315428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:05.321432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.321882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.322661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:05.323098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:05.556316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:03:05.753695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:05.769953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7e55d75a-3a0b-4aa6-aef6-f6dfc0f4c0b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1315 microversion: 2.1 time: 0.458524 Apr 09 21:03:05.771005 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1117/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:05 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:05.918206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-526862683", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:05.999448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:07.135434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:07.136084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:07.136373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:07.136781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:07.137234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:07.146491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.146943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.147745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.148179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.166275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:07.171240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for user 3d1c24bc22654cab94bc0b7b8e271c7e and project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:07.183943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:07.186292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:07.231397 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-243e7564-2bd3-46dd-ba48-83ce69caf364 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458990 Apr 09 21:03:07.232054 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1118/2309] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:07.239110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08f45de50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:07.252216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.252767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.254371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:07.261500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.261947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.262749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.263183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.306027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.307532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.326369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:07.343236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aed5eaf6-0a6e-406e-8921-e529882112e5 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 204 len: 0 microversion: 2.26 time: 0.109042 Apr 09 21:03:07.347518 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1119/2310] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Apr 9 21:03:07 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:07.349715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:07.350407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:07.356877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.357480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.358370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.359431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.506400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:07.529615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd7f9267-2f85-4e8b-af23-b57d90334491 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1277 microversion: 2.1 time: 0.173351 Apr 09 21:03:07.530308 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1120/2311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:07 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:07.535660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-195f639e-7ae9-4fdb-8558-def2441c1cb2 req-4ef7f156-02df-403a-957d-925898c6fe8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:07.554564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-195f639e-7ae9-4fdb-8558-def2441c1cb2 req-4ef7f156-02df-403a-957d-925898c6fe8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.555359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-195f639e-7ae9-4fdb-8558-def2441c1cb2 req-4ef7f156-02df-403a-957d-925898c6fe8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.573018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-195f639e-7ae9-4fdb-8558-def2441c1cb2 req-4ef7f156-02df-403a-957d-925898c6fe8f service nova] Creating event network-changed:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:03:07.591167 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-195f639e-7ae9-4fdb-8558-def2441c1cb2 req-4ef7f156-02df-403a-957d-925898c6fe8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059525 Apr 09 21:03:07.591787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1121/2312] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:07.599422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:07.600397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:07.610348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.611116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.612101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.615838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.819567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Updating instance_info_cache with network_info: [{"id": "b9a7f79d-1d3a-4671-b464-16baee2a1102", "address": "fa:16:3e:c4:c6:3f", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9a7f79d-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:03:07.837746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Releasing lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:03:07.839202 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0efdd984-2654-46d8-b67e-6a2e199416a2 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action" status: 202 len: 0 microversion: 2.1 time: 4.253397 Apr 09 21:03:07.840777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1192/2313] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:03 2022] POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action => generated 0 bytes in 4256 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:03:07.854955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:07.856277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:07.864815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.865709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:07.878093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:07.886440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.028529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:08.036577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0290b11f-8726-4cf8-b9c0-f12a590dd3b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1540 microversion: 2.1 time: 0.443357 Apr 09 21:03:08.037398 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1122/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:07 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1540 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:08.050904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1191814721", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:08.114438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:08.172008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:08.180233 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e729b25f-d3f8-4f70-974d-fa79fd62f2cd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1315 microversion: 2.1 time: 0.337606 Apr 09 21:03:08.184270 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1193/2315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:07 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:08.191339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93e7ec19-25fc-4043-ba0f-c2b8cdcf3463 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e4a4e50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:08.205984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e7ec19-25fc-4043-ba0f-c2b8cdcf3463 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.206563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e7ec19-25fc-4043-ba0f-c2b8cdcf3463 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.239167 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93e7ec19-25fc-4043-ba0f-c2b8cdcf3463 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 12 microversion: 2.26 time: 0.053288 Apr 09 21:03:08.239874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1194/2316] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 21:03:08 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 12 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:08.249936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1bcf1b89-3332-42c3-8b59-3eae1eda3792 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '.version_select at 0x7fb08e4a4820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:08.813238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:08.813758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:08.814163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:08.814573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:08.815268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:08.826007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.826461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.827285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.827720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.845778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:08.851280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for user 3d1c24bc22654cab94bc0b7b8e271c7e and project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:08.863658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:08.865984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:08.911695 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ebb48dc1-e269-45c8-9710-fbd3fdd46c99 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864614 Apr 09 21:03:08.917271 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1123/2317] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:08.917271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb09847be50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:08.925229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.925685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.926150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:08.933996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.934459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.935236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.935675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.960394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:08.960847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:08.972967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:08.988920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ccce89d8-8b84-4a97-b063-930741458e70 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 204 len: 0 microversion: 2.26 time: 0.075597 Apr 09 21:03:08.990307 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1124/2318] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Apr 9 21:03:08 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:09.000027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:09.000759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:09.010623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1bcf1b89-3332-42c3-8b59-3eae1eda3792 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/880f2b1c-2722-4096-99d1-b7dd90897d36" status: 200 len: 184 microversion: 2.1 time: 0.769298 Apr 09 21:03:09.011607 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1195/2319] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:03:08 2022] GET /compute/v2.1/os-floating-ips/880f2b1c-2722-4096-99d1-b7dd90897d36 => generated 184 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:09.018837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd2715ba-2880-404b-8742-f531097d302c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:09.019451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd2715ba-2880-404b-8742-f531097d302c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:09.021449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.021981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.022761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.023355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.176071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd2715ba-2880-404b-8742-f531097d302c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:09.191613 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd2715ba-2880-404b-8742-f531097d302c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1214 microversion: 2.1 time: 0.178523 Apr 09 21:03:09.192369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1196/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:09 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:09.200436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e4a4c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:09.212194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.212951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.213767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:09.222232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.222888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.223986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.224580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.253654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.254492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.265706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.266635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.321002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:09.342381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ea0ef36d-417a-4f49-bf90-13d8003d1e45 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1091123893" status: 201 len: 0 microversion: 2.26 time: 0.145259 Apr 09 21:03:09.344005 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1197/2321] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Apr 9 21:03:09 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1091123893 => generated 0 bytes in 148 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 09 21:03:09.350407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.111"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:09.527681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:09.536528 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-181a4609-a602-45c9-9ef4-39a465330e34 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.541787 Apr 09 21:03:09.537141 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1125/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:08 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:09.544310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:09.546323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:09.553156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.553834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.554662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.555191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.822650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:09.829943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.830939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:09.831879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:09.832401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:10.008221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:10.019416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa1664a3-b5e7-4910-bcaa-b195d247b97a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1540 microversion: 2.1 time: 0.481213 Apr 09 21:03:10.020273 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1126/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:09 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1540 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:10.036070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:10.036915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:10.048856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:10.049348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:10.050152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:10.050755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:10.799481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Acquired lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 21:03:11.006607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:11.015517 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81555307-b61a-419c-a46c-85fda970f690 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1315 microversion: 2.1 time: 0.983447 Apr 09 21:03:11.022282 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1127/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:10 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:11.026852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb098465430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:11.040781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.042016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.042660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:11.048646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.049133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.049912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.050348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.074447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.074860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.084228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.084679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.114734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:11.130625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18e6f188-b38a-47a5-bf0f-ee56df105f0e tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1884387429" status: 201 len: 0 microversion: 2.26 time: 0.108555 Apr 09 21:03:11.131212 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1128/2325] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Apr 9 21:03:11 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags/tempest-tag-1884387429 => generated 0 bytes in 110 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 09 21:03:11.136067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a1dae2be-4e26-4809-ac33-b2774cb678e8 req-59d353f3-df33-4d97-a055-8c8d6b0f0d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f1ce29-b2a9-4ecb-af40-e50a34dde574", "name": "network-vif-deleted", "tag": "455d580c-41d3-4b94-874f-5a7e5ca3ad6f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:11.144124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a1dae2be-4e26-4809-ac33-b2774cb678e8 req-59d353f3-df33-4d97-a055-8c8d6b0f0d39 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.144574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a1dae2be-4e26-4809-ac33-b2774cb678e8 req-59d353f3-df33-4d97-a055-8c8d6b0f0d39 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.156127 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a1dae2be-4e26-4809-ac33-b2774cb678e8 req-59d353f3-df33-4d97-a055-8c8d6b0f0d39 service nova] Creating event network-vif-deleted:455d580c-41d3-4b94-874f-5a7e5ca3ad6f for instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 on nch1-master-1 Apr 09 21:03:11.161226 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a1dae2be-4e26-4809-ac33-b2774cb678e8 req-59d353f3-df33-4d97-a055-8c8d6b0f0d39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028747 Apr 09 21:03:11.161916 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1129/2326] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:11.166746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-95178f5f-51da-4ae6-b17f-5d01eecbfc9f req-252abea4-e5a6-4443-a889-11a03c3fd44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34469266-eccb-4d9a-847a-455bffa2c78a", "name": "network-vif-plugged", "status": "completed", "tag": "f1f5938f-d802-4ab4-9995-8b667eecc83f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:11.175010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-95178f5f-51da-4ae6-b17f-5d01eecbfc9f req-252abea4-e5a6-4443-a889-11a03c3fd44b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.175454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-95178f5f-51da-4ae6-b17f-5d01eecbfc9f req-252abea4-e5a6-4443-a889-11a03c3fd44b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.186218 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-95178f5f-51da-4ae6-b17f-5d01eecbfc9f req-252abea4-e5a6-4443-a889-11a03c3fd44b service nova] Creating event network-vif-plugged:f1f5938f-d802-4ab4-9995-8b667eecc83f for instance 34469266-eccb-4d9a-847a-455bffa2c78a on nch1-master-1 Apr 09 21:03:11.191101 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-95178f5f-51da-4ae6-b17f-5d01eecbfc9f req-252abea4-e5a6-4443-a889-11a03c3fd44b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028077 Apr 09 21:03:11.191831 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1130/2327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:11.197505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:11.198202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:11.214932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.216117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.218013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.218693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.393089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:11.402797 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92cb5105-c0a9-4fc0-b6f9-ee13168f47a5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1272 microversion: 2.1 time: 0.209795 Apr 09 21:03:11.403976 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1131/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:11 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:11.408854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:11.409607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:11.416070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.416814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.417838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:11.418490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:11.988230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:11.996019 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57a582f2-b9c5-44c4-8e0f-5bd2abb450d7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.590915 Apr 09 21:03:11.996608 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1132/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:11 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:12.009816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:12.010434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:12.016774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.017445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.018037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.018494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.545709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:12.553876 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab799bfc-1b0c-444a-9a79-92420b158928 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1535 microversion: 2.1 time: 0.547713 Apr 09 21:03:12.554912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1133/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:11 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1535 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:12.559907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Action: 'update_all', calling method: .version_select at 0x7fb0984653a0>, body: {"tags": ["tempest-tag-898561582", "tempest-tag-413637885"]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:12.569079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.569577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.570504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:12.576906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.577391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.578191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.578631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.602638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.603155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.626477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:12.643894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9cf1d0b9-039b-4bbf-b7e7-540e9f6e57ff tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 60 microversion: 2.26 time: 0.087934 Apr 09 21:03:12.649115 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1134/2331] 10.222.0.30 () {62 vars in 1311 bytes} [Sat Apr 9 21:03:12 2022] PUT /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 60 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:12.649717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:12.650237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:12.657570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.658021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:12.658816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:12.659255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:13.239907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:13.248829 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a85c272b-ee06-4fa5-9418-0b6c9cc3e9b2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1502 microversion: 2.1 time: 0.603130 Apr 09 21:03:13.250543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1135/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:12 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:13.256209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:13.257331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:13.265132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:13.266002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:13.266613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:13.267059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:13.375752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Building network info cache for instance {{(pid=141818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 09 21:03:13.646640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:13.655189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-814d3452-30f6-4e72-bc61-990ff4dfa86b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.403355 Apr 09 21:03:13.655906 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1136/2333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:13 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:13.670799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b060a1b1-d50d-4d2e-a2da-bdf5fee5bbb3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08f45d940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:13.678795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b060a1b1-d50d-4d2e-a2da-bdf5fee5bbb3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:13.679354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b060a1b1-d50d-4d2e-a2da-bdf5fee5bbb3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:13.693265 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b060a1b1-d50d-4d2e-a2da-bdf5fee5bbb3 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 200 len: 60 microversion: 2.26 time: 0.027409 Apr 09 21:03:13.698534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1137/2334] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Apr 9 21:03:13 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 60 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:13.703296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:13.704036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:13.710208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:13.710827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:13.711725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:13.712255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.173401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:14.181779 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ea9a834-8f15-498c-8eb2-8af699a57a30 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.481957 Apr 09 21:03:14.190946 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1138/2335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:13 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:14.190946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f0d25ac2-0db3-4dbb-8247-f3ca4c6bca2e req-7b03b5e9-01f5-4858-9b18-9a30e6f791a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c778043-533a-46e6-904e-6149ad1af0a9", "tag": "926e2550-7b2a-4e9a-947e-f80f6f5bcf9d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:14.198774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f0d25ac2-0db3-4dbb-8247-f3ca4c6bca2e req-7b03b5e9-01f5-4858-9b18-9a30e6f791a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.199596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f0d25ac2-0db3-4dbb-8247-f3ca4c6bca2e req-7b03b5e9-01f5-4858-9b18-9a30e6f791a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.215587 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f0d25ac2-0db3-4dbb-8247-f3ca4c6bca2e req-7b03b5e9-01f5-4858-9b18-9a30e6f791a3 service nova] Creating event network-changed:926e2550-7b2a-4e9a-947e-f80f6f5bcf9d for instance 6c778043-533a-46e6-904e-6149ad1af0a9 on nch2-master-1 Apr 09 21:03:14.222039 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f0d25ac2-0db3-4dbb-8247-f3ca4c6bca2e req-7b03b5e9-01f5-4858-9b18-9a30e6f791a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037744 Apr 09 21:03:14.222657 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1139/2336] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:14.228130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-486f90e0-13ef-4f3f-9e83-2bd9b49d8750 req-41f31db6-3416-42ca-a2a8-fbb3f91c680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63967e76-ec68-47b4-bb9c-e0b7f0262227", "name": "network-vif-plugged", "status": "completed", "tag": "cfc19c1a-ea22-4416-9f28-df0bea28eaf8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:14.238305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-486f90e0-13ef-4f3f-9e83-2bd9b49d8750 req-41f31db6-3416-42ca-a2a8-fbb3f91c680c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.238747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-486f90e0-13ef-4f3f-9e83-2bd9b49d8750 req-41f31db6-3416-42ca-a2a8-fbb3f91c680c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.250325 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-486f90e0-13ef-4f3f-9e83-2bd9b49d8750 req-41f31db6-3416-42ca-a2a8-fbb3f91c680c service nova] Creating event network-vif-plugged:cfc19c1a-ea22-4416-9f28-df0bea28eaf8 for instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 on nch2-master-1 Apr 09 21:03:14.255723 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-486f90e0-13ef-4f3f-9e83-2bd9b49d8750 req-41f31db6-3416-42ca-a2a8-fbb3f91c680c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Apr 09 21:03:14.256330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1140/2337] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:14.262451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2094824135"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:14.263071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:14.269660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.270180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.270973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.271462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.669535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.network.security_group_api [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Adding security group f6e84827-57e9-4d49-91fa-e34ed07b1cf3 to port f1f5938f-d802-4ab4-9995-8b667eecc83f Apr 09 21:03:14.833148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Updating instance_info_cache with network_info: [{"id": "b9a7f79d-1d3a-4671-b464-16baee2a1102", "address": "fa:16:3e:c4:c6:3f", "network": {"id": "7baa1819-530e-4fe9-a0b0-1cedcf135c19", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1432232697-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd8c462cb0354f748ec4a7bfa561be3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9a7f79d-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:03:14.852472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Releasing lock "refresh_cache-ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" {{(pid=141818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 21:03:14.853856 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-555fb5d6-4e84-40a0-8983-5a01c110b05a tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action" status: 202 len: 0 microversion: 2.1 time: 5.508497 Apr 09 21:03:14.860544 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1198/2338] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:09 2022] POST /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6/action => generated 0 bytes in 5516 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 09 21:03:14.872683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:14.873472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:14.880018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.880549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:14.881458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:14.882129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.724514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:15.732312 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af7478a9-90c8-4995-a175-92624e0dc119 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1522 microversion: 2.1 time: 0.863984 Apr 09 21:03:15.732892 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1199/2339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:14 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1522 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:15.743900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '.version_select at 0x7fb08e465280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:15.745166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.745612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.746088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:15.754642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.755092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.755848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.756263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.780488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.781252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.797121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'flavor' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:15.812378 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0587eea-618e-41ea-a0fc-c362c2d64fc9 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags" status: 204 len: 0 microversion: 2.26 time: 0.078305 Apr 09 21:03:15.813022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1200/2340] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Apr 9 21:03:15 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:15.819190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:15.819802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:15.826004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.826452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:15.827413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:15.827628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.419260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4f70b3d-eee7-47ee-96f2-55ed483ae6b9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/action" status: 202 len: 0 microversion: 2.1 time: 2.161323 Apr 09 21:03:16.420235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1141/2341] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:14 2022] POST /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/action => generated 0 bytes in 2163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:16.431062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.431583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.452211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.452211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.452211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.452754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.478013 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] HTTP exception thrown: Instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 could not be found. Apr 09 21:03:16.478624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Returning 404 to user: Instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:16.479477 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b47573f-f714-4714-b273-d889e3492a93 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "DELETE /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 404 len: 111 microversion: 2.1 time: 0.054897 Apr 09 21:03:16.480049 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1142/2342] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:16 2022] DELETE /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:16.489423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.490048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.496410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.496862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.497685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.498124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.618175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:16.628467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b56ffcdb-8510-4093-9a08-39b30538d40c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.814355 Apr 09 21:03:16.629416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1201/2343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:15 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:16.634267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.634765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.641063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.641535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.642320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.642756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.668063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:16.757365 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-938c856c-bb98-4058-b9a2-6e5d91707395 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 204 len: 0 microversion: 2.1 time: 0.126262 Apr 09 21:03:16.763111 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1202/2344] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:16 2022] DELETE /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:16.768549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.769163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.775137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.775591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.776315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:16.776465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.776792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.784099 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f8bf993-ea77-4748-b7ab-761d06172818 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.299219 Apr 09 21:03:16.784928 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1143/2345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:16 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:16.789630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}, {"name": "network-changed", "server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:16.798708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.799075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.801668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:16.812017 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] Creating event network-changed:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:03:16.812615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] Creating event network-changed:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:03:16.819104 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-feae739c-c4a3-4f0c-8e5e-2e0e98220895 req-d6199276-6747-42ee-a087-73828adf20ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032905 Apr 09 21:03:16.819772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1144/2346] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:16.824763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9c92bda1-1f3a-4c8f-b869-d59516f11cf4 req-5e41ad0e-5233-46ce-adc1-341afb1ddb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63967e76-ec68-47b4-bb9c-e0b7f0262227", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc19c1a-ea22-4416-9f28-df0bea28eaf8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:16.832775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9c92bda1-1f3a-4c8f-b869-d59516f11cf4 req-5e41ad0e-5233-46ce-adc1-341afb1ddb0a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.833265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9c92bda1-1f3a-4c8f-b869-d59516f11cf4 req-5e41ad0e-5233-46ce-adc1-341afb1ddb0a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.846178 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9c92bda1-1f3a-4c8f-b869-d59516f11cf4 req-5e41ad0e-5233-46ce-adc1-341afb1ddb0a service nova] Creating event network-vif-unplugged:cfc19c1a-ea22-4416-9f28-df0bea28eaf8 for instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 on nch2-master-1 Apr 09 21:03:16.851005 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9c92bda1-1f3a-4c8f-b869-d59516f11cf4 req-5e41ad0e-5233-46ce-adc1-341afb1ddb0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029875 Apr 09 21:03:16.851615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1145/2347] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:16.856802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2033553948"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:16.857462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.863924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.864378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.865180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.865620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.884937 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8be90b68-28b4-48a9-9f2c-b20ac8503318 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 204 len: 0 microversion: 2.26 time: 0.120201 Apr 09 21:03:16.888887 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1203/2348] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:03:16 2022] DELETE /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:03:16.891037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.891741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: 98f1ce29-b2a9-4ecb-af40-e50a34dde574] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.897711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.898231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.899043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.899484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.913117 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] HTTP exception thrown: Instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 could not be found. Apr 09 21:03:16.913742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Returning 404 to user: Instance 98f1ce29-b2a9-4ecb-af40-e50a34dde574 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:16.914573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a2f974f-0a0a-40bc-a670-05eb365b400c tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574" status: 404 len: 111 microversion: 2.1 time: 0.027590 Apr 09 21:03:16.915112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1204/2349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:16 2022] GET /compute/v2.1/servers/98f1ce29-b2a9-4ecb-af40-e50a34dde574 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:16.919831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:16.920435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:16.926296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.926748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:16.927514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:16.927955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:17.019520 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.network.security_group_api [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Adding security group 9768a175-8f6f-4799-947c-2642b7b31792 to port f1f5938f-d802-4ab4-9995-8b667eecc83f Apr 09 21:03:17.151633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:17.160185 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-102f87e5-f7c3-48af-95c1-003afb18b3f7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1528 microversion: 2.1 time: 0.244075 Apr 09 21:03:17.160859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1205/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:16 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1528 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:17.165549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:17.166132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:17.172599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:17.173089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:17.173878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:17.174319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:17.389214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:17.399057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:17.400639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:17.401854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce40197a-ba7e-47cf-97bb-6565738eb38c tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1551 microversion: 2.26 time: 0.240061 Apr 09 21:03:17.403089 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1206/2351] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:03:17 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1551 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:03:17.415963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2704db01-a002-431a-89bf-bd853ab266f7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '.version_select at 0x7fb08e4ce790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:17.742460 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aaef9d47-513b-4e6f-b081-d7054fb91927 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/action" status: 202 len: 0 microversion: 2.1 time: 0.889594 Apr 09 21:03:17.743646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1146/2352] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:16 2022] POST /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:17.750138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:17.751021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:17.758517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:17.758987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:17.759783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:17.760237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:18.579296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:18.587629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5ff2514-4be4-4433-8f6d-6b46f6490520 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.841752 Apr 09 21:03:18.587629 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1147/2353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:17 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:18.592319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:18.592803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:18.599243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:18.599690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:18.600507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:18.600946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.036072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a063fe85-48df-4e2f-8fed-94e96f554e81 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.447333 Apr 09 21:03:19.046071 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1148/2354] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:03:18 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a/os-security-groups => generated 1156 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:19.051880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:19.052823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:19.059610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.060070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.060858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.061377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.251314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:19.259062 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e67fbddc-d03f-4e3b-8936-58a1de5437b3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.211577 Apr 09 21:03:19.259623 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1149/2355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:19 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:19.269795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:19.270841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:19.278264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.278824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.279575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.280017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.408457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2704db01-a002-431a-89bf-bd853ab266f7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/880f2b1c-2722-4096-99d1-b7dd90897d36" status: 202 len: 0 microversion: 2.1 time: 2.004053 Apr 09 21:03:19.409051 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1207/2356] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:03:17 2022] DELETE /compute/v2.1/os-floating-ips/880f2b1c-2722-4096-99d1-b7dd90897d36 => generated 0 bytes in 2005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:19.416954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:19.417583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:19.424717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.425193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.425967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.426398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.527665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:19.536456 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c7679b8-1dd9-45f5-b8e1-cea30f3c83aa tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1528 microversion: 2.1 time: 0.270756 Apr 09 21:03:19.537340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1150/2357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:19 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:19.552449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2b708a-25bb-4c08-9163-5dfa571dbf7d", "tag": "170bd20a-07a4-4369-8224-c4d2d705ad7c"}, {"name": "network-changed", "server_uuid": "34469266-eccb-4d9a-847a-455bffa2c78a", "tag": "f1f5938f-d802-4ab4-9995-8b667eecc83f"}, {"name": "network-changed", "server_uuid": "34469266-eccb-4d9a-847a-455bffa2c78a", "tag": "f1f5938f-d802-4ab4-9995-8b667eecc83f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:19.560177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.560622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.575318 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Creating event network-changed:170bd20a-07a4-4369-8224-c4d2d705ad7c for instance bd2b708a-25bb-4c08-9163-5dfa571dbf7d on nch1-master-1 Apr 09 21:03:19.575843 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Creating event network-changed:f1f5938f-d802-4ab4-9995-8b667eecc83f for instance 34469266-eccb-4d9a-847a-455bffa2c78a on nch1-master-1 Apr 09 21:03:19.576357 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] Creating event network-changed:f1f5938f-d802-4ab4-9995-8b667eecc83f for instance 34469266-eccb-4d9a-847a-455bffa2c78a on nch1-master-1 Apr 09 21:03:19.584154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e6f935d4-fae6-4d0f-a5bc-887950eae698 req-11b6e0e9-c1c2-49ae-84d6-05e03e2b2005 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.036773 Apr 09 21:03:19.584998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1151/2358] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:19.590236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5c8d6a64-38e5-40de-bedf-e3ba0ec8d91c req-7ebb8948-17c2-46b5-97fd-71ec849bf275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c778043-533a-46e6-904e-6149ad1af0a9", "name": "network-vif-plugged", "status": "completed", "tag": "926e2550-7b2a-4e9a-947e-f80f6f5bcf9d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:19.598832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c8d6a64-38e5-40de-bedf-e3ba0ec8d91c req-7ebb8948-17c2-46b5-97fd-71ec849bf275 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.599270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c8d6a64-38e5-40de-bedf-e3ba0ec8d91c req-7ebb8948-17c2-46b5-97fd-71ec849bf275 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.610522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5c8d6a64-38e5-40de-bedf-e3ba0ec8d91c req-7ebb8948-17c2-46b5-97fd-71ec849bf275 service nova] Creating event network-vif-plugged:926e2550-7b2a-4e9a-947e-f80f6f5bcf9d for instance 6c778043-533a-46e6-904e-6149ad1af0a9 on nch2-master-1 Apr 09 21:03:19.620639 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5c8d6a64-38e5-40de-bedf-e3ba0ec8d91c req-7ebb8948-17c2-46b5-97fd-71ec849bf275 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Apr 09 21:03:19.620639 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1152/2359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:19.625462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b1f18f30-71cc-4f37-8e7d-bfb7c750a8b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb098486670>, body: {"security_group": {"name": " tempest-securitygroup -232475860 ", "description": "tempest-description-1318015064"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:19.665063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:19.673265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:19.674777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:19.675965 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07c41797-54c6-42e1-853b-32c9e2989229 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1551 microversion: 2.26 time: 0.263090 Apr 09 21:03:19.676525 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1208/2360] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:03:19 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1551 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:03:19.681050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:19.681607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:19.688562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.689340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.690311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.690764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.716865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:19.806686 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e824adee-4447-4948-8500-7ab8195ed994 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 204 len: 0 microversion: 2.1 time: 0.128783 Apr 09 21:03:19.807592 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1209/2361] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:19 2022] DELETE /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:19.814359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:19.815145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:19.824755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.825499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:19.826572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:19.827180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.062529 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b1f18f30-71cc-4f37-8e7d-bfb7c750a8b7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.442842 Apr 09 21:03:20.068343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1153/2362] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:19 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:20.073876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.074881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:20.082379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.082517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.083302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.084076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.264566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:20.273717 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-27c07d61-cd39-4000-a035-2ddc6b37a7c0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.464496 Apr 09 21:03:20.274740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1210/2363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:19 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:20.279968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80a9a57a-f0ec-458f-a14f-504d8cac3cab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08f450940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.385578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:20.398980 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-258ef0d3-c530-4972-a3e6-9dc7bf687ab9 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1526 microversion: 2.1 time: 0.327118 Apr 09 21:03:20.401889 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1154/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1526 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:20.410044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.410898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:20.418681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.419407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.420407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.421168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.462122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80a9a57a-f0ec-458f-a14f-504d8cac3cab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef" status: 200 len: 223 microversion: 2.1 time: 0.185613 Apr 09 21:03:20.462122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1211/2365] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef => generated 223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:20.473311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1badab60-8af3-49b0-afcf-9aa1f25ee35f req-1c04d7d6-b582-49da-af1f-520f6f6c04d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa96a6a-ad9e-4764-b6d8-591508c71bf9", "name": "network-vif-deleted", "tag": "b398b476-f8f8-407d-a3f3-11da1ed049c7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:20.488683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1badab60-8af3-49b0-afcf-9aa1f25ee35f req-1c04d7d6-b582-49da-af1f-520f6f6c04d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.489404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1badab60-8af3-49b0-afcf-9aa1f25ee35f req-1c04d7d6-b582-49da-af1f-520f6f6c04d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.502234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1badab60-8af3-49b0-afcf-9aa1f25ee35f req-1c04d7d6-b582-49da-af1f-520f6f6c04d3 service nova] Creating event network-vif-deleted:b398b476-f8f8-407d-a3f3-11da1ed049c7 for instance 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 on nch2-master-1 Apr 09 21:03:20.508439 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1badab60-8af3-49b0-afcf-9aa1f25ee35f req-1c04d7d6-b582-49da-af1f-520f6f6c04d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044684 Apr 09 21:03:20.510226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1212/2366] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:20.517606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c30ff00-acf8-4310-b743-773d0c3d6fec tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08f450940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.758300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:20.767156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4efd30ff-e02c-4885-8fd8-02d9c854fe4e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1319 microversion: 2.1 time: 0.363962 Apr 09 21:03:20.767743 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1155/2367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:20.776650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.776650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:20.779103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.779556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.780329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.780810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.864798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:20.876616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f0815bd-1169-4dd3-91a0-2182ff356030 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 200 len: 1486 microversion: 2.1 time: 0.107811 Apr 09 21:03:20.878448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1156/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 1486 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:20.883892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.884738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:20.891662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.892542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.893442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.894564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.894728 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c30ff00-acf8-4310-b743-773d0c3d6fec tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef" status: 202 len: 0 microversion: 2.1 time: 0.382759 Apr 09 21:03:20.895270 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1213/2369] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:03:20 2022] DELETE /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:20.903822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08e449af0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:20.940629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:20.941405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group 4566481b-917f-4c12-ae7e-f36e1973d7ef not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:03:20.942173 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist Apr 09 21:03:20.942173 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-3e0a2699-3ace-40d7-83ce-a311980d7c64'] Apr 09 21:03:20.942816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist Apr 09 21:03:20.942816 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-3e0a2699-3ace-40d7-83ce-a311980d7c64'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:20.943817 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2df01e07-b5f6-4cd5-923c-738a47a37936 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef" status: 404 len: 194 microversion: 2.1 time: 0.043899 Apr 09 21:03:20.944472 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1214/2370] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:03:20.944643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:20.945080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:20.945541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lazy-loading 'fault' on Instance uuid 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:20.954655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fe61b07-6d7c-479d-8eee-ddf4d1719bac tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb0984964c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-73512157", "description": "tempest-description-1332336258"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:21.008661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:21.024875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:21.027044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57553270540e4163aad06138d03f9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0bf14b8dad4360adb4727282b63237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:21.028674 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dc0c184-9343-4f77-81b0-ca73534c5564 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 200 len: 1351 microversion: 2.26 time: 0.148292 Apr 09 21:03:21.029628 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1157/2371] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:03:20 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:03:21.291843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:21.293873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:21.302108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.302495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.303494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.305391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.345343 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fe61b07-6d7c-479d-8eee-ddf4d1719bac tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.395116 Apr 09 21:03:21.349137 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1215/2372] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:20 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:03:21.358327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2a7021b-24e4-445d-87ca-12f0cd395a1c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb08e449700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-214528913", "description": "tempest-description-1109327557"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:21.675679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:21.696079 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0107731c-08f7-47e0-b508-7ecd6325d0e4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.408298 Apr 09 21:03:21.709809 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1158/2373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:21 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:21.717002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:21.721638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:21.729527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.730302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.731069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.734346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.864143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ddff4ad7c4ef1b382b760918d6054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8c462cb0354f748ec4a7bfa561be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:21.874331 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-759552c2-b79f-471a-9278-deb5ba4027c7 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 200 len: 1484 microversion: 2.1 time: 0.162006 Apr 09 21:03:21.888449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1159/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:21 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 1484 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:21.893992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2f4e91-7e66-48aa-a017-1fd991c6fa19"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:21.904276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:21.920454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.921195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.922171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.922798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.934280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2a7021b-24e4-445d-87ca-12f0cd395a1c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.579767 Apr 09 21:03:21.935465 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1216/2375] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:03:21.940245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1b97f0a4-d70e-4bca-a35d-61259f42b171 req-677468ee-55f8-4773-8242-4f960f2a1364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63967e76-ec68-47b4-bb9c-e0b7f0262227", "name": "network-vif-deleted", "tag": "cfc19c1a-ea22-4416-9f28-df0bea28eaf8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:21.961467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1b97f0a4-d70e-4bca-a35d-61259f42b171 req-677468ee-55f8-4773-8242-4f960f2a1364 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:21.961943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1b97f0a4-d70e-4bca-a35d-61259f42b171 req-677468ee-55f8-4773-8242-4f960f2a1364 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:21.993650 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1b97f0a4-d70e-4bca-a35d-61259f42b171 req-677468ee-55f8-4773-8242-4f960f2a1364 service nova] Creating event network-vif-deleted:cfc19c1a-ea22-4416-9f28-df0bea28eaf8 for instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 on nch2-master-1 Apr 09 21:03:22.005963 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1b97f0a4-d70e-4bca-a35d-61259f42b171 req-677468ee-55f8-4773-8242-4f960f2a1364 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068209 Apr 09 21:03:22.007615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1217/2376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:22.013070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:22.021984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:22.030428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.031968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.037241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.037942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.274792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:22.284537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9626af77-95b7-484f-b0ec-4dcd68e308ea tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "POST /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394040 Apr 09 21:03:22.285968 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-36aebbd0-a2fa-44e7-bd0b-39d76634c9cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1469 microversion: 2.1 time: 0.276665 Apr 09 21:03:22.290716 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1160/2377] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:03:21 2022] POST /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:22.293848 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1218/2378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:22 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:22.297949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:22.299260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:22.301853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4d0a6240-472d-4ba9-b1d1-d886cde16aa5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb098496040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2083598051", "description": "tempest-description-263768357"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:22.311343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.312156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.314273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.316420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.335423 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. Apr 09 21:03:22.336383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:22.338072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36013780-4a2e-4d6f-8841-e8707a00149a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 404 len: 111 microversion: 2.1 time: 0.045805 Apr 09 21:03:22.339023 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1161/2379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:22 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:22.369542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:22.371241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] [instance: 7aa96a6a-ad9e-4764-b6d8-591508c71bf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:22.400077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.403029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.410057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.415197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.459805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] HTTP exception thrown: Instance 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 could not be found. Apr 09 21:03:22.460837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] Returning 404 to user: Instance 7aa96a6a-ad9e-4764-b6d8-591508c71bf9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:22.462895 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21f59fee-032e-44a9-b7bf-e3269bcfc303 tempest-ServerTagsTestJSON-580460456 tempest-ServerTagsTestJSON-580460456-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9" status: 404 len: 111 microversion: 2.26 time: 0.122405 Apr 09 21:03:22.464712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1162/2380] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:03:22 2022] GET /compute/v2.1/servers/7aa96a6a-ad9e-4764-b6d8-591508c71bf9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:03:22.672302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1049268213", "block_migration": true, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:22.676111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:22.683473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.684097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.684964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:22.685948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:22.730796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lazy-loading 'flavor' on Instance uuid 6c778043-533a-46e6-904e-6149ad1af0a9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:22.747575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Going to try to live migrate instance to tempest-host-1049268213 {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 21:03:22.755590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] HTTP exception thrown: Compute host tempest-host-1049268213 could not be found. Apr 09 21:03:22.756212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Returning 400 to user: Compute host tempest-host-1049268213 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:22.757661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f10ad99-1547-4663-959f-22aa6acebeec tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9/action" status: 400 len: 100 microversion: 2.1 time: 0.291491 Apr 09 21:03:22.758891 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1163/2381] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Apr 9 21:03:22 2022] POST /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9/action => generated 100 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:03:22.763965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'create', calling method: .version_select at 0x7fb098477430>, body: {"keypair": {"name": "tempest-keypair-1042255887"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:22.785934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:22.812448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for user f6869f687bd8411ea81a24f566fef6b2 and project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:23.320909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:23.325922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for user f6869f687bd8411ea81a24f566fef6b2 and project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:23.342584 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2aa4b920-b1c5-443a-843b-8d0eb78fe488 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.582075 Apr 09 21:03:23.349253 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1164/2382] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:03:22 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:23.357801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3760b9b8-ce6c-4005-8705-bfe60bbece33 req-3d55f71c-8a93-45ff-83f5-1cd3a9bb3e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6", "name": "network-vif-deleted", "tag": "b9a7f79d-1d3a-4671-b464-16baee2a1102"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:23.374500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3760b9b8-ce6c-4005-8705-bfe60bbece33 req-3d55f71c-8a93-45ff-83f5-1cd3a9bb3e4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.375073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3760b9b8-ce6c-4005-8705-bfe60bbece33 req-3d55f71c-8a93-45ff-83f5-1cd3a9bb3e4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.383290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4d0a6240-472d-4ba9-b1d1-d886cde16aa5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.087826 Apr 09 21:03:23.384985 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1219/2383] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:23.394702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-33e517fe-2493-4095-9c7d-4ddfea344d9d req-328df6ad-8c4c-4150-aeea-11a49e4dedb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-plugged", "status": "completed", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:23.396280 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3760b9b8-ce6c-4005-8705-bfe60bbece33 req-3d55f71c-8a93-45ff-83f5-1cd3a9bb3e4a service nova] Creating event network-vif-deleted:b9a7f79d-1d3a-4671-b464-16baee2a1102 for instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 on nch1-master-1 Apr 09 21:03:23.401873 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3760b9b8-ce6c-4005-8705-bfe60bbece33 req-3d55f71c-8a93-45ff-83f5-1cd3a9bb3e4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056567 Apr 09 21:03:23.402734 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1165/2384] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:23.415908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-33e517fe-2493-4095-9c7d-4ddfea344d9d req-328df6ad-8c4c-4150-aeea-11a49e4dedb0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.423491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-33e517fe-2493-4095-9c7d-4ddfea344d9d req-328df6ad-8c4c-4150-aeea-11a49e4dedb0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.428703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:23.429638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:23.438421 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-33e517fe-2493-4095-9c7d-4ddfea344d9d req-328df6ad-8c4c-4150-aeea-11a49e4dedb0 service nova] Creating event network-vif-plugged:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:03:23.443663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.443663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.445713 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-33e517fe-2493-4095-9c7d-4ddfea344d9d req-328df6ad-8c4c-4150-aeea-11a49e4dedb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059098 Apr 09 21:03:23.447423 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1220/2385] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:23.450761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.450895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.455017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:23.456689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:23.464311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.465208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.466311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:23.467255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:23.969150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:23.971433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:23.980810 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6032a7af-25ea-47b7-8c0f-17a582e3619c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.568619 Apr 09 21:03:23.989737 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1166/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:23 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:23.991881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:23.993368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] [instance: ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:24.000586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:24.001927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:24.002913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:24.003905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b9e41495-3a9e-4311-85df-c019c6d55f32 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1469 microversion: 2.1 time: 0.551507 Apr 09 21:03:24.004166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:24.013643 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1221/2387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:23 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1469 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:24.026683 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] HTTP exception thrown: Instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 could not be found. Apr 09 21:03:24.028344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] Returning 404 to user: Instance ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:24.029904 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-941aba04-e319-4750-b3bd-9d42a11dfc62 tempest-FloatingIPsAssociationTestJSON-905993333 tempest-FloatingIPsAssociationTestJSON-905993333-project] 10.222.0.30 "GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6" status: 404 len: 111 microversion: 2.1 time: 0.042527 Apr 09 21:03:24.033318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1167/2388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:23 2022] GET /compute/v2.1/servers/ad5a2c94-2544-4cfe-8f64-e2dea6a6fcf6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:24.038480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45b23cb5-886e-4578-b0ed-af77cb972491 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb098494820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:24.163406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1379178028", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:24.244277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:24.857998 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45b23cb5-886e-4578-b0ed-af77cb972491 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.842082 Apr 09 21:03:24.860314 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1222/2389] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 21:03:24 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:24.872926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db925344-d974-451b-be0a-bda0d330ab3e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08e4ce700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:24.875928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:24.876948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:24.877799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:24.878624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:24.879209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:24.890065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:24.890758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:24.891794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:24.892432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:24.911428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Getting quotas for project ab5f53583b7444188c705ed472c3cf06. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:24.917817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Getting quotas for user 35025c6fdf024e8ea7d8d53db1a3974c and project ab5f53583b7444188c705ed472c3cf06. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:24.936518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:24.939142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:24.995649 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-578f1165-bc98-42fe-8015-9b445dda9231 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836478 Apr 09 21:03:25.005404 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1168/2390] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:03:25.009524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:25.010471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:25.019974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:25.020679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:25.022240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:25.022985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:25.439539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:25.472436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4eba4c84-03c9-4d55-bcd0-ab308128faa2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.469349 Apr 09 21:03:25.474364 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1169/2391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:25 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:25.487760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db925344-d974-451b-be0a-bda0d330ab3e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571" status: 202 len: 0 microversion: 2.1 time: 0.619334 Apr 09 21:03:25.488565 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1223/2392] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:03:24 2022] DELETE /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:03:25.494257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1575898933", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:25.494572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1a8606c-705d-4e83-bfd7-78862f62df94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:25.495392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1a8606c-705d-4e83-bfd7-78862f62df94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:25.585778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] validate_networks() for [('2acdcdfe-c4fc-46e9-aafe-ac2fc5194554', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:25.684576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f1a8606c-705d-4e83-bfd7-78862f62df94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:25.693204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1a8606c-705d-4e83-bfd7-78862f62df94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1219 microversion: 2.1 time: 0.217740 Apr 09 21:03:25.696914 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1170/2393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:25 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1219 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:25.701956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4ac548eb-c354-4fb0-9139-bb74331c3eba req-ba9a83de-91db-40d9-bf99-5a31ccdab665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b708a-25bb-4c08-9163-5dfa571dbf7d", "name": "network-vif-plugged", "status": "completed", "tag": "170bd20a-07a4-4369-8224-c4d2d705ad7c"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:25.713884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4ac548eb-c354-4fb0-9139-bb74331c3eba req-ba9a83de-91db-40d9-bf99-5a31ccdab665 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:25.714710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4ac548eb-c354-4fb0-9139-bb74331c3eba req-ba9a83de-91db-40d9-bf99-5a31ccdab665 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:25.727978 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4ac548eb-c354-4fb0-9139-bb74331c3eba req-ba9a83de-91db-40d9-bf99-5a31ccdab665 service nova] Creating event network-vif-plugged:170bd20a-07a4-4369-8224-c4d2d705ad7c for instance bd2b708a-25bb-4c08-9163-5dfa571dbf7d on nch1-master-1 Apr 09 21:03:25.734650 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4ac548eb-c354-4fb0-9139-bb74331c3eba req-ba9a83de-91db-40d9-bf99-5a31ccdab665 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Apr 09 21:03:25.735307 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1171/2394] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:25.743288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb098477af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:25.887614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:25.888863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:03:25.889602 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist Apr 09 21:03:25.889602 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-b970a13a-cd5f-40c8-917f-2ff181ed1fee'] Apr 09 21:03:25.890669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist Apr 09 21:03:25.890669 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-b970a13a-cd5f-40c8-917f-2ff181ed1fee'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:25.891770 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-203f2040-3d30-4bc5-97a9-f242de031e80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571" status: 404 len: 194 microversion: 2.1 time: 0.155314 Apr 09 21:03:25.892827 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1172/2395] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:03:25 2022] GET /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:25.900933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-04c19ec3-1c55-4c3a-8576-27563f872622 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb0984863a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:27.117369 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-04c19ec3-1c55-4c3a-8576-27563f872622 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3" status: 202 len: 0 microversion: 2.1 time: 1.220154 Apr 09 21:03:27.117993 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1173/2396] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:03:25 2022] DELETE /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3 => generated 0 bytes in 1222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:03:27.123863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:27.124925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:27.131691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.132192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.133021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.133497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.145019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:27.145553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:27.146140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:27.146551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:27.146962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:27.156685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.157275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.158090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.158522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.166270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-821becad-8a5d-4522-be95-e5b335f9d7f0 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Apr 09 21:03:27.171645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1174/2397] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:03:27 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:27.179103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:27.201420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for user f6869f687bd8411ea81a24f566fef6b2 and project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:27.215087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:27.217433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:27.270949 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59866557-225d-4a43-8808-1f4561340bca tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.781078 Apr 09 21:03:27.273973 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1224/2398] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:27.279562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:27.280455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:27.288735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.289366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.290290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.290722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.347222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1559898704", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:27.415327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:27.803241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:27.824396 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb7a3030-9ff9-44a7-8295-6bbaa1cdf162 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1314 microversion: 2.1 time: 0.548908 Apr 09 21:03:27.824988 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1225/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:27 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:27.836948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:27.837545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:27.853147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.853705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.854611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:27.855060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:27.981507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:27.990813 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-242d05de-9586-427d-aba3-672a6f8e97f8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1277 microversion: 2.1 time: 0.164770 Apr 09 21:03:27.992132 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1226/2400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:27 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:27.999388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08e465a60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.088797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbc01e51-006e-4334-899d-154794431da3 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:28.089377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group fbc01e51-006e-4334-899d-154794431da3 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:03:28.089913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group fbc01e51-006e-4334-899d-154794431da3 does not exist Apr 09 21:03:28.089913 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-83caf2e3-be63-4370-92cb-38fb58331718'] Apr 09 21:03:28.090643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group fbc01e51-006e-4334-899d-154794431da3 does not exist Apr 09 21:03:28.090643 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-83caf2e3-be63-4370-92cb-38fb58331718'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:28.091499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-abbdb0df-736b-409b-ae7e-2361a294594b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3" status: 404 len: 194 microversion: 2.1 time: 0.098142 Apr 09 21:03:28.092036 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1227/2401] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:03:27 2022] GET /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:28.097960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.098571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:28.106114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.106583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.107332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.107972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.188568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lazy-loading 'services' on Instance uuid 38771bd6-54dc-448e-9f9e-be97fabb46b6 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:28.264119 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments/ca2f4e91-7e66-48aa-a017-1fd991c6fa19" status: 202 len: 0 microversion: 2.1 time: 0.170197 Apr 09 21:03:28.264840 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1228/2402] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:03:28 2022] DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments/ca2f4e91-7e66-48aa-a017-1fd991c6fa19 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:28.275514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.276855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:28.289063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.289816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.291643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.292413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.435559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:28.452152 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-111a5725-f44d-4f75-88d2-9c33d6f684a9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1277 microversion: 2.1 time: 0.182476 Apr 09 21:03:28.454165 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1229/2403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:28 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:28.460134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9591dc16-4376-4ad9-b3a5-aa8a691b249c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08eb6a820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.466479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:28.467823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:28.468942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:28.469829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:28.470917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:28.481584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.482190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.483008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.483453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.508474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:28.513722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:28.527722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:28.530198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:28.596703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70547663-6fba-47c8-8cc1-edb6a63da2fe tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428227 Apr 09 21:03:28.597772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1175/2404] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:28.611159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-364d771b-9099-4fc1-80c5-865ded0309e9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.611783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-364d771b-9099-4fc1-80c5-865ded0309e9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:28.767461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-364d771b-9099-4fc1-80c5-865ded0309e9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:28.778497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-364d771b-9099-4fc1-80c5-865ded0309e9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1193 microversion: 2.1 time: 0.171354 Apr 09 21:03:28.779894 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1176/2405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:28 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:28.841619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:28.842479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:28.855137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.855591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:28.856726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:28.861265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.654272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:29.668640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3b516c29-690d-4463-bfd3-ff72b0695675 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1464 microversion: 2.1 time: 0.830814 Apr 09 21:03:29.670223 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1177/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:28 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1464 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:29.675791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:29.676987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:29.685892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.686787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.688356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.688977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.758457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9591dc16-4376-4ad9-b3a5-aa8a691b249c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31" status: 202 len: 0 microversion: 2.1 time: 1.302932 Apr 09 21:03:29.760393 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1230/2407] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:03:28 2022] DELETE /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31 => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:29.771544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:29.773020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:29.785991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.790561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.791766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.792278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.930310 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-710b5367-77e2-4f72-8ffe-8d004dbb648a tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164009 Apr 09 21:03:29.930728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:29.931435 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1231/2408] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:03:29 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:29.939734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:29.940532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:29.943639 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-125b8bb0-293b-40f7-990a-531733d96af2 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.272082 Apr 09 21:03:29.950592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1178/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:29 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:29.952469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.957875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:29.958220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.959315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.960054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.962606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:29.979471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.979930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:29.980724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:29.981193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:30.382112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:30.390957 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c75183da-430b-4cf6-bc28-2a9471e8f06d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1462 microversion: 2.1 time: 0.438872 Apr 09 21:03:30.395475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:30.401003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1179/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:29 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1462 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:30.413509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b16da5c-9279-4cba-bbf0-cd6219a27d4a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.479999 Apr 09 21:03:30.414910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08e64e430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:30.417746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1232/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:29 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:30.428774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:30.430106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:30.444814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:30.446015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:30.456133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:30.457129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:30.504918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:30.505594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group efa7071b-5efa-4434-8df3-31d4e348ec31 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:03:30.506570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist Apr 09 21:03:30.506570 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-fc817f96-03b5-4b7a-a357-c3203625f92b'] Apr 09 21:03:30.507215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist Apr 09 21:03:30.507215 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-fc817f96-03b5-4b7a-a357-c3203625f92b'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:30.508491 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-acdcf4ca-87ed-4fca-a5e3-4a792c2fbbfd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31" status: 404 len: 194 microversion: 2.1 time: 0.105989 Apr 09 21:03:30.509080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1180/2412] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:03:30 2022] GET /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:30.516100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:30.518505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:30.539187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:30.539774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:30.541659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:30.542104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:30.595794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:30.598256 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5cc0637f-9d8a-4ace-ae78-501c8c8d845d tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086645 Apr 09 21:03:30.600205 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1181/2413] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:03:30 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:30.607095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-82697e74-f692-4161-987b-698f3311af76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1251 microversion: 2.1 time: 0.185671 Apr 09 21:03:30.607533 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1233/2414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:30 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1251 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:30.614488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-588481861", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9a922650-a7ae-40a9-ba61-a2f388b0e621"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:30.618480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-be58be7c-6fa8-4f2f-88a3-8fd939c05764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb09847dca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:30.717853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:31.119956 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-be58be7c-6fa8-4f2f-88a3-8fd939c05764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.518467 Apr 09 21:03:31.121649 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1182/2415] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 21:03:30 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:31.132837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:31.133702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:31.147594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.148064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.148887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.149391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.179839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:31.204952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:31.205851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:31.206508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:31.206924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:31.207340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:31.236571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.237403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.238694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.239128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.307543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:31.321951 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d2aadfd-35ab-4797-ae78-e5002a57a8be tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 204 len: 0 microversion: 2.1 time: 0.196996 Apr 09 21:03:31.323022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Getting quotas for user 3d1c24bc22654cab94bc0b7b8e271c7e and project 54a9d66010e4404c82a529dd4bd18c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:31.326253 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1183/2416] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:31 2022] DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:31.341475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:31.342267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:31.360379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.363132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.364620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.365296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.374552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:31.385024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:31.512175 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ff4d7ba-a5c7-487b-93ff-0119e0550c7d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902574 Apr 09 21:03:31.513778 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1234/2417] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:31.526732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4b60cd44-37ed-4159-9d79-dd4864d80dec req-3863c7b9-9185-4ec7-8152-ae367054bced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98c800d-6d97-4a1e-ae07-0b67613b3b9a", "tag": "9b504e32-7c87-466e-9a26-d68a37240534"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:31.543078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4b60cd44-37ed-4159-9d79-dd4864d80dec req-3863c7b9-9185-4ec7-8152-ae367054bced service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.543753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4b60cd44-37ed-4159-9d79-dd4864d80dec req-3863c7b9-9185-4ec7-8152-ae367054bced service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.563437 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4b60cd44-37ed-4159-9d79-dd4864d80dec req-3863c7b9-9185-4ec7-8152-ae367054bced service nova] Creating event network-changed:9b504e32-7c87-466e-9a26-d68a37240534 for instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a on nch2-master-1 Apr 09 21:03:31.569876 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4b60cd44-37ed-4159-9d79-dd4864d80dec req-3863c7b9-9185-4ec7-8152-ae367054bced service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054466 Apr 09 21:03:31.571054 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1235/2418] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:31.580489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2b75c4e-e6ef-48f9-98f5-db0c9273830e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb0984a88b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-235718788", "description": "tempest-description-521252194"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:31.719100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:31.735963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c7a7b503-b91b-47f1-97a1-32cd6d3556cb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.408215 Apr 09 21:03:31.736829 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1184/2419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:31 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:31.741742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:31.742639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:31.749028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.749740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:31.750709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:31.751310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.020945 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2b75c4e-e6ef-48f9-98f5-db0c9273830e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.445534 Apr 09 21:03:32.029097 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1236/2420] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:32.034630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:32.035464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:32.036794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:32.055969 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba783e96-1e83-4357-a9a4-ba954d08da71 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1683 microversion: 2.1 time: 0.312050 Apr 09 21:03:32.060289 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1185/2421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:31 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1683 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:32.065452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:32.066070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:32.067070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.067633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.069091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.069091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.072281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.072724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.073735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.074341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.166206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:32.174958 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee8ea421-1080-43e5-8f44-f315ea38abbc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1217 microversion: 2.1 time: 0.113317 Apr 09 21:03:32.175559 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1186/2422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:32 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:32.189832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:32.190681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:32.198359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.198818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.199618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.200063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.294900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:32.303329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4305bff5-741b-4f81-81d5-7265dee9cc46 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.272847 Apr 09 21:03:32.304859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1237/2423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:32 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:32.317539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5eaa6aa-3425-4163-b485-5a06cfe3c075 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb08f61db80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1567399253", "description": "tempest-description-466128858"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:32.457747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:32.467154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ec84715-f7df-4e6c-a430-37550fabfb94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.281162 Apr 09 21:03:32.468310 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1187/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:32 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:32.474773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-faba432d-74aa-4ce7-918e-82ba3c482cd5 req-5f556fdf-4347-4c91-ae6d-853cf838d656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f667511c-c0e4-4a11-8440-927a5977f82e", "tag": "4b939184-9908-4fe1-b2fd-2da6cdaa8901"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:32.483586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-faba432d-74aa-4ce7-918e-82ba3c482cd5 req-5f556fdf-4347-4c91-ae6d-853cf838d656 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.484017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-faba432d-74aa-4ce7-918e-82ba3c482cd5 req-5f556fdf-4347-4c91-ae6d-853cf838d656 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.499886 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-faba432d-74aa-4ce7-918e-82ba3c482cd5 req-5f556fdf-4347-4c91-ae6d-853cf838d656 service nova] Creating event network-changed:4b939184-9908-4fe1-b2fd-2da6cdaa8901 for instance f667511c-c0e4-4a11-8440-927a5977f82e on nch2-master-1 Apr 09 21:03:32.506715 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-faba432d-74aa-4ce7-918e-82ba3c482cd5 req-5f556fdf-4347-4c91-ae6d-853cf838d656 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036233 Apr 09 21:03:32.507767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1188/2425] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:32.699629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5eaa6aa-3425-4163-b485-5a06cfe3c075 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.393407 Apr 09 21:03:32.700322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1238/2426] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:03:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:32.753546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:32.754318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:32.765057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.765650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.766445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:32.766882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:32.842508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1759661077", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "2862fa2b-3134-4de1-bedd-a2bf3828b8ca"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:32.916683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] validate_networks() for [('2862fa2b-3134-4de1-bedd-a2bf3828b8ca', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:33.229858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:33.240343 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90e3df7e-3829-4bbf-ac8f-9b0656261654 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.491492 Apr 09 21:03:33.251271 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1189/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:32 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:33.256318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:33.257157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:33.278045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:33.280549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:33.286196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:33.286942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:33.859722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:33.869611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1708c50d-4902-476b-90fa-56233572ba81 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1683 microversion: 2.1 time: 0.617105 Apr 09 21:03:33.870939 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1190/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:33 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1683 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:33.877005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:33.879123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:33.893243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:33.893548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:33.897611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:33.898545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.067584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:34.076507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c200931a-fd59-47ed-af5e-2c6e8451a583 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1271 microversion: 2.1 time: 0.203141 Apr 09 21:03:34.077131 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1191/2429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:33 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:34.091372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:34.099602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:34.121291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.126180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.129637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.130503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.360411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:34.361685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:34.362187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:34.362658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:34.363020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:34.372459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.373374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.374477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.375139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.394061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Getting quotas for project bc7a2d61df2b4bfda6882e74e73b6cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:34.399739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Getting quotas for user fbcb9088698a4f478ccebca7a65f54c4 and project bc7a2d61df2b4bfda6882e74e73b6cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:34.414926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:34.418059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:34.473201 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8955b010-c4db-4f25-b469-061fdfccb9e5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635669 Apr 09 21:03:34.480264 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1239/2430] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:03:34.486010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:34.486992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:34.499620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.501628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:34.503271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:34.503912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.154660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:35.168223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99ddf83f-c893-4f90-baff-8e2cd3481fa2 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 1.080659 Apr 09 21:03:35.169535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1192/2431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:34 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:35.177841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:35.178783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:35.186812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.187765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.188991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.189838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.463036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:35.483256 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b48d968-79ff-4b6c-8b9a-7e0f3a751e73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 1.001240 Apr 09 21:03:35.484745 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1240/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:34 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:35.492471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:35.494202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:35.509267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.509766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.510644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.510956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.721407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:35.738016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-21f390e4-81d5-4a5e-b9a7-53126f705764 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1268 microversion: 2.1 time: 0.251016 Apr 09 21:03:35.738949 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1241/2433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:35 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:35.753351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:35.756652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:35.774930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.775402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.776299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.776731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.817855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:35.830833 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ffb0d410-c7d1-4d77-a263-ba3ccd627102 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.658978 Apr 09 21:03:35.831831 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1193/2434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:35 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:35.837620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:35.838533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:35.848042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.848888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:35.850795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:35.852008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.100688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:36.114943 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63340fff-28d1-4347-b0eb-ab0195197c02 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1271 microversion: 2.1 time: 0.277407 Apr 09 21:03:36.116951 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1194/2435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:35 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:36.132887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-0e8eff55-b25c-4742-8ce5-a2b197a1709c req-451f2d8f-db72-4716-b52f-f57093973fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce0e76e-bbf7-44e1-86c4-9d078813ff72", "tag": "d9131337-3f4d-44a3-aa06-6245dff9187e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:36.133154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:36.151105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0e8eff55-b25c-4742-8ce5-a2b197a1709c req-451f2d8f-db72-4716-b52f-f57093973fdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.151898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0e8eff55-b25c-4742-8ce5-a2b197a1709c req-451f2d8f-db72-4716-b52f-f57093973fdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.165126 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0269e9c4-be5a-42a9-bcd6-b32bd52a509f tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1616 microversion: 2.1 time: 0.413265 Apr 09 21:03:36.172017 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1242/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:35 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1616 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:36.190396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:36.192319 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-0e8eff55-b25c-4742-8ce5-a2b197a1709c req-451f2d8f-db72-4716-b52f-f57093973fdb service nova] Creating event network-changed:d9131337-3f4d-44a3-aa06-6245dff9187e for instance bce0e76e-bbf7-44e1-86c4-9d078813ff72 on nch2-master-1 Apr 09 21:03:36.195419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:36.201511 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-0e8eff55-b25c-4742-8ce5-a2b197a1709c req-451f2d8f-db72-4716-b52f-f57093973fdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080899 Apr 09 21:03:36.203126 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1195/2437] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:36.209689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.210542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.211661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.212310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.503037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:36.503918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:36.517586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.518071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.519038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.519523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.658842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:36.677572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f43fce8-a6de-441e-ae34-5b83897e5ec1 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.494793 Apr 09 21:03:36.691500 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1243/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:36 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:36.761456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:36.762539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:36.776547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.777789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:36.778890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:36.779543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.000235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:37.030330 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1688234-bda3-43fb-9395-7c9a6fdcea80 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1274 microversion: 2.1 time: 0.274257 Apr 09 21:03:37.032836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1244/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:36 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:37.039319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:37.040227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:37.048417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.049388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.050630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.051274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.119525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:37.139538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d57e5d3c-fff1-48cb-b064-85610484d041 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.641013 Apr 09 21:03:37.140121 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1196/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:36 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:37.154052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:37.154677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:37.171051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.171513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.172478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.172816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.663221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:37.669284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:37.679985 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ff5406c-a84d-4b8b-8b77-92c1516ed3d4 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.645659 Apr 09 21:03:37.681974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4f34743-70f4-49da-8833-62b599c847a0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.531804 Apr 09 21:03:37.683515 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1245/2441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:37 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:37.690404 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1197/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:37 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:37.692614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:37.695854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:37.701870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9a654259-37d2-4d00-9776-0c02c213408d req-df567440-1217-4624-963d-83d00e96a28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38771bd6-54dc-448e-9f9e-be97fabb46b6", "name": "network-vif-deleted", "tag": "61d1421c-05ab-4e1a-8af5-088db0beffa3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:37.714291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.714731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.717002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9a654259-37d2-4d00-9776-0c02c213408d req-df567440-1217-4624-963d-83d00e96a28d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.717223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.717916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9a654259-37d2-4d00-9776-0c02c213408d req-df567440-1217-4624-963d-83d00e96a28d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.719906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.738023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9a654259-37d2-4d00-9776-0c02c213408d req-df567440-1217-4624-963d-83d00e96a28d service nova] Creating event network-vif-deleted:61d1421c-05ab-4e1a-8af5-088db0beffa3 for instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 on nch1-master-1 Apr 09 21:03:37.745160 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9a654259-37d2-4d00-9776-0c02c213408d req-df567440-1217-4624-963d-83d00e96a28d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052945 Apr 09 21:03:37.746550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1198/2443] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:37.753063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:37.754103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:37.763870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.764922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.766136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.766863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.799203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:37.799665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:37.800293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lazy-loading 'fault' on Instance uuid 38771bd6-54dc-448e-9f9e-be97fabb46b6 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:37.897661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd753dc1202f4e138094f0f50b83b2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d288e617526417680b8d375cf87e380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:37.911735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-77551e12-3400-472c-adf5-f4b44dbe2591 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 200 len: 1332 microversion: 2.1 time: 0.225144 Apr 09 21:03:37.913455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1246/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:37 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 1332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:38.049608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:38.050244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:38.060537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.061005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.061834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.062279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.277372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:38.300924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2936d4ad-524f-4fe6-80cb-d49626da2150 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.550011 Apr 09 21:03:38.302550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1199/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:37 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:38.310037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:38.313126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:38.324217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.329700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.331328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.333320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.373790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:38.386533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8b5b2192-d455-42bb-a43a-d89eeb243d84 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.341291 Apr 09 21:03:38.396084 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1247/2446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:38 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:38.536117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6bee7ddb-e1db-4b3b-8ccb-8de2f5c38c2a req-9124788b-a707-423b-aa3f-9471a4b08f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98c800d-6d97-4a1e-ae07-0b67613b3b9a", "name": "network-vif-plugged", "status": "completed", "tag": "9b504e32-7c87-466e-9a26-d68a37240534"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:38.552158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6bee7ddb-e1db-4b3b-8ccb-8de2f5c38c2a req-9124788b-a707-423b-aa3f-9471a4b08f42 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.552628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6bee7ddb-e1db-4b3b-8ccb-8de2f5c38c2a req-9124788b-a707-423b-aa3f-9471a4b08f42 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.586337 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6bee7ddb-e1db-4b3b-8ccb-8de2f5c38c2a req-9124788b-a707-423b-aa3f-9471a4b08f42 service nova] Creating event network-vif-plugged:9b504e32-7c87-466e-9a26-d68a37240534 for instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a on nch2-master-1 Apr 09 21:03:38.592432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6bee7ddb-e1db-4b3b-8ccb-8de2f5c38c2a req-9124788b-a707-423b-aa3f-9471a4b08f42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061724 Apr 09 21:03:38.593523 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1248/2447] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:38.642130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:38.655275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-80fd7c62-6d0a-461b-b3ac-afe90a22fcaf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.350841 Apr 09 21:03:38.657260 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1200/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:38 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:38.700816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:38.702222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:38.709158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.709973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.710973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.711579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.713941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:38.714730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:38.723549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.724280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:38.725498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:38.726684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.502020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:39.507774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:39.531053 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-05734523-0e84-4c16-bbb3-540df78074ac tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.831434 Apr 09 21:03:39.533168 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7d8eaf0-8c5f-4c8f-b3e1-7be7f2fea07f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.827449 Apr 09 21:03:39.534948 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1249/2449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:38 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:39.547495 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1201/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:38 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:39.560815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:39.562961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:39.563301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:39.566079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:39.587332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.588049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.588779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.590633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.590831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.591993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.592730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.593447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.640415 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] HTTP exception thrown: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. Apr 09 21:03:39.641476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Returning 404 to user: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:39.643104 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5e41b4e-d402-4c5b-9fb4-31151c43bfc7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 404 len: 111 microversion: 2.1 time: 0.106511 Apr 09 21:03:39.643870 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1250/2451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:39 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:39.655911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:39.657446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:39.667267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.668001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:39.671619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:39.673649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.040231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:40.051359 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4ba31b3-e285-492c-ae6e-260f79b4b59c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.501778 Apr 09 21:03:40.052458 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1202/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:39 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:40.059353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cabc4240-60c5-45cf-a34f-822e3f0634ac tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '.version_select at 0x7fb08ecccf70>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:40.101148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cabc4240-60c5-45cf-a34f-822e3f0634ac tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965686660" status: 202 len: 0 microversion: 2.1 time: 0.046730 Apr 09 21:03:40.102606 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1203/2453] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965686660 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:40.114503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:40.119636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:40.132425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:40.137633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.138526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.139816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.141399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.143950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8a525db-a5b8-4571-b9b9-d5e536166cea tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.492555 Apr 09 21:03:40.144647 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1251/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:39 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:40.159744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4c8537a9-e76e-4eaf-8bb2-d4a5b17821ed req-ddb70959-64cc-40b5-acf4-f07c2628b770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595b235c-0268-4995-b9b6-a9681a0e728f", "tag": "3b264ec0-cb5f-44ef-8d47-fdf046582d87"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:40.182338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4c8537a9-e76e-4eaf-8bb2-d4a5b17821ed req-ddb70959-64cc-40b5-acf4-f07c2628b770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.182865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4c8537a9-e76e-4eaf-8bb2-d4a5b17821ed req-ddb70959-64cc-40b5-acf4-f07c2628b770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.213345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4c8537a9-e76e-4eaf-8bb2-d4a5b17821ed req-ddb70959-64cc-40b5-acf4-f07c2628b770 service nova] Creating event network-changed:3b264ec0-cb5f-44ef-8d47-fdf046582d87 for instance 595b235c-0268-4995-b9b6-a9681a0e728f on nch1-master-1 Apr 09 21:03:40.227067 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4c8537a9-e76e-4eaf-8bb2-d4a5b17821ed req-ddb70959-64cc-40b5-acf4-f07c2628b770 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079789 Apr 09 21:03:40.231948 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1252/2455] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:40.482713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:40.494744 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54ebd9f5-f208-4c62-9ec9-a6657ee9be9e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.390059 Apr 09 21:03:40.496880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1204/2456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:40 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:40.569147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:40.571660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:40.575673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:40.577429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:40.586452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.603851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.608177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.609114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.609927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.610634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:40.615303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:40.616338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.003636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:41.010994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:41.014633 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-212c9ba9-8aeb-47d0-a5fd-a4ca7872685a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.465895 Apr 09 21:03:41.022725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-67aeb754-18cf-42c6-98ac-9c706f5f0e29 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.472956 Apr 09 21:03:41.022927 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1253/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:40 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:41.023659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1205/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:40 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:41.070826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:41.071648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:41.081456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.081949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.082765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.083419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.167996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:41.169363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:41.178410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.179286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.180471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.181169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.508304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:41.522321 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20dcca60-164c-4948-a53a-0d2b728d47ce tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.457205 Apr 09 21:03:41.523269 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1254/2459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:41 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:41.530286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:41.533807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:41.543783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.544534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.545550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.546165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.731595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:41.744218 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-049f689b-53b5-4626-b70d-a3573c970d2e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.586508 Apr 09 21:03:41.747594 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1206/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:41 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:41.760441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3b931ccb-d9be-4852-8c88-c55ae85a4427 req-55387b01-d864-46aa-84c8-f1e5e4ed8840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90cdbf3-35f5-4442-933c-e8875ca0542b", "tag": "9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:41.776272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3b931ccb-d9be-4852-8c88-c55ae85a4427 req-55387b01-d864-46aa-84c8-f1e5e4ed8840 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:41.776993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3b931ccb-d9be-4852-8c88-c55ae85a4427 req-55387b01-d864-46aa-84c8-f1e5e4ed8840 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:41.791283 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3b931ccb-d9be-4852-8c88-c55ae85a4427 req-55387b01-d864-46aa-84c8-f1e5e4ed8840 service nova] Creating event network-changed:9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac for instance c90cdbf3-35f5-4442-933c-e8875ca0542b on nch2-master-1 Apr 09 21:03:41.797026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3b931ccb-d9be-4852-8c88-c55ae85a4427 req-55387b01-d864-46aa-84c8-f1e5e4ed8840 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048150 Apr 09 21:03:41.797991 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1207/2461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:41.957048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:41.965394 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-15355b0d-f48d-471b-929f-a24bc1957e96 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.440832 Apr 09 21:03:41.965992 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1255/2462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:41 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:42.034324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:42.040259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:42.041588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:42.043298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:42.057520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.060926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.062517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.064171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.065602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.066344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.069683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.070289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.497960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:42.512685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1c404e06-2d80-48b0-8537-959a49ba0999 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.482248 Apr 09 21:03:42.524914 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1208/2463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:42 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:42.545363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:42.545363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:42.550780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.552342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.553697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.554547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.790690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:42.805222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2a160d3-04d0-4260-a8cc-6b5bd172c1bc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.769108 Apr 09 21:03:42.806182 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1256/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:42 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:03:42.820117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:42.820741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:42.829097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.829553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:42.830620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:42.831290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.081603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:43.101310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d8744c4-7e23-49c6-b7b6-46c724663010 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.565054 Apr 09 21:03:43.107529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1209/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:42 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:43.112690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:43.113347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:43.135488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.135953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.136755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.140248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.225423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:43.258194 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59604fbd-4126-4183-a638-ed0f2dbbf428 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.450559 Apr 09 21:03:43.273338 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1257/2466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:42 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:43.282045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-64820d21-0926-4e3a-996c-806bde7bd8ea req-a3dae20a-18b8-432e-a724-f0151e3240e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667511c-c0e4-4a11-8440-927a5977f82e", "name": "network-vif-plugged", "status": "completed", "tag": "4b939184-9908-4fe1-b2fd-2da6cdaa8901"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:43.314778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-64820d21-0926-4e3a-996c-806bde7bd8ea req-a3dae20a-18b8-432e-a724-f0151e3240e0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.315258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-64820d21-0926-4e3a-996c-806bde7bd8ea req-a3dae20a-18b8-432e-a724-f0151e3240e0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.357402 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-64820d21-0926-4e3a-996c-806bde7bd8ea req-a3dae20a-18b8-432e-a724-f0151e3240e0 service nova] Creating event network-vif-plugged:4b939184-9908-4fe1-b2fd-2da6cdaa8901 for instance f667511c-c0e4-4a11-8440-927a5977f82e on nch2-master-1 Apr 09 21:03:43.369499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-64820d21-0926-4e3a-996c-806bde7bd8ea req-a3dae20a-18b8-432e-a724-f0151e3240e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103581 Apr 09 21:03:43.370117 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1258/2467] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:43.485857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:43.494765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0ac8782-c9b8-4ead-98c5-5bd48617f70c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.385912 Apr 09 21:03:43.495384 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1210/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:43 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:43.532912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:43.533771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:43.541610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.542393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.543380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.543828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.716707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:43.728005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0d765a8-fe5b-4fdd-b248-11e793e63bbb tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1319 microversion: 2.1 time: 0.199641 Apr 09 21:03:43.728790 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1259/2469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:43 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:43.822978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:43.824211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:43.842041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.842572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:43.843628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:43.844076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.052573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:44.065965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e97dc19-7da7-40b6-a9ba-85e8761b1319 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.246937 Apr 09 21:03:44.068592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1211/2470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:43 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:44.124229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.125027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.135290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.137388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.138384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.138944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.283551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.284706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.300186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.301650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.303086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.303846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.388557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:44.398418 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d4de0ed-bff0-4865-8b0b-f8de1bf20b44 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.278210 Apr 09 21:03:44.403653 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1260/2471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:44 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:44.421258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.424909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.465210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.467312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.470865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.477122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.505745 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] HTTP exception thrown: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. Apr 09 21:03:44.507624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Returning 404 to user: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:44.508705 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d3c6a4e4-d1ad-45e9-b6cb-8713297ae3d4 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 404 len: 111 microversion: 2.1 time: 0.097440 Apr 09 21:03:44.509669 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1261/2472] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:44 2022] DELETE /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:44.520406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.521799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.534952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.535870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.536681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.537485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.722865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:44.737868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d4e84ae-44ab-4b6b-a474-1c6a23917f4f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.459865 Apr 09 21:03:44.749444 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1212/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:44 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:44.749444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.749444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] [instance: 38771bd6-54dc-448e-9f9e-be97fabb46b6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.765857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.767018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.768967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.769791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.795089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] HTTP exception thrown: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. Apr 09 21:03:44.795991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] Returning 404 to user: Instance 38771bd6-54dc-448e-9f9e-be97fabb46b6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:44.798199 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea48c411-160a-430d-bfe5-2769b8e951d7 tempest-AttachSCSIVolumeTestJSON-1115941662 tempest-AttachSCSIVolumeTestJSON-1115941662-project] 10.222.0.30 "GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6" status: 404 len: 111 microversion: 2.1 time: 0.058643 Apr 09 21:03:44.799432 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1213/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:44 2022] GET /compute/v2.1/servers/38771bd6-54dc-448e-9f9e-be97fabb46b6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:44.806367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:44.807529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:44.816145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.816496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.817536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:44.818022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:44.872101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:44.884941 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e582194b-c6ac-4ec1-9a97-fbcbbf18cdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.373761 Apr 09 21:03:44.898600 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1262/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:44 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:45.037528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:45.053723 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbce7ef1-17a9-4fe4-99d5-ca2651d185f0 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1468 microversion: 2.1 time: 0.252936 Apr 09 21:03:45.054351 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1214/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:44 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:45.070788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:45.071714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:45.082804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.082804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:45.082804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.082804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:45.100633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6cf29c7-52d3-46ed-9171-4baa42c0aabf tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Action: 'create', calling method: .version_select at 0x7fb08eb7e700>, body: {"pool": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:45.113865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lazy-loading 'flavor' on Instance uuid d98c800d-6d97-4a1e-ae07-0b67613b3b9a {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:45.271241 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d324a874-41e0-4272-8eb5-f3d32b7df9d7 tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.203994 Apr 09 21:03:45.278411 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1215/2477] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:45 2022] POST /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:45.285917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:45.287007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:45.296663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.297508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:45.299322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.300130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:45.641012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:45.656679 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16af79ab-c159-4053-8234-998182a4c790 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.376342 Apr 09 21:03:45.657834 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1216/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:45 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:45.669525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:45.670385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:45.678698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.679634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:45.680703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:45.682011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:46.392980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:46.401128 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b53b236b-0bd9-4612-ac5a-8b32222e7ea6 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1476 microversion: 2.1 time: 0.741227 Apr 09 21:03:46.410883 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1217/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:45 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:46.410883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:46.410883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:46.416830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:46.417327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:46.418149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:46.418586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:46.697338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:46.705233 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85a4084d-8eb4-4137-9b0d-c9bad5092d25 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1325 microversion: 2.1 time: 0.302570 Apr 09 21:03:46.706005 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1218/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:46 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:46.716723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:46.717411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:46.724573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:46.725028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:46.726014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:46.726634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:47.011143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:47.042732 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fabea44-cdb0-4010-bc97-4e2a5b315f75 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.335333 Apr 09 21:03:47.043708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1219/2481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:46 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:47.048620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:47.049659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:47.061025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:47.062839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:47.064468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:47.065176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:47.396696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:47.409245 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-32166504-ba4a-4d78-977a-10882cca5aa6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.364244 Apr 09 21:03:47.419548 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1220/2482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:47 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:47.428534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-aa9be2bc-17b3-44a3-be09-2eec105239d9 req-79507a32-ffad-4265-a72b-bb9cfe63b0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595b235c-0268-4995-b9b6-a9681a0e728f", "name": "network-vif-plugged", "status": "completed", "tag": "3b264ec0-cb5f-44ef-8d47-fdf046582d87"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:47.438628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa9be2bc-17b3-44a3-be09-2eec105239d9 req-79507a32-ffad-4265-a72b-bb9cfe63b0db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:47.439386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa9be2bc-17b3-44a3-be09-2eec105239d9 req-79507a32-ffad-4265-a72b-bb9cfe63b0db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:47.456848 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-aa9be2bc-17b3-44a3-be09-2eec105239d9 req-79507a32-ffad-4265-a72b-bb9cfe63b0db service nova] Creating event network-vif-plugged:3b264ec0-cb5f-44ef-8d47-fdf046582d87 for instance 595b235c-0268-4995-b9b6-a9681a0e728f on nch1-master-1 Apr 09 21:03:47.472323 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-aa9be2bc-17b3-44a3-be09-2eec105239d9 req-79507a32-ffad-4265-a72b-bb9cfe63b0db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047104 Apr 09 21:03:47.473789 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1221/2483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:47.523542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:47.524331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:47.573587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:47.574196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:47.575115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:47.575650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.345235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:48.357475 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-96ee4e82-ff8c-46aa-b145-c835cda4553a tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1313 microversion: 2.1 time: 0.881994 Apr 09 21:03:48.370284 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1222/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:47 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:48.385207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:48.387215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:48.394178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.394910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.395907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.396588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.694898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6cf29c7-52d3-46ed-9171-4baa42c0aabf tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.794418 Apr 09 21:03:48.696586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1263/2485] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 21:03:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:48.703003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:48.704018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:48.715535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:48.725317 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24802c62-d193-4b99-a60c-24ea842df859 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1459 microversion: 2.1 time: 0.353401 Apr 09 21:03:48.726770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.727489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.728478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.729573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.735295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1223/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:48 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1459 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:48.744428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:48.745157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:48.758746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.759221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:48.761399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:48.761855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.000722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:49.004076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:49.012829 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c55c3d1e-3f0e-4959-ba00-c08b98a98daf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1522 microversion: 2.1 time: 0.314751 Apr 09 21:03:49.014066 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1264/2487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:48 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:49.027278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad2fa08b-7e44-4945-9cc4-d273cf74472f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.277419 Apr 09 21:03:49.027278 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1224/2488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:48 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:49.032344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.033263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:49.037277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc7dc502-534a-4b9a-9d00-4cc684727475 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb098465700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.066221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.066701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.067524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.067965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.354503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc7dc502-534a-4b9a-9d00-4cc684727475 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/0c9bb7b7-97dc-49a1-a277-225c007072e5" status: 200 len: 142 microversion: 2.1 time: 0.321881 Apr 09 21:03:49.355340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1225/2489] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/os-floating-ips/0c9bb7b7-97dc-49a1-a277-225c007072e5 => generated 142 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:49.361600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.362445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:49.374991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.375746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.377441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.380000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.399830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:49.415080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0500488b-4cab-47e6-b3d5-60d37689dfc1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.397289 Apr 09 21:03:49.429219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1265/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:49.434588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.450804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:49.464655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.467339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.468154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.468596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.815398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:49.827438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-823817b2-8acf-4f21-8db4-f9892d151b8c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1522 microversion: 2.1 time: 0.396653 Apr 09 21:03:49.840605 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1266/2491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:49.852347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d8cf054-7b81-4290-a640-eb0597fd904d tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb0984a8790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.943050 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d20a4ef7-2f04-4d6e-aa0b-bb452b22b8ff tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1610 microversion: 2.1 time: 0.584824 Apr 09 21:03:49.944290 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1226/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1610 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:49.950116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:49.950968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:49.959152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.962025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:49.962025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:49.962025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.141704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d8cf054-7b81-4290-a640-eb0597fd904d tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.300153 Apr 09 21:03:50.142378 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1267/2493] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:50.147510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-445a4f73-a925-4f54-9cb5-d0b55153d5e6 req-1bb462dc-caf5-4b37-9e4e-2da8fa5571ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce0e76e-bbf7-44e1-86c4-9d078813ff72", "name": "network-vif-plugged", "status": "completed", "tag": "d9131337-3f4d-44a3-aa06-6245dff9187e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:50.172505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-445a4f73-a925-4f54-9cb5-d0b55153d5e6 req-1bb462dc-caf5-4b37-9e4e-2da8fa5571ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.173668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-445a4f73-a925-4f54-9cb5-d0b55153d5e6 req-1bb462dc-caf5-4b37-9e4e-2da8fa5571ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.182165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:50.186362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-445a4f73-a925-4f54-9cb5-d0b55153d5e6 req-1bb462dc-caf5-4b37-9e4e-2da8fa5571ea service nova] Creating event network-vif-plugged:d9131337-3f4d-44a3-aa06-6245dff9187e for instance bce0e76e-bbf7-44e1-86c4-9d078813ff72 on nch2-master-1 Apr 09 21:03:50.191172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0abf557e-23b9-44e4-8d70-1cbf122efbfc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1463 microversion: 2.1 time: 0.245680 Apr 09 21:03:50.191742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-445a4f73-a925-4f54-9cb5-d0b55153d5e6 req-1bb462dc-caf5-4b37-9e4e-2da8fa5571ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047955 Apr 09 21:03:50.192481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1268/2494] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:50.193482 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1227/2495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:49 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1463 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:50.198166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-537248249"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:50.199437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:50.212189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:50.213333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.214038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.215104 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:03:50.215104 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:03:50.215457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.216096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.217067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.217610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.218503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.219026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.256165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f45bb37d-7bf4-419b-8148-083c9d3abcce tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060953 Apr 09 21:03:50.266359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1228/2496] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 21:03:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:50.272875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:50.273536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:50.282238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.282920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.284230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.284819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.540477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:50.549633 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb7b6674-9477-4517-9723-26dbe30873f7 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.281827 Apr 09 21:03:50.552226 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1229/2497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:50 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:50.559051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd3bc451-1881-475e-b633-324e89874995 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb09845fb80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:50.566197 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e05ee1e1-56db-4b3f-a68b-323ba20d4bb3 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e/action" status: 202 len: 0 microversion: 2.1 time: 0.358216 Apr 09 21:03:50.567842 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1269/2498] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:50 2022] POST /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:03:50.757470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:50.761389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'deleted': False, 'project_id': 'ff352cfa067d4a45b06c494093a370bb'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:50.767706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.768605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.769624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.770406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.801556 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d30b77a-cf21-4cf2-a378-fa971011e316 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.232164 Apr 09 21:03:50.812856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1270/2499] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:03:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:50.812856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:50.812856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:50.816801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.817463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.817820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.818671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.846185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Lazy-loading 'flavor' on Instance uuid d98c800d-6d97-4a1e-ae07-0b67613b3b9a {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:50.859727 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a while it is in vm_state suspended Apr 09 21:03:50.860484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a while it is in vm_state suspended {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:50.861562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-278b0f4e-7573-4ba7-b7c0-356bf59084ca tempest-LiveMigrationNegativeTest-1857113938 tempest-LiveMigrationNegativeTest-1857113938-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a/action" status: 409 len: 155 microversion: 2.1 time: 0.057994 Apr 09 21:03:50.862248 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1271/2500] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:50 2022] POST /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a/action => generated 155 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:03:50.867887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:50.868785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:50.875744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.876310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:50.877242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:50.877929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:51.543688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:51.554063 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86c77cd4-ca2a-488c-8e10-f009c3af9bb7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1293 microversion: 2.1 time: 0.689812 Apr 09 21:03:51.555496 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1272/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:50 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1293 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:51.571770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-021e5534-6b63-4dd7-8f7f-979ad5c5a87b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb08eaefdc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:51.734819 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-021e5534-6b63-4dd7-8f7f-979ad5c5a87b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959" status: 204 len: 0 microversion: 2.1 time: 0.167361 Apr 09 21:03:51.735417 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1273/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:51 2022] DELETE /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:51.740612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:51.745880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'deleted': False} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:51.751798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:51.753244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:51.753894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:51.754335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:51.879378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:03:51.962568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd3bc451-1881-475e-b633-324e89874995 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/0c9bb7b7-97dc-49a1-a277-225c007072e5" status: 202 len: 0 microversion: 2.1 time: 1.408360 Apr 09 21:03:51.964051 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1230/2503] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:03:50 2022] DELETE /compute/v2.1/os-floating-ips/0c9bb7b7-97dc-49a1-a277-225c007072e5 => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:51.969434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:51.970676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:51.980949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:51.981661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:51.982705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:51.983310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:51.989381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:51.990416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.017575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:52.126662 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78282c90-0de6-4bcc-86dd-374557ef6c94 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 204 len: 0 microversion: 2.1 time: 0.160329 Apr 09 21:03:52.129119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1231/2504] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:51 2022] DELETE /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:52.135292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:52.136211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:52.142565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.142995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.143978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.144581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.340764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:52.350453 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a7ebb34-8f90-4978-8622-bd7a9c36f193 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.219675 Apr 09 21:03:52.351051 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1232/2505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:52 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:52.355888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-961217b6-cd97-4be0-8630-c79845c55cf5 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb08f1c2820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:52.378145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-961217b6-cd97-4be0-8630-c79845c55cf5 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Image not found. Apr 09 21:03:52.378929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-961217b6-cd97-4be0-8630-c79845c55cf5 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:52.379780 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-961217b6-cd97-4be0-8630-c79845c55cf5 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959" status: 404 len: 62 microversion: 2.1 time: 0.027627 Apr 09 21:03:52.380862 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1233/2506] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:03:52 2022] GET /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:03:52.385932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ed12f9d-3924-41da-b0a1-5e2529b23fd2 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Action: 'create', calling method: .version_select at 0x7fb08f680940>, body: {"pool": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:52.563113 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa521198-39b4-4458-a188-ae31381cd8d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17324 microversion: 2.1 time: 0.826363 Apr 09 21:03:52.573839 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1274/2507] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Apr 9 21:03:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17324 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:03:52.580982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:52.583249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:52.591160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.591745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.592949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.593589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.811012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:52.818738 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3bf680eb-3461-467e-b6d3-444229fab6b7 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1465 microversion: 2.1 time: 0.242575 Apr 09 21:03:52.819453 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1275/2508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:52 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:52.833380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ecb34317-c9a1-4820-8893-daf8d0bcdbf2 req-df330486-dbf1-4445-85a9-d5cde043bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90cdbf3-35f5-4442-933c-e8875ca0542b", "name": "network-vif-plugged", "status": "completed", "tag": "9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:52.855373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ecb34317-c9a1-4820-8893-daf8d0bcdbf2 req-df330486-dbf1-4445-85a9-d5cde043bb48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.856127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ecb34317-c9a1-4820-8893-daf8d0bcdbf2 req-df330486-dbf1-4445-85a9-d5cde043bb48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.868217 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ecb34317-c9a1-4820-8893-daf8d0bcdbf2 req-df330486-dbf1-4445-85a9-d5cde043bb48 service nova] Creating event network-vif-plugged:9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac for instance c90cdbf3-35f5-4442-933c-e8875ca0542b on nch2-master-1 Apr 09 21:03:52.873550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ecb34317-c9a1-4820-8893-daf8d0bcdbf2 req-df330486-dbf1-4445-85a9-d5cde043bb48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043665 Apr 09 21:03:52.874409 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1276/2509] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:52.880789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:52.882330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:52.889177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.889742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:52.890541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:52.890964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.072494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:53.080256 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b8e6a6e-233f-42d3-af01-8509fe55ba37 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1534 microversion: 2.1 time: 0.204414 Apr 09 21:03:53.081185 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1277/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:52 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1534 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:53.085844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:53.086696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:53.092710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.093199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.093982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.094756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.313466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:53.321826 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-703e8e2a-d13d-4d98-ac3d-4a62bde3af6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1473 microversion: 2.1 time: 0.239417 Apr 09 21:03:53.322822 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1278/2511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:53 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1473 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:53.346712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:53.351366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'deleted': False, 'project_id': 'ff352cfa067d4a45b06c494093a370bb'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:53.357730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.358412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.359374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.360001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.408315 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0dd0a12f-f24e-4b3d-9151-5342cf376249 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=54a9d66010e4404c82a529dd4bd18c3c" status: 200 len: 15 microversion: 2.1 time: 0.069381 Apr 09 21:03:53.408903 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1279/2512] 10.222.0.30 () {58 vars in 1230 bytes} [Sat Apr 9 21:03:53 2022] GET /compute/v2.1/servers/detail?tenant_id=54a9d66010e4404c82a529dd4bd18c3c => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:53.413918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:53.414594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:53.421125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.421822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.422797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.423429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.657877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:53.665916 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64ff6cd0-db67-4c3b-b78f-e0ba0e358a2c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.255883 Apr 09 21:03:53.676066 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1280/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:53 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:53.681344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:53.686307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'tenant_id': '54a9d66010e4404c82a529dd4bd18c3c', 'deleted': False} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:53.691317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.691763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.692557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.693080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.725710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:03:53.773577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:53.774432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:53.948967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fb580a4-d8f9-4264-9b1a-4a5a0511fa14 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=54a9d66010e4404c82a529dd4bd18c3c" status: 200 len: 4825 microversion: 2.1 time: 0.271397 Apr 09 21:03:53.969269 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1281/2514] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:03:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=54a9d66010e4404c82a529dd4bd18c3c => generated 4825 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:53.975926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-170025906", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:54.042873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:03:54.185726 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ed12f9d-3924-41da-b0a1-5e2529b23fd2 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.803594 Apr 09 21:03:54.186330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1234/2515] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Apr 9 21:03:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:54.196541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:54.197204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:54.213343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.213914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.214974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.215586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.501453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:54.511088 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ab6c8e8-1166-4b05-9d91-7fc1de43e8df tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1465 microversion: 2.1 time: 0.323728 Apr 09 21:03:54.512698 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1235/2516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:54 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:54.521675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:54.529986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'tenant_id': 'ff352cfa067d4a45b06c494093a370bb', 'deleted': False} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:54.548285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.549108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.550122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.550736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.565816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:03:54.572651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:03:54.573458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:03:54.574042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:03:54.574698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:03:54.584810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.585555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.586937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.587555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.613233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:03:54.618969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:03:54.634309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:03:54.636854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:03:54.686343 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce0a2fd8-c886-454a-af7f-5ebd5c7257d7 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ff352cfa067d4a45b06c494093a370bb" status: 200 len: 15 microversion: 2.1 time: 0.171586 Apr 09 21:03:54.698387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1236/2517] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:03:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ff352cfa067d4a45b06c494093a370bb => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:54.701693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:54.702326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:54.707336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7b75999-f7bf-496b-8249-7ac3ab51bd67 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736656 Apr 09 21:03:54.708609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1282/2518] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:03:54.714106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92e4795d-089e-4d2e-b44c-70974f8e297b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb08ee2d790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:54.728891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.730132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.731481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:54.732367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:54.997807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:55.006416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4ff37a0-19cc-453d-b2b1-19cfa921468a tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1540 microversion: 2.1 time: 0.317922 Apr 09 21:03:55.017699 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1237/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:54 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1540 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:55.024047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:55.024689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:55.031159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.031866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:55.032940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.033580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:55.371990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:55.380489 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f85e6de5-d884-4d5f-94df-f5dcafb20c8b tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1316 microversion: 2.1 time: 0.361263 Apr 09 21:03:55.390515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1238/2520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:55 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:55.405157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dbfe5ee7-5157-47a8-bc44-f17e17fa52d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:55.420417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dbfe5ee7-5157-47a8-bc44-f17e17fa52d3 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019024 Apr 09 21:03:55.421660 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1239/2521] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Apr 9 21:03:55 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:55.426279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:55.426779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:55.445166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.445850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:55.456087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.457623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:55.486409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:55.505246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.505701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:55.532523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lazy-loading 'flavor' on Instance uuid b831c6c7-428c-43b1-9716-8e06bc138d41 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:55.563915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lazy-loading 'system_metadata' on Instance uuid b831c6c7-428c-43b1-9716-8e06bc138d41 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:55.661328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lazy-loading 'metadata' on Instance uuid b831c6c7-428c-43b1-9716-8e06bc138d41 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:03:55.832918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:55.833573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.015768 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e860195c-7dc8-46ec-8ef8-0ad8343f8757 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 204 len: 0 microversion: 2.1 time: 0.592429 Apr 09 21:03:56.021767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1240/2522] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:55 2022] DELETE /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:56.030085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:56.031379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.040472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.041001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.042628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.043126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.066257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-92e4795d-089e-4d2e-b44c-70974f8e297b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d" status: 202 len: 0 microversion: 2.1 time: 1.356064 Apr 09 21:03:56.068583 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1283/2523] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:03:54 2022] DELETE /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:56.076718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.078139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.095656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.096312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.097175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.097621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.165206 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-96c01b1b-20cb-4aeb-88ac-c2f740efc75d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 0 microversion: 2.1 time: 0.141328 Apr 09 21:03:56.166876 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1241/2524] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:56 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:56.179159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.180732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.200056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.200683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.201796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.202357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.251314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:56.259948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a30e3fde-f2aa-4f84-9cca-1600671f7ee3 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 200 len: 1423 microversion: 2.1 time: 0.189080 Apr 09 21:03:56.260845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1284/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 1423 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:56.266020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.266966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.274680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.275468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.276477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.277155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.370256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:56.382714 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fbdcd92b-149c-4820-bb6c-460d63cbd727 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 200 len: 1210 microversion: 2.1 time: 0.120278 Apr 09 21:03:56.383310 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1285/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:56.388213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-fb62b9a9-f86c-4bef-987a-29a087b080fa req-8c7915c1-0877-428f-86f2-f338ada034ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98c800d-6d97-4a1e-ae07-0b67613b3b9a", "name": "network-vif-deleted", "tag": "9b504e32-7c87-466e-9a26-d68a37240534"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:56.396897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fb62b9a9-f86c-4bef-987a-29a087b080fa req-8c7915c1-0877-428f-86f2-f338ada034ad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.397371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fb62b9a9-f86c-4bef-987a-29a087b080fa req-8c7915c1-0877-428f-86f2-f338ada034ad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.409403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-fb62b9a9-f86c-4bef-987a-29a087b080fa req-8c7915c1-0877-428f-86f2-f338ada034ad service nova] Creating event network-vif-deleted:9b504e32-7c87-466e-9a26-d68a37240534 for instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a on nch2-master-1 Apr 09 21:03:56.415877 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-fb62b9a9-f86c-4bef-987a-29a087b080fa req-8c7915c1-0877-428f-86f2-f338ada034ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Apr 09 21:03:56.416783 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1286/2527] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:56.424537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d80928e-4c6f-463c-89b9-8eb1c1dc068b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb08f5499d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.428554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:56.436033 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-abfcb868-0c9c-45ab-8085-3a570756f69e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1540 microversion: 2.1 time: 0.266014 Apr 09 21:03:56.436840 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1242/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1540 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:56.450703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.454095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:56.454912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:56.471697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.472044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.472853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.473330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.486284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-8d80928e-4c6f-463c-89b9-8eb1c1dc068b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a22389f6-d652-4ecd-a726-b8fc1e49e60d could not be found", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:56.487940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8d80928e-4c6f-463c-89b9-8eb1c1dc068b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] HTTP exception thrown: Floating IP not found for ID a22389f6-d652-4ecd-a726-b8fc1e49e60d Apr 09 21:03:56.488545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d80928e-4c6f-463c-89b9-8eb1c1dc068b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Returning 404 to user: Floating IP not found for ID a22389f6-d652-4ecd-a726-b8fc1e49e60d {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:56.489438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d80928e-4c6f-463c-89b9-8eb1c1dc068b tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d" status: 404 len: 111 microversion: 2.1 time: 0.070883 Apr 09 21:03:56.491169 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1287/2529] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:56.498065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7b124550-2c10-45dd-81ed-2d19d2d395d3 req-e7aeab42-5417-4feb-a1e5-036e51d44161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667511c-c0e4-4a11-8440-927a5977f82e", "name": "network-vif-plugged", "status": "completed", "tag": "4b939184-9908-4fe1-b2fd-2da6cdaa8901"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:56.513842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7b124550-2c10-45dd-81ed-2d19d2d395d3 req-e7aeab42-5417-4feb-a1e5-036e51d44161 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.514626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7b124550-2c10-45dd-81ed-2d19d2d395d3 req-e7aeab42-5417-4feb-a1e5-036e51d44161 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.526930 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7b124550-2c10-45dd-81ed-2d19d2d395d3 req-e7aeab42-5417-4feb-a1e5-036e51d44161 service nova] Creating event network-vif-plugged:4b939184-9908-4fe1-b2fd-2da6cdaa8901 for instance f667511c-c0e4-4a11-8440-927a5977f82e on nch2-master-1 Apr 09 21:03:56.532578 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7b124550-2c10-45dd-81ed-2d19d2d395d3 req-e7aeab42-5417-4feb-a1e5-036e51d44161 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039448 Apr 09 21:03:56.533542 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1288/2530] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:56.539990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.540735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.550117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.552958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.552958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.552958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.565139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:03:56.635535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ee89384-38cf-4e81-b015-e75e36631bef tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.188991 Apr 09 21:03:56.640698 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1243/2531] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:56.646953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5df6a37c-de63-47ca-a4ec-219f597e9832 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Calling method '.version_select at 0x7fb08f161310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.749608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-5df6a37c-de63-47ca-a4ec-219f597e9832 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a22389f6-d652-4ecd-a726-b8fc1e49e60d could not be found", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:56.750875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-5df6a37c-de63-47ca-a4ec-219f597e9832 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] HTTP exception thrown: Floating IP not found for ID a22389f6-d652-4ecd-a726-b8fc1e49e60d Apr 09 21:03:56.751990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5df6a37c-de63-47ca-a4ec-219f597e9832 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] Returning 404 to user: Floating IP not found for ID a22389f6-d652-4ecd-a726-b8fc1e49e60d {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:56.754396 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5df6a37c-de63-47ca-a4ec-219f597e9832 tempest-FloatingIPsTestJSON-2017888037 tempest-FloatingIPsTestJSON-2017888037-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d" status: 404 len: 111 microversion: 2.1 time: 0.111879 Apr 09 21:03:56.755603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1244/2532] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:03:56 2022] DELETE /compute/v2.1/os-floating-ips/a22389f6-d652-4ecd-a726-b8fc1e49e60d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:56.763034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:56.764511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.776615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.777554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.778687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.779363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.884865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:56.906639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-26d1e98e-0573-4620-a8fe-9d6d5535c0df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1504 microversion: 2.1 time: 0.371648 Apr 09 21:03:56.907711 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1289/2533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:56.918136 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1861ba4a-880a-4d84-994c-bec113ab6700 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 0 microversion: 2.1 time: 0.160906 Apr 09 21:03:56.923531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1245/2534] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:56 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:56.928893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:56.930490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-235718788"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:56.931085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.931223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:56.938180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.938998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.940883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.943107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:56.980019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:56.999256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.002547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:57.004698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.335745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95943500-61f3-42d3-97b1-bff92f9c1fa1 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1613 microversion: 2.1 time: 0.410696 Apr 09 21:03:57.336539 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1246/2535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:56 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1613 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:57.340789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:57.341430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: d98c800d-6d97-4a1e-ae07-0b67613b3b9a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:57.358880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:57.359358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.360096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:57.360543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.388934 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] HTTP exception thrown: Instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a could not be found. Apr 09 21:03:57.389558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Returning 404 to user: Instance d98c800d-6d97-4a1e-ae07-0b67613b3b9a could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:57.390482 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c97cb1f-c407-4b85-8d6f-571eefd8406e tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a" status: 404 len: 111 microversion: 2.1 time: 0.053237 Apr 09 21:03:57.391277 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1247/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:57 2022] GET /compute/v2.1/servers/d98c800d-6d97-4a1e-ae07-0b67613b3b9a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:57.396044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:57.396967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:57.403872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:57.403872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.404194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:57.404428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:57.529865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.network.security_group_api [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Adding security group dd64af9c-f183-4ef0-8190-a444a7c21037 to port 9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac Apr 09 21:03:58.090508 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9dad868a-f27c-4c42-a586-6b28a074010c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1613 microversion: 2.1 time: 0.698319 Apr 09 21:03:58.101116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1248/2537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:57 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1613 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:58.101116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:58.101116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:58.106229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.106229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.107072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.107800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.257211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:58.265859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5cce4c4-8a9a-49e5-8c7b-869e535cde76 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 200 len: 1212 microversion: 2.1 time: 0.173629 Apr 09 21:03:58.268378 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1249/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:58 2022] GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 1212 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:58.277770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:58.277770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:58.279902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.280848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.281190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.281628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.310280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:03:58.414563 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d22dd0b5-c55a-4367-9e31-60ea1489d912 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 204 len: 0 microversion: 2.1 time: 0.144394 Apr 09 21:03:58.418513 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1250/2539] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:03:58 2022] DELETE /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:03:58.424363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:58.425191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:58.432138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.432459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.433401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.434007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.840130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:58.849204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39d43b39-0811-41a0-be69-3d0e406a5026 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1540 microversion: 2.1 time: 0.429326 Apr 09 21:03:58.849813 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1251/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:58 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1540 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:58.856377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:58.873581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:58.895146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.895514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.896424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.896859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.963539 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43c35361-7422-4460-9f48-3317dfbaaf19 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action" status: 202 len: 0 microversion: 2.1 time: 2.039688 Apr 09 21:03:58.965750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1290/2541] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:56 2022] POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action => generated 0 bytes in 2042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:03:58.972061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:58.972916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:58.989233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:58.998269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:58.999679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.001020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.106834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:03:59.184012 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21f4eb29-e6be-46c2-8055-0966503867b5 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1316 microversion: 2.1 time: 0.333109 Apr 09 21:03:59.185512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1252/2542] 10.222.0.30 () {58 vars in 1189 bytes} [Sat Apr 9 21:03:58 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:59.190562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce2fc70e-b2ac-447d-a094-82bbf5cd4cf4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08f296d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:59.337385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:03:59.353449 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec860bf7-a725-409a-a387-6621e2cb8d40 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1475 microversion: 2.1 time: 0.386192 Apr 09 21:03:59.364953 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1291/2543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:58 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:03:59.371359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5c3d63f1-f783-4098-9511-42840376a798 req-3e9c9022-019d-4efb-b745-1a25d5c2ce18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90cdbf3-35f5-4442-933c-e8875ca0542b", "tag": "9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:59.382079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5c3d63f1-f783-4098-9511-42840376a798 req-3e9c9022-019d-4efb-b745-1a25d5c2ce18 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.383122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5c3d63f1-f783-4098-9511-42840376a798 req-3e9c9022-019d-4efb-b745-1a25d5c2ce18 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.398653 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5c3d63f1-f783-4098-9511-42840376a798 req-3e9c9022-019d-4efb-b745-1a25d5c2ce18 service nova] Creating event network-changed:9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac for instance c90cdbf3-35f5-4442-933c-e8875ca0542b on nch2-master-1 Apr 09 21:03:59.405592 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5c3d63f1-f783-4098-9511-42840376a798 req-3e9c9022-019d-4efb-b745-1a25d5c2ce18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038420 Apr 09 21:03:59.406569 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1292/2544] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:03:59.411767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:59.417466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:03:59.422706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.423314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.424198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.424644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.458908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-ce2fc70e-b2ac-447d-a094-82bbf5cd4cf4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group dd64af9c-f183-4ef0-8190-a444a7c21037 in use.", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:03:59.459872 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ce2fc70e-b2ac-447d-a094-82bbf5cd4cf4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security Group dd64af9c-f183-4ef0-8190-a444a7c21037 in use. Apr 09 21:03:59.459872 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-89744a72-7266-4f0d-9b7e-4e99df2a37be'] Apr 09 21:03:59.460849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce2fc70e-b2ac-447d-a094-82bbf5cd4cf4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 400 to user: Security Group dd64af9c-f183-4ef0-8190-a444a7c21037 in use. Apr 09 21:03:59.460849 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-89744a72-7266-4f0d-9b7e-4e99df2a37be'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:59.464396 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce2fc70e-b2ac-447d-a094-82bbf5cd4cf4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037" status: 400 len: 185 microversion: 2.1 time: 0.275360 Apr 09 21:03:59.465247 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1253/2545] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:03:59 2022] DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037 => generated 185 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:03:59.472652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:59.473304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:59.491281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.491743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.492545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.494614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.527684 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. Apr 09 21:03:59.528658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:03:59.529552 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a28fce5d-313d-4cd8-8f76-1239400c0593 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 404 len: 111 microversion: 2.1 time: 0.062438 Apr 09 21:03:59.532126 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2737df7-8cca-412b-8239-82d4b35a7596 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.124255 Apr 09 21:03:59.532834 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1254/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:59 2022] GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:03:59.533545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1293/2547] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Apr 9 21:03:59 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:03:59.542495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:59.543535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:59.552436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.552982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.553796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.554230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.555228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:59.556409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:59.567001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.570452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.571438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.573678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.715154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e9f7994-39c2-454f-9f55-cc457fd0fcd2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action" status: 202 len: 0 microversion: 2.1 time: 0.180743 Apr 09 21:03:59.721366 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1255/2548] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:59 2022] POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:59.729616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-414540089", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:03:59.730002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7b4c358-cfe3-4132-85e3-99496894e558 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 0 microversion: 2.1 time: 0.179521 Apr 09 21:03:59.731606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1294/2549] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:03:59 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:03:59.738552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:03:59.740318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:03:59.751972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.752691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.754783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:03:59.755876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:03:59.852149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:00.056595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:00.075507 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46cacd46-226c-431f-ad82-dd6e108756e4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1574 microversion: 2.1 time: 0.341949 Apr 09 21:04:00.084330 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1295/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:03:59 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1574 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:00.094728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:00.096288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:00.116234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.116692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.117517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.117951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.234502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:00.235056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:00.235539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:00.235954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:00.236360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:00.327468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:00.349127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.349567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.350650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.351156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.404341 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a91e9f19-dbe9-4a45-9c4a-0e8973bbafd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 1066 microversion: 2.1 time: 0.318570 Apr 09 21:04:00.405513 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1296/2551] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:04:00 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 1066 bytes in 320 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 09 21:04:00.419304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:00.419304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:00.419304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.419304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.420511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.420667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.666054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:00.667771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:00.668451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:00.668708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:00.671087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:00.693536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.694326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.694816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.695257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.708529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:00.723028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c254ea99-b55c-409c-8221-4c4784890268 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1535 microversion: 2.1 time: 0.315122 Apr 09 21:04:00.736095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:00.742339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:00.745008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1297/2552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:00 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1535 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:00.753598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:00.755326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:00.765250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.765504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:00.766434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.767515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.768524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.769541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:00.904199 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-47598802-fcb3-4dec-b247-1f11dc1b9e47 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180956 Apr 09 21:04:00.910697 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1256/2553] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:00.920844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:00.921559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:00.934148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.934612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:00.935517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:00.936230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:01.062425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:01.077911 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35e678aa-adb3-4c81-92c5-889c528d1de8 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1475 microversion: 2.1 time: 0.330050 Apr 09 21:04:01.091072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1298/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:00 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:01.094920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ed34ec4-f259-4fcc-ae0b-c071e3cbf70a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:01.095998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ed34ec4-f259-4fcc-ae0b-c071e3cbf70a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:01.164466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ed34ec4-f259-4fcc-ae0b-c071e3cbf70a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:01.175856 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ed34ec4-f259-4fcc-ae0b-c071e3cbf70a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1220 microversion: 2.1 time: 0.092793 Apr 09 21:04:01.186130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:01.189627 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1299/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:01 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:01.193698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df0025f5-f258-4893-b2ce-097d3a7953a1 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.281733 Apr 09 21:04:01.194267 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1257/2556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:00 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:01.203469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:01.203469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:01.203469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:01.203469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:01.204351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:01.204809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:01.454417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:01.464727 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd22adf3-683f-418c-b716-df8083dfbf04 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1574 microversion: 2.1 time: 0.274169 Apr 09 21:04:01.477757 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1300/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:01 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1574 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:01.739686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:01.740300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:01.756745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:01.757545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:01.758508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:01.759775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.027495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:02.035392 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18d82f41-6fcc-4115-a6b8-5d8a115b7075 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1522 microversion: 2.1 time: 0.299575 Apr 09 21:04:02.055616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-17f8b96e-7a18-419a-975d-5c0e03b40bbd req-553609b8-8840-45ba-b875-dd1d21a40dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c778043-533a-46e6-904e-6149ad1af0a9", "name": "network-vif-deleted", "tag": "926e2550-7b2a-4e9a-947e-f80f6f5bcf9d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:02.064041 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1258/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:01 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:02.075821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:02.076189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-17f8b96e-7a18-419a-975d-5c0e03b40bbd req-553609b8-8840-45ba-b875-dd1d21a40dac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.077314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-17f8b96e-7a18-419a-975d-5c0e03b40bbd req-553609b8-8840-45ba-b875-dd1d21a40dac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.081747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:02.091760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.094732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.101078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.101913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.105310 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-17f8b96e-7a18-419a-975d-5c0e03b40bbd req-553609b8-8840-45ba-b875-dd1d21a40dac service nova] Creating event network-vif-deleted:926e2550-7b2a-4e9a-947e-f80f6f5bcf9d for instance 6c778043-533a-46e6-904e-6149ad1af0a9 on nch2-master-1 Apr 09 21:04:02.118640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-17f8b96e-7a18-419a-975d-5c0e03b40bbd req-553609b8-8840-45ba-b875-dd1d21a40dac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059704 Apr 09 21:04:02.123182 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1301/2559] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:02.137295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:02.139185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:02.153264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.158310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:02.160627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.161941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.162562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.227154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.227893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.228511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lazy-loading 'fault' on Instance uuid 6c778043-533a-46e6-904e-6149ad1af0a9 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:02.320335 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8297bf25-ee16-4bec-8063-c9104e4c4933 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 204 len: 0 microversion: 2.1 time: 0.253392 Apr 09 21:04:02.321305 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1259/2560] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:02 2022] DELETE /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:02.330485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:02.331493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:02.380573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.381075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.383560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:02.386997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.388792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.395948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98f64d00-97ce-44d3-bf1b-7dcc7a9bba1a tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1309 microversion: 2.1 time: 0.270267 Apr 09 21:04:02.396559 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1302/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:02 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1309 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:02.414731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:02.416878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:02.432639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.433157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.433985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.434425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.618675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:02.629085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f2d6ed3-d50f-4395-8c19-91d79baad549 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1280 microversion: 2.1 time: 0.306302 Apr 09 21:04:02.639233 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1260/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:02 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:02.644476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:02.645496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:02.651766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.652499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.653517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:02.654133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:02.972863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:02.982145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b33e13c6-4765-44d6-b796-d5418d691d45 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.583208 Apr 09 21:04:02.993598 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1303/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:02 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:02.998636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:03.000157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:03.007755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.009028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.010460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.011126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.051830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:03.064083 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad45a8a4-9e07-4656-b740-d5f9738e47e7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1528 microversion: 2.1 time: 0.419341 Apr 09 21:04:03.064710 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1261/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:02 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1528 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:03.372528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:03.385403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c21ddeb5-0e36-458a-ad7c-c761281f751f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1574 microversion: 2.1 time: 0.390545 Apr 09 21:04:03.387567 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1304/2565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:02 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1574 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:03.414025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:03.414918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:03.421572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.422492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.423452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.424164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.477543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.477664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.478045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lazy-loading 'fault' on Instance uuid 6c778043-533a-46e6-904e-6149ad1af0a9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:03.547769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35025c6fdf024e8ea7d8d53db1a3974c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5f53583b7444188c705ed472c3cf06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:03.561194 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-346a7cfe-43a5-43c6-963c-4bfa35984a36 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 200 len: 1309 microversion: 2.1 time: 0.151199 Apr 09 21:04:03.562060 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1262/2566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:03 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:03.646493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:03.647090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:03.653101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.653781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.654740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:03.655337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:03.746853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:03.767647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-754c8eb3-7ea3-4147-9784-352f8b99e86b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1278 microversion: 2.1 time: 0.124604 Apr 09 21:04:03.769022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1305/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:03 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:04.000256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:04.001457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:04.041913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.043117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.046170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.047983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.084637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:04.085600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:04.097761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.102684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.103662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.105481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.465103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:04.474467 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-71c3810f-fb10-413f-9fc7-a80f73f45bdd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.478216 Apr 09 21:04:04.475063 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1263/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:03 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:04.490382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-775c2c3b-a96e-4ea8-85a4-204ee6e0e067 req-64b7e98d-f750-41ff-a67c-c88f4a4a1e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667511c-c0e4-4a11-8440-927a5977f82e", "name": "network-vif-unplugged", "status": "completed", "tag": "4b939184-9908-4fe1-b2fd-2da6cdaa8901"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:04.508680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-775c2c3b-a96e-4ea8-85a4-204ee6e0e067 req-64b7e98d-f750-41ff-a67c-c88f4a4a1e07 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.509162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-775c2c3b-a96e-4ea8-85a4-204ee6e0e067 req-64b7e98d-f750-41ff-a67c-c88f4a4a1e07 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.529068 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-775c2c3b-a96e-4ea8-85a4-204ee6e0e067 req-64b7e98d-f750-41ff-a67c-c88f4a4a1e07 service nova] Creating event network-vif-unplugged:4b939184-9908-4fe1-b2fd-2da6cdaa8901 for instance f667511c-c0e4-4a11-8440-927a5977f82e on nch2-master-1 Apr 09 21:04:04.535086 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-775c2c3b-a96e-4ea8-85a4-204ee6e0e067 req-64b7e98d-f750-41ff-a67c-c88f4a4a1e07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053815 Apr 09 21:04:04.536615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1264/2569] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:04.543600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:04.544509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:04.551286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.552137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.553256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.553918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.579299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:04.594793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f22e4ec-9c04-4a80-aa8d-53c453733a33 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1528 microversion: 2.1 time: 0.517000 Apr 09 21:04:04.597632 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1306/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:04 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1528 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:04.606726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:04.611034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] [instance: 6c778043-533a-46e6-904e-6149ad1af0a9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:04.626671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.629723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.633335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.634356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.654619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] HTTP exception thrown: Instance 6c778043-533a-46e6-904e-6149ad1af0a9 could not be found. Apr 09 21:04:04.655739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] Returning 404 to user: Instance 6c778043-533a-46e6-904e-6149ad1af0a9 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:04.657177 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc3622e7-4097-4bdb-8971-08aeccbeff79 tempest-LiveMigrationNegativeTest-1032568364 tempest-LiveMigrationNegativeTest-1032568364-project] 10.222.0.30 "GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9" status: 404 len: 111 microversion: 2.1 time: 0.057616 Apr 09 21:04:04.658033 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1307/2571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:04 2022] GET /compute/v2.1/servers/6c778043-533a-46e6-904e-6149ad1af0a9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:04.786829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:04.788809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:04.808431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.811248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.813025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:04.816182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:04.989815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:04.999705 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8379bedd-62d4-4976-9860-a4e3354cb6df tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1574 microversion: 2.1 time: 0.460885 Apr 09 21:04:05.007014 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1265/2572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:04 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1574 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:05.114614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:05.127014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a979690-21ed-488c-a82d-b4b51ecff317 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.344742 Apr 09 21:04:05.128364 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1308/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:04 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:05.496957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:05.499337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:05.512640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:05.513642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:05.514474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:05.515224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:05.621294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:05.621871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:05.636543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:05.647266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:05.648690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:05.654295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.025611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:06.036484 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d331aae-04a5-46a6-974d-13641dab0bf2 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.545510 Apr 09 21:04:06.037709 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1266/2574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:05 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:06.046356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-37534778-c4f2-4cd6-b78e-23d4d547709a req-3b0f22fb-ced5-44d3-9435-3c1309da2d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490c11f8-8cc8-452d-8186-9b860d1e926d", "tag": "af7a7ae8-fef2-4586-8969-b2574e026722"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:06.075361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-37534778-c4f2-4cd6-b78e-23d4d547709a req-3b0f22fb-ced5-44d3-9435-3c1309da2d3d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.076327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-37534778-c4f2-4cd6-b78e-23d4d547709a req-3b0f22fb-ced5-44d3-9435-3c1309da2d3d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.105405 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-37534778-c4f2-4cd6-b78e-23d4d547709a req-3b0f22fb-ced5-44d3-9435-3c1309da2d3d service nova] Creating event network-changed:af7a7ae8-fef2-4586-8969-b2574e026722 for instance 490c11f8-8cc8-452d-8186-9b860d1e926d on nch1-master-1 Apr 09 21:04:06.111468 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-37534778-c4f2-4cd6-b78e-23d4d547709a req-3b0f22fb-ced5-44d3-9435-3c1309da2d3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072164 Apr 09 21:04:06.112949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1267/2575] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:06.130200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:06.131296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:06.140871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.141697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.142893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.143569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.582413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:06.592096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69cda46a-4666-4d98-9b3f-ff988620e697 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 200 len: 1528 microversion: 2.1 time: 0.982525 Apr 09 21:04:06.604993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1309/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:05 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 1528 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:06.610372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:06.611251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:06.618203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.618970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.619843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.620766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.848975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:06.857774 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06f6e3c3-e327-44d1-9244-fbda17f8bcb3 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1579 microversion: 2.1 time: 0.738739 Apr 09 21:04:06.866726 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1268/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:06 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1579 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:06.885838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-389a979f-6a6f-45bf-9a6a-3e94b847b06f req-7ac61ade-b68e-4cd9-9679-c7eefa94648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667511c-c0e4-4a11-8440-927a5977f82e", "name": "network-vif-deleted", "tag": "4b939184-9908-4fe1-b2fd-2da6cdaa8901"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:06.918822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-389a979f-6a6f-45bf-9a6a-3e94b847b06f req-7ac61ade-b68e-4cd9-9679-c7eefa94648b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:06.919401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-389a979f-6a6f-45bf-9a6a-3e94b847b06f req-7ac61ade-b68e-4cd9-9679-c7eefa94648b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:06.951940 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-389a979f-6a6f-45bf-9a6a-3e94b847b06f req-7ac61ade-b68e-4cd9-9679-c7eefa94648b service nova] Creating event network-vif-deleted:4b939184-9908-4fe1-b2fd-2da6cdaa8901 for instance f667511c-c0e4-4a11-8440-927a5977f82e on nch2-master-1 Apr 09 21:04:06.973106 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-389a979f-6a6f-45bf-9a6a-3e94b847b06f req-7ac61ade-b68e-4cd9-9679-c7eefa94648b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091113 Apr 09 21:04:06.975982 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1269/2578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:06.998763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-838bc2ee-61b3-4c0f-ba5a-7103ce644623 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eea3af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:07.063754 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-838bc2ee-61b3-4c0f-ba5a-7103ce644623 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64" status: 200 len: 661 microversion: 2.1 time: 0.082797 Apr 09 21:04:07.073459 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1270/2579] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:06 2022] GET /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64 => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:07.079934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:07.081141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:07.089151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.089971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:07.091099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.091866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:07.230877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:07.240682 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5889d307-abd7-4b2f-ba14-3c699f3e9a6e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.633570 Apr 09 21:04:07.248642 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1310/2580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:06 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:07.258821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fee07872-b195-417e-bae4-705b4bbc7379 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eaef700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:07.335015 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fee07872-b195-417e-bae4-705b4bbc7379 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64" status: 200 len: 661 microversion: 2.1 time: 0.084615 Apr 09 21:04:07.341503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:07.351168 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1311/2581] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:07 2022] GET /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64 => generated 661 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:07.355384 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00757bd5-cc23-4f6e-aab8-53633608162d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.280290 Apr 09 21:04:07.356116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1271/2582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:07 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:07.611951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:07.612562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:07.621486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.621932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:07.622719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.623151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:07.647977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. Apr 09 21:04:07.649006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:07.650170 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9779459-a493-4b86-8b02-a5e325b326da tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 404 len: 111 microversion: 2.1 time: 0.042228 Apr 09 21:04:07.651143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1312/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:07 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:07.765836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-460549848", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:07.834946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] validate_networks() for [('2acdcdfe-c4fc-46e9-aafe-ac2fc5194554', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:07.884989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:07.885833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:07.902099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.911958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:07.912978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:07.919484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.312732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:08.329725 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-396979ad-edbd-4354-966f-002cf100d834 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1572 microversion: 2.1 time: 0.449497 Apr 09 21:04:08.332792 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1313/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:07 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1572 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:08.341699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:08.342654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:08.352134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.353611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.354711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.355907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.784514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:08.785165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:08.785448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:08.785974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:08.786393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:08.804380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.804840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.805699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.806136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.837616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:08.850027 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff4a6669-bd99-4648-838b-28dfc152a263 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.513451 Apr 09 21:04:08.853590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1314/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:08 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:08.859579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:08.867122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1567399253"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:08.869684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:08.872269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Getting quotas for user f6869f687bd8411ea81a24f566fef6b2 and project ed5c4a7f5181441d9d3db5d4ed86133b. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:08.897447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.900250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.902022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:08.903385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:08.913967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:08.916317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:09.018313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7b53a94-49a3-45f6-932b-04e9a61f405f tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.257377 Apr 09 21:04:09.024133 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1272/2586] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:09.038553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:09.039192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:09.050804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:09.051102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:09.052319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:09.052768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:09.413817 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.network.security_group_api [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Adding security group a6d69725-e78f-4b27-99d7-6cc74447bf88 to port 9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac Apr 09 21:04:09.632076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:09.641522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6afe1750-b5ef-4a21-9322-65bae4849e3d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.616094 Apr 09 21:04:09.642191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1273/2587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:09 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:09.817524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9813898d-29bd-4ea8-8576-320eed8aaa9f tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] Calling method '.version_select at 0x7fb08efa2b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:10.111612 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9813898d-29bd-4ea8-8576-320eed8aaa9f tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 7393 microversion: 2.1 time: 0.468320 Apr 09 21:04:10.112218 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1274/2588] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:04:09 2022] GET /compute/v2.1/os-networks => generated 7393 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:10.120919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:10.121555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:10.127838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:10.128286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:10.129057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:10.129523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:10.205242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-16821155-5a39-4055-9313-0242564bd65f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action" status: 202 len: 0 microversion: 2.1 time: 1.350228 Apr 09 21:04:10.205868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1315/2589] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:04:08 2022] POST /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b/action => generated 0 bytes in 1352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:10.210822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84b4e3f0-d267-4b9e-a84d-4f70fb6e9ab7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef198b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:10.260863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:10.272413 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc05d9f2-3d68-4d95-a105-ec44a377d2b9 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1276 microversion: 2.1 time: 0.155149 Apr 09 21:04:10.273506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1275/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:10 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:10.283085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-84b4e3f0-d267-4b9e-a84d-4f70fb6e9ab7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac" status: 200 len: 662 microversion: 2.1 time: 0.075904 Apr 09 21:04:10.295478 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1316/2591] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:10 2022] GET /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:10.301412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:10.302396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:10.310587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:10.311253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:10.312243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:10.312881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:10.374177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5208039f-dcda-4591-9968-6e2b9d30971f tempest-FloatingIPDetailsNegativeTestJSON-459803232 tempest-FloatingIPDetailsNegativeTestJSON-459803232-project] Calling method '.version_select at 0x7fb08ef89dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:10.424566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-5208039f-dcda-4591-9968-6e2b9d30971f tempest-FloatingIPDetailsNegativeTestJSON-459803232 tempest-FloatingIPDetailsNegativeTestJSON-459803232-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fd6961fc-c656-48c9-b6a7-bfe3c645d3e9 could not be found", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:10.425650 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-5208039f-dcda-4591-9968-6e2b9d30971f tempest-FloatingIPDetailsNegativeTestJSON-459803232 tempest-FloatingIPDetailsNegativeTestJSON-459803232-project] HTTP exception thrown: Floating IP not found for ID fd6961fc-c656-48c9-b6a7-bfe3c645d3e9 Apr 09 21:04:10.426469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5208039f-dcda-4591-9968-6e2b9d30971f tempest-FloatingIPDetailsNegativeTestJSON-459803232 tempest-FloatingIPDetailsNegativeTestJSON-459803232-project] Returning 404 to user: Floating IP not found for ID fd6961fc-c656-48c9-b6a7-bfe3c645d3e9 {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:10.427300 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5208039f-dcda-4591-9968-6e2b9d30971f tempest-FloatingIPDetailsNegativeTestJSON-459803232 tempest-FloatingIPDetailsNegativeTestJSON-459803232-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/fd6961fc-c656-48c9-b6a7-bfe3c645d3e9" status: 404 len: 111 microversion: 2.1 time: 0.152708 Apr 09 21:04:10.427874 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1276/2592] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:04:10 2022] GET /compute/v2.1/os-floating-ips/fd6961fc-c656-48c9-b6a7-bfe3c645d3e9 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:10.459159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e109e833-354c-448d-b310-f4d69388858f tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] Calling method '.version_select at 0x7fb08ef814c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.018526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:11.034578 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b834dd1-3729-4c6a-8aa0-57bbc8a58668 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.737210 Apr 09 21:04:11.036694 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1317/2593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:10 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:11.044453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8707459c-80f7-40ce-9a5d-4402d536db2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ef19c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.055471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e109e833-354c-448d-b310-f4d69388858f tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/bae95fbb-2739-43fa-b1ef-385638f6c878" status: 200 len: 652 microversion: 2.1 time: 0.623301 Apr 09 21:04:11.061871 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1277/2594] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:04:10 2022] GET /compute/v2.1/os-networks/bae95fbb-2739-43fa-b1ef-385638f6c878 => generated 652 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:11.071801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-983316fa-52ed-444b-9441-b70886106c7c req-5e645d03-afc3-41a7-b53f-dbbc0f7098b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90cdbf3-35f5-4442-933c-e8875ca0542b", "tag": "9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:11.087318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-983316fa-52ed-444b-9441-b70886106c7c req-5e645d03-afc3-41a7-b53f-dbbc0f7098b7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.097605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-983316fa-52ed-444b-9441-b70886106c7c req-5e645d03-afc3-41a7-b53f-dbbc0f7098b7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.110504 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-983316fa-52ed-444b-9441-b70886106c7c req-5e645d03-afc3-41a7-b53f-dbbc0f7098b7 service nova] Creating event network-changed:9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac for instance c90cdbf3-35f5-4442-933c-e8875ca0542b on nch2-master-1 Apr 09 21:04:11.117084 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-983316fa-52ed-444b-9441-b70886106c7c req-5e645d03-afc3-41a7-b53f-dbbc0f7098b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053570 Apr 09 21:04:11.121827 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1278/2595] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:11.127583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ecd3933-e6a4-4a18-b8ba-c5dfb48cf58f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef81790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.175985 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ecd3933-e6a4-4a18-b8ba-c5dfb48cf58f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac" status: 200 len: 662 microversion: 2.1 time: 0.052645 Apr 09 21:04:11.176748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1279/2596] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:11 2022] GET /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:11.197962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.198829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:11.210918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.212584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.214251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.215420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.399012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-8707459c-80f7-40ce-9a5d-4402d536db2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a6d69725-e78f-4b27-99d7-6cc74447bf88 in use.", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:11.399707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8707459c-80f7-40ce-9a5d-4402d536db2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security Group a6d69725-e78f-4b27-99d7-6cc74447bf88 in use. Apr 09 21:04:11.399707 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-e24a8956-f83a-493b-b6a4-9da9fd1d466f'] Apr 09 21:04:11.400710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8707459c-80f7-40ce-9a5d-4402d536db2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 400 to user: Security Group a6d69725-e78f-4b27-99d7-6cc74447bf88 in use. Apr 09 21:04:11.400710 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-e24a8956-f83a-493b-b6a4-9da9fd1d466f'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:11.401875 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8707459c-80f7-40ce-9a5d-4402d536db2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88" status: 400 len: 185 microversion: 2.1 time: 0.363204 Apr 09 21:04:11.402925 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1318/2597] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:11 2022] DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88 => generated 185 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:04:11.408439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-389d45ec-5b62-438c-9ff1-b91d6b6ba782 tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] Calling method '.version_select at 0x7fb08ee629d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.557711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:11.566531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c7d9087-5ae4-4d70-b9b8-0e2b8b47c324 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.388305 Apr 09 21:04:11.577424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1280/2598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:11 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:11.582937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.583917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:11.591613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.592958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.594500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.595176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.705262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-389d45ec-5b62-438c-9ff1-b91d6b6ba782 tempest-NetworksTest-1657486512 tempest-NetworksTest-1657486512-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 7393 microversion: 2.1 time: 0.300098 Apr 09 21:04:11.712921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1319/2599] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:04:11 2022] GET /compute/v2.1/os-networks => generated 7393 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:11.720315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:11.722100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:11.730437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.733613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.735362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:11.736401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:11.778073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:11.954274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:11.977094 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-941336fc-8b6f-4658-b89e-e023cb02576b tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 0.397301 Apr 09 21:04:11.983703 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1281/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:11 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:12.000246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9c70475-5d0c-435e-a0f8-ee86d2df0a66 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 204 len: 0 microversion: 2.1 time: 0.284743 Apr 09 21:04:12.013211 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1320/2601] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:11 2022] DELETE /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:12.013648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:12.017599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:12.035333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.038477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.042586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.043464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.058182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:12.059954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:12.079383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.081330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.083311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.086039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.482506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:12.494712 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-560ef8ec-0dcd-4f8f-855b-cd3f6e3ae7a1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.445344 Apr 09 21:04:12.495320 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1321/2602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:12 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:12.503021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:12.511697 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-031d2061-1dd5-42ff-990d-a5c31c29992c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1647 microversion: 2.1 time: 0.504500 Apr 09 21:04:12.521231 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1282/2603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:12 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1647 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:12.584560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:12.586294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:12.599456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.600911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.602024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:12.604362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:12.964651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70acdc4b-0257-4e45-97c2-ca54ac750d8b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08f0a4d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:13.028822 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70acdc4b-0257-4e45-97c2-ca54ac750d8b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d" status: 200 len: 662 microversion: 2.1 time: 0.068596 Apr 09 21:04:13.037804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1283/2604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:12 2022] GET /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:13.043257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:13.044116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:13.052977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.055787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.056722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.057677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.257225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:13.264953 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-507d5418-354e-4de0-b019-98ff1189a67d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.684443 Apr 09 21:04:13.269793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1322/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:12 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:13.279444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7f90d7fa-b567-4f1c-9f71-3a098f359ea3 req-958ada1f-d5ff-49e8-9af5-b850f2f288df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbde0439-8c37-47c0-9c32-ca5152679302", "tag": "7e8c197f-7833-4616-9703-c66566894b07"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:13.295659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f90d7fa-b567-4f1c-9f71-3a098f359ea3 req-958ada1f-d5ff-49e8-9af5-b850f2f288df service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.296527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f90d7fa-b567-4f1c-9f71-3a098f359ea3 req-958ada1f-d5ff-49e8-9af5-b850f2f288df service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.311860 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7f90d7fa-b567-4f1c-9f71-3a098f359ea3 req-958ada1f-d5ff-49e8-9af5-b850f2f288df service nova] Creating event network-changed:7e8c197f-7833-4616-9703-c66566894b07 for instance cbde0439-8c37-47c0-9c32-ca5152679302 on nch2-master-1 Apr 09 21:04:13.318845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7f90d7fa-b567-4f1c-9f71-3a098f359ea3 req-958ada1f-d5ff-49e8-9af5-b850f2f288df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047472 Apr 09 21:04:13.320059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1323/2606] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:13.329285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-275732b3-10e0-4c75-b7f9-40d8497dfaef req-b9d1be59-c05b-4074-9b09-c27a263117f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490c11f8-8cc8-452d-8186-9b860d1e926d", "name": "network-vif-plugged", "status": "completed", "tag": "af7a7ae8-fef2-4586-8969-b2574e026722"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:13.342309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-275732b3-10e0-4c75-b7f9-40d8497dfaef req-b9d1be59-c05b-4074-9b09-c27a263117f0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.343450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-275732b3-10e0-4c75-b7f9-40d8497dfaef req-b9d1be59-c05b-4074-9b09-c27a263117f0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.359354 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-275732b3-10e0-4c75-b7f9-40d8497dfaef req-b9d1be59-c05b-4074-9b09-c27a263117f0 service nova] Creating event network-vif-plugged:af7a7ae8-fef2-4586-8969-b2574e026722 for instance 490c11f8-8cc8-452d-8186-9b860d1e926d on nch1-master-1 Apr 09 21:04:13.364591 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-275732b3-10e0-4c75-b7f9-40d8497dfaef req-b9d1be59-c05b-4074-9b09-c27a263117f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042264 Apr 09 21:04:13.366316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1324/2607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:13.375773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a66197bc-ac83-470b-8d71-7ac6892a7e10 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef7f9d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:13.471159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a66197bc-ac83-470b-8d71-7ac6892a7e10 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d" status: 200 len: 662 microversion: 2.1 time: 0.103409 Apr 09 21:04:13.475514 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1325/2608] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:13 2022] GET /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:13.512297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:13.513173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:13.521116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.522013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.525872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:13.535701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.537178 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f1d4396-52cb-4cd6-b89e-1437f9b0fcb8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 0.497921 Apr 09 21:04:13.537884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.539184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1284/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:13 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:13.546790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:13.549206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:13.565624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.566312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:13.569865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:13.570529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.101750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:14.112208 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff1b49fe-62c4-4c63-9a6b-8e63dc82c403 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1320 microversion: 2.1 time: 0.604169 Apr 09 21:04:14.112817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1326/2610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:13 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:14.121170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-268079031", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:14.203211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:14.223923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:14.233748 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bbc71aac-4456-47ef-bbb7-eaeb6f210aff tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1647 microversion: 2.1 time: 0.692223 Apr 09 21:04:14.234732 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1285/2611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:13 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1647 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:14.292083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:14.292912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:14.299972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.300913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.302023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.304995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.724841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:14.751916 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb0fe68f-6b85-4c83-bdc1-18e8adbb935c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.469582 Apr 09 21:04:14.752568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1286/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:14 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:14.775795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:14.776508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:14.778057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:14.780008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:14.780769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:14.782467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:14.783553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:14.784992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.785784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.786748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.787348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.804440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.806055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.807429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:14.812314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:14.837690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Getting quotas for project 1e2f7aa3f0c94253b265693d30844fd0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:14.845442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Getting quotas for user 5fe69df11b2846f99843c4883a067021 and project 1e2f7aa3f0c94253b265693d30844fd0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:14.862820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:14.865778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:14.983762 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18d9a37a-22ca-47b7-8526-c5f686d11abe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868040 Apr 09 21:04:14.986863 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1327/2613] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:15.130457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:15.131542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:15.161204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:15.163499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:15.166022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:15.172766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:15.782252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:15.792035 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6eb82b6d-61c3-47cd-b714-16cff41e5258 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1500 microversion: 2.1 time: 0.666170 Apr 09 21:04:15.796028 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1328/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:15 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1500 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:15.801414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:15.810315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e7fb5d6-5646-4838-bf87-4a6d2208e0b8 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 1.041358 Apr 09 21:04:15.815230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-694482565", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:15.831085 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1287/2615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:14 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:15.836463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:15.837120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:15.844448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:15.845603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:15.852629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:15.855932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:15.919884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:15.951759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:15.961159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b34cf632-aea9-4a5a-b706-e59960af9476 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 200 len: 1468 microversion: 2.1 time: 0.128864 Apr 09 21:04:15.962069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1288/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:15 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 1468 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:15.967860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-123bc797-04fb-44c0-90f5-0a5fa594c125 req-24b4d7d8-4725-4fa7-9604-376ab5ef9515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90cdbf3-35f5-4442-933c-e8875ca0542b", "name": "network-vif-deleted", "tag": "9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:15.977521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-123bc797-04fb-44c0-90f5-0a5fa594c125 req-24b4d7d8-4725-4fa7-9604-376ab5ef9515 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:15.978223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-123bc797-04fb-44c0-90f5-0a5fa594c125 req-24b4d7d8-4725-4fa7-9604-376ab5ef9515 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:15.994348 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-123bc797-04fb-44c0-90f5-0a5fa594c125 req-24b4d7d8-4725-4fa7-9604-376ab5ef9515 service nova] Creating event network-vif-deleted:9a36a3c1-69b3-4732-a3c0-fe7bed4c05ac for instance c90cdbf3-35f5-4442-933c-e8875ca0542b on nch2-master-1 Apr 09 21:04:16.000364 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-123bc797-04fb-44c0-90f5-0a5fa594c125 req-24b4d7d8-4725-4fa7-9604-376ab5ef9515 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Apr 09 21:04:16.001364 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1289/2617] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:16.007522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:16.008553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:16.016584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.017338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.019887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.020558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.485121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:16.492805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a48e2bf5-7e58-4eca-b204-635d2e071422 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1470 microversion: 2.1 time: 0.490017 Apr 09 21:04:16.493479 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1290/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:16 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1470 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:16.500286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:16.500918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:16.507417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.508163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.509263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.509868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.525659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:16.526384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:16.526965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:16.527472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:16.528106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:16.549644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.550178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.551118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.551619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.574442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Getting quotas for project 1e2f7aa3f0c94253b265693d30844fd0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:16.579447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Getting quotas for user 5fe69df11b2846f99843c4883a067021 and project 1e2f7aa3f0c94253b265693d30844fd0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:16.597914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:16.600463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:16.655535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a12b0d9-17f6-478f-9377-c577f4500746 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849701 Apr 09 21:04:16.661183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1329/2619] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:16.912789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:16.938454 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-511efdff-34d7-4d31-8229-0eade3aac4fc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1500 microversion: 2.1 time: 0.440324 Apr 09 21:04:16.939908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b7d6a0a-22e7-4a9e-9eb3-bbfc0f88a001 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] Calling method '.version_select at 0x7fb08eae68b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:16.941189 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1291/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:16 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1500 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:16.950442 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:04:16.950442 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:04:16.959019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-23f7cf40-5166-40b0-9a7c-3a9cc3b2c7f1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:16.966687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-23f7cf40-5166-40b0-9a7c-3a9cc3b2c7f1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:16.977928 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b7d6a0a-22e7-4a9e-9eb3-bbfc0f88a001 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.314990 Apr 09 21:04:16.978842 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1330/2621] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 21:04:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:16.983711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:16.984557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:16.994566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.995843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:16.996927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:16.997686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.162495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-23f7cf40-5166-40b0-9a7c-3a9cc3b2c7f1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:17.170422 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-23f7cf40-5166-40b0-9a7c-3a9cc3b2c7f1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1217 microversion: 2.1 time: 0.226107 Apr 09 21:04:17.173656 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1292/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:16 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:17.188039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:17.196155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:17.215515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.216615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.217535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.234345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.299209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:17.505767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:17.513616 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ddcf1e0-eac7-459b-89fb-9b15adfbefdb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 0.533710 Apr 09 21:04:17.515908 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1331/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:16 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:17.527055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:17.531605 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c1b07e6-a098-4c8e-a72c-b16258a272da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 204 len: 0 microversion: 2.1 time: 0.346547 Apr 09 21:04:17.532296 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1293/2624] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:17 2022] DELETE /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:17.536847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:17.539114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-27c7cc8b-ebfd-4cfa-b89c-92f9753332ad tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] Action: 'update', calling method: .version_select at 0x7fb08f50cd30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:17.541263 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:04:17.541263 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:04:17.557666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.558955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.560349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.563588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.590020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. Apr 09 21:04:17.590720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:17.591910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b686fb93-d237-457d-8685-9e361b0bb94e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 404 len: 111 microversion: 2.1 time: 0.074042 Apr 09 21:04:17.592697 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1332/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:17 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:17.599272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:17.600253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:17.607597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.608362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.609519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.610192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.856437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:17.869381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe619201-211f-42dc-8fdf-8f7457f20f4c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.274842 Apr 09 21:04:17.874461 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1333/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:17 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:17.883794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-27c7cc8b-ebfd-4cfa-b89c-92f9753332ad tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.342456 Apr 09 21:04:17.883794 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1294/2627] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Apr 9 21:04:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:17.885912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:17.890320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0769a076-76a7-475f-b847-5e2aa85749ee tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ef89dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:17.893461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:17.900727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.901562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:17.902538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:17.903238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.127571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:18.136708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57e3cb7b-7ec6-466a-a6ea-46bc92bdff15 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1506 microversion: 2.1 time: 0.258857 Apr 09 21:04:18.140877 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1334/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:17 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:18.156397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1c70f75-61ca-4709-8191-871ccb894c96 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] Calling method '.version_select at 0x7fb08eadce50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:18.160278 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:04:18.160278 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:04:18.184279 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1c70f75-61ca-4709-8191-871ccb894c96 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041878 Apr 09 21:04:18.190025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1335/2629] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 21:04:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:18.207415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:18.208571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:18.215532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.216227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.218184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.219550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.229369 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0769a076-76a7-475f-b847-5e2aa85749ee tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037" status: 202 len: 0 microversion: 2.1 time: 0.345796 Apr 09 21:04:18.230027 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1295/2630] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:17 2022] DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:18.234430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c8c9770-9ebb-4fb7-8c35-5ed837a06846 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] Action: 'update', calling method: .version_select at 0x7fb08eeb5280>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:18.365418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:18.379840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e0fa32d0-ab02-4be5-b0bc-9d6360ac19a9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1277 microversion: 2.1 time: 0.188516 Apr 09 21:04:18.380439 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1336/2631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:18 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:18.388964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8bb1337e-4275-4d88-8f61-707850e29ff9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee6e4c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:18.455015 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0c8c9770-9ebb-4fb7-8c35-5ed837a06846 tempest-QuotaClassesAdminTestJSON-477363776 tempest-QuotaClassesAdminTestJSON-477363776-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.223749 Apr 09 21:04:18.464569 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1296/2632] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Apr 9 21:04:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:18.471579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-02c3f9c8-e49b-4c0d-b10e-b4ea8a718c0a req-37a2fe3f-1a93-433c-9b8f-93ac9d0eaa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde0439-8c37-47c0-9c32-ca5152679302", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c197f-7833-4616-9703-c66566894b07"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:18.483571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-02c3f9c8-e49b-4c0d-b10e-b4ea8a718c0a req-37a2fe3f-1a93-433c-9b8f-93ac9d0eaa67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.486798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-02c3f9c8-e49b-4c0d-b10e-b4ea8a718c0a req-37a2fe3f-1a93-433c-9b8f-93ac9d0eaa67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.502565 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-02c3f9c8-e49b-4c0d-b10e-b4ea8a718c0a req-37a2fe3f-1a93-433c-9b8f-93ac9d0eaa67 service nova] Creating event network-vif-plugged:7e8c197f-7833-4616-9703-c66566894b07 for instance cbde0439-8c37-47c0-9c32-ca5152679302 on nch2-master-1 Apr 09 21:04:18.509085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-02c3f9c8-e49b-4c0d-b10e-b4ea8a718c0a req-37a2fe3f-1a93-433c-9b8f-93ac9d0eaa67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043402 Apr 09 21:04:18.509907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1297/2633] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:18.547561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:18.551289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:18.568996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.571049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.571946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.572617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.889816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:18.897511 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87e67d3c-d4ff-4033-8ed0-daa824e91dbf tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 0.365856 Apr 09 21:04:18.907029 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1298/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:18 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:18.912357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:18.913476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:18.919292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.919591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.920386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:18.920831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:18.967550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8bb1337e-4275-4d88-8f61-707850e29ff9 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88" status: 202 len: 0 microversion: 2.1 time: 0.586035 Apr 09 21:04:18.968151 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1337/2635] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:18 2022] DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88 => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:18.983701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7281a891-8166-434b-9a78-b78c244ee000 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'create', calling method: .version_select at 0x7fb08eb6af70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2007062203", "description": "tempest-description-1999629935"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:19.393854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:19.403891 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1565da31-e460-4a66-8dfd-63d192243b24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.495489 Apr 09 21:04:19.405174 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1299/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:18 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:19.410692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:19.411555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:19.419328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:19.419959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:19.421119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:19.421720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:19.674933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7281a891-8166-434b-9a78-b78c244ee000 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.696171 Apr 09 21:04:19.683633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1338/2637] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:04:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:19.689562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:19.690467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:19.698958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:19.699685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:19.700664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:19.701312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:19.743745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:19.753519 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-452e2899-7e05-457a-8130-e6d7e8fa4980 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1506 microversion: 2.1 time: 0.346921 Apr 09 21:04:19.754896 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1300/2638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:19 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:19.760348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92f13094-fe79-45d1-ac43-f1280babb45e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Action: 'update', calling method: .version_select at 0x7fb08eeb5790>, body: {"security_group": {"name": "tempest-sg-hth-1021511779", "description": "tempest-description-hth-1798866230"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:20.159709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:20.170350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0286e763-0d43-4ed1-8835-2d1c64e05e20 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.484292 Apr 09 21:04:20.174451 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1339/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:19 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:20.194291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:20.196185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:20.231664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:20.232900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:20.234002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:20.234672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:20.311375 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92f13094-fe79-45d1-ac43-f1280babb45e tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d" status: 200 len: 218 microversion: 2.1 time: 0.555154 Apr 09 21:04:20.312310 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1301/2640] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Apr 9 21:04:19 2022] PUT /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d => generated 218 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:20.693383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-11da09e0-fd15-46a6-8470-9f84ed19f819 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] Calling method '.version_select at 0x7fb08efc23a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:20.751082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-11da09e0-fd15-46a6-8470-9f84ed19f819 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] 10.222.0.30 "GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36" status: 200 len: 784 microversion: 2.1 time: 0.437515 Apr 09 21:04:20.751703 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1302/2641] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:20 2022] GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36 => generated 784 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:20.774287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-168ea474-5942-4da5-b194-852171636697 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08eeb5dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:20.799872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:20.821589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69f89e36-4362-47be-afbd-97b927d10a4c tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1324 microversion: 2.1 time: 0.633262 Apr 09 21:04:20.823403 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1340/2642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:20 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:20.828912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6ebcef7b-1da1-445d-bc4d-94fc4834f888 req-6894724d-41e3-49c4-9483-81cf485cae62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:20.845304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6ebcef7b-1da1-445d-bc4d-94fc4834f888 req-6894724d-41e3-49c4-9483-81cf485cae62 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:20.846046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6ebcef7b-1da1-445d-bc4d-94fc4834f888 req-6894724d-41e3-49c4-9483-81cf485cae62 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:20.865415 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6ebcef7b-1da1-445d-bc4d-94fc4834f888 req-6894724d-41e3-49c4-9483-81cf485cae62 service nova] Creating event network-changed:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:04:20.874385 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6ebcef7b-1da1-445d-bc4d-94fc4834f888 req-6894724d-41e3-49c4-9483-81cf485cae62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048995 Apr 09 21:04:20.875553 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1341/2643] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:20.881973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:20.882937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:20.893108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:20.893838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:20.895268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:20.895893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:21.094436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-168ea474-5942-4da5-b194-852171636697 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d" status: 200 len: 218 microversion: 2.1 time: 0.323522 Apr 09 21:04:21.095197 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1303/2644] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:04:20 2022] GET /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d => generated 218 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:21.102850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cea14673-5580-4e73-a15d-92c3e9cc9394 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] Calling method '.version_select at 0x7fb08f1618b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:21.188276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cea14673-5580-4e73-a15d-92c3e9cc9394 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.091391 Apr 09 21:04:21.189198 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1304/2645] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:21 2022] GET /compute/v2.1/images => generated 445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:21.194682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:21.196027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:21.204885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:21.205645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:21.206943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:21.207920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:21.416007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:21.431455 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34c9dda5-6d4b-46d4-820c-a9a96e9f3110 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.553832 Apr 09 21:04:21.432667 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1342/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:20 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:21.449170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dac0f029-b149-47c6-98c0-0686b5c56298 req-4fd15a2c-0fce-4fe6-a89c-fcec658a5b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-unplugged", "status": "completed", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:21.469613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dac0f029-b149-47c6-98c0-0686b5c56298 req-4fd15a2c-0fce-4fe6-a89c-fcec658a5b06 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:21.470777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dac0f029-b149-47c6-98c0-0686b5c56298 req-4fd15a2c-0fce-4fe6-a89c-fcec658a5b06 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:21.487429 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dac0f029-b149-47c6-98c0-0686b5c56298 req-4fd15a2c-0fce-4fe6-a89c-fcec658a5b06 service nova] Creating event network-vif-unplugged:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:04:21.493215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dac0f029-b149-47c6-98c0-0686b5c56298 req-4fd15a2c-0fce-4fe6-a89c-fcec658a5b06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058911 Apr 09 21:04:21.494375 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1343/2647] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:21.501227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1907e37e-c1a1-463f-9c51-93844e06d9c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee621f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:21.688364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:21.697669 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ea8c14d-c818-4629-9cae-4b6822500ffc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 200 len: 1506 microversion: 2.1 time: 0.506825 Apr 09 21:04:21.699670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1305/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:21 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:21.705932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:21.707263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:21.714685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:21.715466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:21.716861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:21.717633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.023811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:22.036266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-60b03d47-6f4e-4daf-aea5-521d66d17b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.335177 Apr 09 21:04:22.037895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1306/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:21 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:22.046490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c92bfdb-a080-49b6-9515-398f649ebca0 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] Calling method '.version_select at 0x7fb08f017310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.083527 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1907e37e-c1a1-463f-9c51-93844e06d9c5 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d" status: 202 len: 0 microversion: 2.1 time: 0.587509 Apr 09 21:04:22.085603 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1344/2650] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:21 2022] DELETE /compute/v2.1/os-security-groups/71a7c0a8-e57c-485a-9279-6040c9a03b8d => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:22.092488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-227a3571-6458-4038-b497-2bf18838654b req-1ea5d749-36e9-4a01-a7ab-01bfb1213df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490c11f8-8cc8-452d-8186-9b860d1e926d", "name": "network-vif-deleted", "tag": "af7a7ae8-fef2-4586-8969-b2574e026722"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:22.103743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-227a3571-6458-4038-b497-2bf18838654b req-1ea5d749-36e9-4a01-a7ab-01bfb1213df9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.104401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-227a3571-6458-4038-b497-2bf18838654b req-1ea5d749-36e9-4a01-a7ab-01bfb1213df9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.129902 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c92bfdb-a080-49b6-9515-398f649ebca0 tempest-ListImagesTestJSON-1710300723 tempest-ListImagesTestJSON-1710300723-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.090524 Apr 09 21:04:22.130948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-227a3571-6458-4038-b497-2bf18838654b req-1ea5d749-36e9-4a01-a7ab-01bfb1213df9 service nova] Creating event network-vif-deleted:af7a7ae8-fef2-4586-8969-b2574e026722 for instance 490c11f8-8cc8-452d-8186-9b860d1e926d on nch1-master-1 Apr 09 21:04:22.139935 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1307/2651] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:04:22 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:22.146413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.147211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.154027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.154762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.155730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.156335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.173188 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-227a3571-6458-4038-b497-2bf18838654b req-1ea5d749-36e9-4a01-a7ab-01bfb1213df9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073347 Apr 09 21:04:22.176316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1345/2652] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:22.200249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.200850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.220996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.224765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.225819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.229611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.271348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. Apr 09 21:04:22.271983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:22.272840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1357cbb4-75e0-41ec-b933-9443e46395ab tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 404 len: 111 microversion: 2.1 time: 0.093735 Apr 09 21:04:22.276508 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1346/2653] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:22 2022] DELETE /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:22.291253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.294141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: c90cdbf3-35f5-4442-933c-e8875ca0542b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.304325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.304774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.311772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.312552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.335882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. Apr 09 21:04:22.336765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Instance c90cdbf3-35f5-4442-933c-e8875ca0542b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:22.337996 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ea6281d-8544-4bcc-9873-f1ad22e2f865 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b" status: 404 len: 111 microversion: 2.1 time: 0.056126 Apr 09 21:04:22.338967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1347/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:22 2022] GET /compute/v2.1/servers/c90cdbf3-35f5-4442-933c-e8875ca0542b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:22.348394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08e47d310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.729914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a6d69725-e78f-4b27-99d7-6cc74447bf88 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:22.730894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group a6d69725-e78f-4b27-99d7-6cc74447bf88 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:22.731610 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group a6d69725-e78f-4b27-99d7-6cc74447bf88 does not exist Apr 09 21:04:22.731610 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-947ff9a0-c04d-434c-b90f-72c2ea1e5121'] Apr 09 21:04:22.732588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group a6d69725-e78f-4b27-99d7-6cc74447bf88 does not exist Apr 09 21:04:22.732588 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-947ff9a0-c04d-434c-b90f-72c2ea1e5121'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:22.733729 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17c84e3d-191f-4a2a-b5a8-193366c8a107 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88" status: 404 len: 194 microversion: 2.1 time: 0.390603 Apr 09 21:04:22.734977 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1348/2655] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:22 2022] DELETE /compute/v2.1/os-security-groups/a6d69725-e78f-4b27-99d7-6cc74447bf88 => generated 194 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:22.739836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.742295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.758107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.758479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.759275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.759710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.824559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:22.835797 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-29cbf6ba-a533-4a97-a09c-85854b673e01 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1521 microversion: 2.1 time: 0.694483 Apr 09 21:04:22.837515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1308/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:22 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:22.844181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.846505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.877897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.878614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.879859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.880550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.898846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. Apr 09 21:04:22.899651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:22.900874 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7cbbdd4-aaa0-41ba-ac7e-1ad92c6e30d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 404 len: 111 microversion: 2.1 time: 0.061862 Apr 09 21:04:22.901787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1309/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:22 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:22.913668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee49040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.960937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd64af9c-f183-4ef0-8190-a444a7c21037 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:22.961918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group dd64af9c-f183-4ef0-8190-a444a7c21037 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:22.962515 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group dd64af9c-f183-4ef0-8190-a444a7c21037 does not exist Apr 09 21:04:22.962515 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-953c890a-f33b-4f5a-8025-dae127eaeb93'] Apr 09 21:04:22.963189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group dd64af9c-f183-4ef0-8190-a444a7c21037 does not exist Apr 09 21:04:22.963189 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-953c890a-f33b-4f5a-8025-dae127eaeb93'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:22.964135 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30c7d6aa-39be-49a9-aa7f-c4868031ad57 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037" status: 404 len: 194 microversion: 2.1 time: 0.060398 Apr 09 21:04:22.964769 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1310/2658] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:22 2022] DELETE /compute/v2.1/os-security-groups/dd64af9c-f183-4ef0-8190-a444a7c21037 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:22.975218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:22.976817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:22.989136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.989601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:22.990408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:22.990855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.015993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:23.019126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:23.027614 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7a4937f-f9c0-4fa2-a913-9033e0b381ac tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.289293 Apr 09 21:04:23.027614 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1349/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:22 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:23.033539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: .version_select at 0x7fb08f20c550>, body: {"keypair": {"name": "tempest-key-2020746697"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:23.048970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:23.057605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:23.137613 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec952bf3-b8a2-4834-aae5-82161be89682 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 204 len: 0 microversion: 2.1 time: 0.164786 Apr 09 21:04:23.138840 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1311/2660] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:22 2022] DELETE /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:23.147731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08f017af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.188882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:23.189999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group efa7071b-5efa-4434-8df3-31d4e348ec31 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:23.190831 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist Apr 09 21:04:23.190831 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-fa730228-25ea-4780-a40c-d9ff8fe1823d'] Apr 09 21:04:23.192430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group efa7071b-5efa-4434-8df3-31d4e348ec31 does not exist Apr 09 21:04:23.192430 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-fa730228-25ea-4780-a40c-d9ff8fe1823d'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:23.194355 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1dace296-189f-40d9-a30a-1ab45e09cd9f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31" status: 404 len: 194 microversion: 2.1 time: 0.054199 Apr 09 21:04:23.198369 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1312/2661] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:23 2022] DELETE /compute/v2.1/os-security-groups/efa7071b-5efa-4434-8df3-31d4e348ec31 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:23.204712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.207056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:23.228019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.228623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.229768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.230317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.483816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:23.495868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c0c423a5-abc7-4f7f-9499-cbd4c7cca8a2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.298539 Apr 09 21:04:23.498903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1313/2662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:23 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:23.510897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.512445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:23.521962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.522647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.523630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.524236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.565539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:23.572319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:23.592173 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d448884-ebf9-48eb-ab10-c7fe52a8cf94 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.564907 Apr 09 21:04:23.593884 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1350/2663] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:23 2022] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:23.604483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee6e310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.642408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG neutronclient.v2_0.client [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbc01e51-006e-4334-899d-154794431da3 does not exist", "detail": ""}} {{(pid=141818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:23.643319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group fbc01e51-006e-4334-899d-154794431da3 not found {{(pid=141818) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:23.643846 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group fbc01e51-006e-4334-899d-154794431da3 does not exist Apr 09 21:04:23.643846 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-c8e124d8-6dff-4660-be40-0e937aa71912'] Apr 09 21:04:23.644670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group fbc01e51-006e-4334-899d-154794431da3 does not exist Apr 09 21:04:23.644670 ncdv-master-1 devstack@n-api.service[141818]: Neutron server returns request_ids: ['req-c8e124d8-6dff-4660-be40-0e937aa71912'] {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:23.646346 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2518bddf-81b9-4aa7-a094-3f2e4cc17cf2 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3" status: 404 len: 194 microversion: 2.1 time: 0.048445 Apr 09 21:04:23.649815 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1351/2664] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:23 2022] DELETE /compute/v2.1/os-security-groups/fbc01e51-006e-4334-899d-154794431da3 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:23.652246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-76496d3d-49d8-4541-938d-ac1ed77e1d48 req-0144ca46-38a7-4df3-96e7-da1f7398ea5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-plugged", "status": "completed", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:23.661066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-76496d3d-49d8-4541-938d-ac1ed77e1d48 req-0144ca46-38a7-4df3-96e7-da1f7398ea5b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.661499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-76496d3d-49d8-4541-938d-ac1ed77e1d48 req-0144ca46-38a7-4df3-96e7-da1f7398ea5b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.671896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-76496d3d-49d8-4541-938d-ac1ed77e1d48 req-0144ca46-38a7-4df3-96e7-da1f7398ea5b service nova] Creating event network-vif-plugged:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:04:23.676847 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-76496d3d-49d8-4541-938d-ac1ed77e1d48 req-0144ca46-38a7-4df3-96e7-da1f7398ea5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Apr 09 21:04:23.677674 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1352/2665] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:23.683465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:23.693788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc54717d-ef31-4309-a4c2-8898ea5fb15d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1527 microversion: 2.1 time: 0.192933 Apr 09 21:04:23.704598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1314/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:23 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1527 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:23.711041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8ea5a15-767b-4565-b312-e34fede4cd82 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '.version_select at 0x7fb08efa2940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.714111 ncdv-master-1 devstack@n-api.service[141819]: WARNING oslo_db.sqlalchemy.utils [None req-f8ea5a15-767b-4565-b312-e34fede4cd82 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 21:04:23.720380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8ea5a15-767b-4565-b312-e34fede4cd82 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.014596 Apr 09 21:04:23.721094 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1315/2667] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:04:23 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:23.726140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee5c670>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.753295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:23.753934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:23.754878 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist Apr 09 21:04:23.754878 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-a500954f-849d-4bd4-bb68-378f3a532f6f'] Apr 09 21:04:23.755755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group c5c834f0-ea5c-4ab7-b13c-75306bb31571 does not exist Apr 09 21:04:23.755755 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-a500954f-849d-4bd4-bb68-378f3a532f6f'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:23.756855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35e99311-3b6d-4abc-8727-1312c1f8f4aa tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571" status: 404 len: 194 microversion: 2.1 time: 0.034447 Apr 09 21:04:23.757977 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1316/2668] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:23 2022] DELETE /compute/v2.1/os-security-groups/c5c834f0-ea5c-4ab7-b13c-75306bb31571 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:23.766625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ef555e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.793768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:04:23.794384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Neutron security group 4566481b-917f-4c12-ae7e-f36e1973d7ef not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:04:23.796219 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist Apr 09 21:04:23.796219 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-0a26a006-ce2c-41f6-a123-8940976423f2'] Apr 09 21:04:23.796857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Security group 4566481b-917f-4c12-ae7e-f36e1973d7ef does not exist Apr 09 21:04:23.796857 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-0a26a006-ce2c-41f6-a123-8940976423f2'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:23.797967 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af18ee66-fa38-4053-844b-05c8c5d3777c tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef" status: 404 len: 194 microversion: 2.1 time: 0.036235 Apr 09 21:04:23.798970 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1317/2669] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:23 2022] DELETE /compute/v2.1/os-security-groups/4566481b-917f-4c12-ae7e-f36e1973d7ef => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:04:23.810410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:23.811441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:23.818662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.819527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.820433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.821386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.851046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:23.885671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1377758617", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:23.947983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:23.948294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:23.948767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:23.949367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:23.949747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:23.968153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.969567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.970657 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5db5ffab-8b27-434f-80d1-7614daede5b1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 204 len: 0 microversion: 2.1 time: 0.167218 Apr 09 21:04:23.970929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:23.971265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1318/2670] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:23 2022] DELETE /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:23.971990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:23.990075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-215859757", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "key_name": "tempest-key-2020746697", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:23.995594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Getting quotas for project 4b9455ce3b4e4d268c23b32258d8eeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:24.002907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Getting quotas for user 877cb7c7f5da43638d8cb4fe28a927ae and project 4b9455ce3b4e4d268c23b32258d8eeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:24.033125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:24.037632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:24.058874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:24.099070 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff1daac0-6934-4b41-bc00-33db7381485e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.420344 Apr 09 21:04:24.100004 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1353/2671] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:04:24.105343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:24.106346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:24.113838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.115144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.116624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.117384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.423262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:24.432399 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f838562-f6d1-4248-9444-1fc41b773ffd tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1646 microversion: 2.1 time: 0.331083 Apr 09 21:04:24.443561 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1354/2672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:24 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1646 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:24.450254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:24.451290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:24.459668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.460982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.462184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.462882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.704178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:24.714975 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f1a70c8b-4cf3-4d1e-9f68-0bd53dddc55c tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.269789 Apr 09 21:04:24.715968 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1355/2673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:24 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:24.720917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:24.722097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:24.728124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.728577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.729411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.729849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.769891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:24.770339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:24.770814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:24.771221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:24.771631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:24.799165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.800182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.801473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.802368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.825587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:24.832036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:24.845502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:24.847989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:24.874476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:24.888575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:24.891684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:24.899497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52e28eff-6c32-4c08-9ffa-4effeb82ca16 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "PUT /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1363 microversion: 2.75 time: 0.182232 Apr 09 21:04:24.901286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1356/2674] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Apr 9 21:04:24 2022] PUT /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:24.916463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36d57f4a-5a0c-4f89-965f-46992548f56c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940548 Apr 09 21:04:24.917259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1319/2675] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:24.927935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-422ae29b-8ede-44ce-a8a6-8001e3a76210 req-f103e2b3-1537-48af-bb06-fa5d59f4c7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3a8c29-e199-4d97-8cde-57b42551b09e", "tag": "7871b15f-ec75-4638-8efa-02a7ceefbe68"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:24.952322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-422ae29b-8ede-44ce-a8a6-8001e3a76210 req-f103e2b3-1537-48af-bb06-fa5d59f4c7c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:24.952784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-422ae29b-8ede-44ce-a8a6-8001e3a76210 req-f103e2b3-1537-48af-bb06-fa5d59f4c7c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:24.982208 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-422ae29b-8ede-44ce-a8a6-8001e3a76210 req-f103e2b3-1537-48af-bb06-fa5d59f4c7c4 service nova] Creating event network-changed:7871b15f-ec75-4638-8efa-02a7ceefbe68 for instance bc3a8c29-e199-4d97-8cde-57b42551b09e on nch2-master-1 Apr 09 21:04:24.992923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-422ae29b-8ede-44ce-a8a6-8001e3a76210 req-f103e2b3-1537-48af-bb06-fa5d59f4c7c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074332 Apr 09 21:04:24.994061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1320/2676] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:25.003929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.004662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.019772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.020320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.021005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.021479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.062768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Calling method '.version_select at 0x7fb08ee72280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.078660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.079123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.079935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.080376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.106914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb65d7d4-3aa7-4361-8e75-bcf4d98320ca tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.204149 Apr 09 21:04:25.108006 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1357/2677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:04:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:25.113954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.115066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.126906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.128233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.129904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.130782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.355179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.367335 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dce66bbb-8a3d-4288-851c-1620984a4066 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.371033 Apr 09 21:04:25.369132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1321/2678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:24 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:25.374389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.375180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.394725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.399008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.399568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.400475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.403860 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d890e81-73f6-458b-8a69-b57918672b9e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1527 microversion: 2.1 time: 0.294512 Apr 09 21:04:25.404369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.413581 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1358/2679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:25 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:25.413581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b87c3db-4a33-4e85-9e96-0f97db9addda tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.413581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2b87c3db-4a33-4e85-9e96-0f97db9addda tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.500806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2b87c3db-4a33-4e85-9e96-0f97db9addda tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.508522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b87c3db-4a33-4e85-9e96-0f97db9addda tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1228 microversion: 2.1 time: 0.102364 Apr 09 21:04:25.509315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1359/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:25 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:25.514566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1791420843", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:25.570591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:25.571628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.586198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.587923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.595567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35057a50-9066-4172-8e5d-6cb2393f660f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1355 microversion: 2.75 time: 0.225047 Apr 09 21:04:25.596597 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1322/2681] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:25 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1355 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:25.601318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.602042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.608942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.609786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.617272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.618222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.918883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:25.922695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Getting quotas for project 720fd939cec64e069f36f74f4a2007ef. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:25.932375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Getting quotas for user e1baa603ea934446bc560f273872dc24 and project 720fd939cec64e069f36f74f4a2007ef. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:25.934750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d0b8e18d-2200-432d-98ff-0d445141ff69 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1646 microversion: 2.1 time: 0.336863 Apr 09 21:04:25.938387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1323/2682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:25 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1646 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:25.945946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Apr 09 21:04:25.946651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:25.947573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2170e083-cac5-459f-bf01-bdc6a6877250 tempest-AbsoluteLimitsNegativeTestJSON-67737243 tempest-AbsoluteLimitsNegativeTestJSON-67737243-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.436803 Apr 09 21:04:25.948385 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1360/2683] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Apr 9 21:04:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 438 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:04:25.952367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6c72eded-f960-4c2f-b8d6-b344f984c318 req-c84dedf7-6b61-4616-8852-ae6534fc099b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde0439-8c37-47c0-9c32-ca5152679302", "name": "network-vif-deleted", "tag": "7e8c197f-7833-4616-9703-c66566894b07"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:25.953205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:25.953946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:25.961397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.961932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.962784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.963285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.976675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6c72eded-f960-4c2f-b8d6-b344f984c318 req-c84dedf7-6b61-4616-8852-ae6534fc099b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:25.977575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6c72eded-f960-4c2f-b8d6-b344f984c318 req-c84dedf7-6b61-4616-8852-ae6534fc099b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:25.990482 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6c72eded-f960-4c2f-b8d6-b344f984c318 req-c84dedf7-6b61-4616-8852-ae6534fc099b service nova] Creating event network-vif-deleted:7e8c197f-7833-4616-9703-c66566894b07 for instance cbde0439-8c37-47c0-9c32-ca5152679302 on nch2-master-1 Apr 09 21:04:25.996016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6c72eded-f960-4c2f-b8d6-b344f984c318 req-c84dedf7-6b61-4616-8852-ae6534fc099b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054766 Apr 09 21:04:26.001252 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1324/2684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:26.179955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.188048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9efa0659-849e-4d7a-b0e5-3967d20937c7 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1476 microversion: 2.1 time: 0.238612 Apr 09 21:04:26.188950 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1361/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:25 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:26.386474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:26.387185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:26.402252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.402854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.405910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.406389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.421720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:26.422477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:26.436368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.438454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.439588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.441767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.567002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.577724 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c03a9d9-adaf-4d73-a315-e8893975bc91 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1485 microversion: 2.1 time: 0.160486 Apr 09 21:04:26.578312 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1362/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:26 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:26.591833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:26.593089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:26.601731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.602472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.603500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.604078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.653238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.661224 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34ae83d5-84f6-436f-bd0c-033d6b9ab083 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.278871 Apr 09 21:04:26.662391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1325/2687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:26 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:26.667391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:26.668268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:26.674782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.676289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.677277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.677880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.695054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.705918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b1fe5378-5c5e-432f-92f0-e74c4bd43434 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1280 microversion: 2.1 time: 0.126083 Apr 09 21:04:26.716279 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1363/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:26 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:26.719062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-70a63a88-a3c8-4116-ab7c-3d05aa32f8b5 req-f14c4491-af64-40e9-b418-abe25d93e1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-plugged", "status": "completed", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:26.729342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-70a63a88-a3c8-4116-ab7c-3d05aa32f8b5 req-f14c4491-af64-40e9-b418-abe25d93e1e3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.729806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-70a63a88-a3c8-4116-ab7c-3d05aa32f8b5 req-f14c4491-af64-40e9-b418-abe25d93e1e3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.743726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-70a63a88-a3c8-4116-ab7c-3d05aa32f8b5 req-f14c4491-af64-40e9-b418-abe25d93e1e3 service nova] Creating event network-vif-plugged:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:04:26.749166 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-70a63a88-a3c8-4116-ab7c-3d05aa32f8b5 req-f14c4491-af64-40e9-b418-abe25d93e1e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Apr 09 21:04:26.750318 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1364/2689] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:26.791282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.801839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.809519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:26.818611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99983ac8-79c2-4f88-b607-4c7f528ec14a tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1419 microversion: 2.75 time: 0.154923 Apr 09 21:04:26.824484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1326/2690] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:26 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1419 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:26.958814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:26.960052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:26.971571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.972511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:26.974350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:26.976693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.012933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.013497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.014560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lazy-loading 'fault' on Instance uuid 34469266-eccb-4d9a-847a-455bffa2c78a {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:27.019965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b34c54a4-f326-4b1c-b657-44e26a146b3d req-03f5a3e7-fac8-4866-b801-a2f45549005d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34469266-eccb-4d9a-847a-455bffa2c78a", "name": "network-vif-deleted", "tag": "f1f5938f-d802-4ab4-9995-8b667eecc83f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:27.032551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b34c54a4-f326-4b1c-b657-44e26a146b3d req-03f5a3e7-fac8-4866-b801-a2f45549005d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.034781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b34c54a4-f326-4b1c-b657-44e26a146b3d req-03f5a3e7-fac8-4866-b801-a2f45549005d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.054509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b34c54a4-f326-4b1c-b657-44e26a146b3d req-03f5a3e7-fac8-4866-b801-a2f45549005d service nova] Creating event network-vif-deleted:f1f5938f-d802-4ab4-9995-8b667eecc83f for instance 34469266-eccb-4d9a-847a-455bffa2c78a on nch1-master-1 Apr 09 21:04:27.061245 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b34c54a4-f326-4b1c-b657-44e26a146b3d req-03f5a3e7-fac8-4866-b801-a2f45549005d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045467 Apr 09 21:04:27.062150 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1327/2691] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:04:27.085498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbcb9088698a4f478ccebca7a65f54c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a2d61df2b4bfda6882e74e73b6cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:27.093769 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8bdd1643-55d9-4797-985f-7099e24aa8c1 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 200 len: 1305 microversion: 2.1 time: 0.142160 Apr 09 21:04:27.094445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1365/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:26 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:27.205691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:27.206420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:27.212871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.213441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.214278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.214665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.578178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:27.591733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7285fa3-4bd9-41a2-a494-c9a81827cd24 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1462 microversion: 2.1 time: 0.390141 Apr 09 21:04:27.598054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:27.598671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:27.603774 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1328/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:27 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1462 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:27.610122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.610964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.611961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.613330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.613514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:27.614154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:27.632733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.633221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.634024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.634474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.653204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.653669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.654126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lazy-loading 'fault' on Instance uuid cbde0439-8c37-47c0-9c32-ca5152679302 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:27.748572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6869f687bd8411ea81a24f566fef6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5c4a7f5181441d9d3db5d4ed86133b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:27.756285 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dcdadb9c-567d-468f-bfd6-05e0a035466d tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 200 len: 1314 microversion: 2.1 time: 0.164851 Apr 09 21:04:27.756867 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1366/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:27 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:27.762188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:27.762947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:27.769391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.769842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.770626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.771059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.963368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:27.971208 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d1c70dc0-2de8-4acc-a1b0-997aaf6fc0f9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1462 microversion: 2.1 time: 0.366346 Apr 09 21:04:27.971788 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1329/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:27 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1462 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:27.987496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:27.988278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:27.994834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.995300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:27.996227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:27.996721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.096367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.104432 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c8e223a-f38d-4d24-beb5-4a84256a836a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1286 microversion: 2.1 time: 0.131325 Apr 09 21:04:28.105327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1330/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:27 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:28.106545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.114723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e201d9e-c99e-4a12-8397-ce1c4f0b9978 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.356453 Apr 09 21:04:28.119520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.120305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.125256 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1367/2697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:27 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:28.130589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:28.132076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.138230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.138679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.139459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.140401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.140838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.141319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.142891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.143324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.247229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:28.247757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:28.248340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:28.248824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:28.249457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:28.267748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.285613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.288147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.296803 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2f2ad89-c6a6-4e38-9aa8-9aab119f0377 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1417 microversion: 2.75 time: 0.189771 Apr 09 21:04:28.298231 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1331/2698] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:28 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1417 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:28.304579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.305842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] [instance: 34469266-eccb-4d9a-847a-455bffa2c78a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.318677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.319712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.320779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.321625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.342254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] HTTP exception thrown: Instance 34469266-eccb-4d9a-847a-455bffa2c78a could not be found. Apr 09 21:04:28.343727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Returning 404 to user: Instance 34469266-eccb-4d9a-847a-455bffa2c78a could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:28.345375 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fee0642b-29d3-4427-93af-3450d6b050d4 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a" status: 404 len: 111 microversion: 2.1 time: 0.045571 Apr 09 21:04:28.347105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1332/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:28 2022] GET /compute/v2.1/servers/34469266-eccb-4d9a-847a-455bffa2c78a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:28.359177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ed66bf3-c16c-4244-976c-137c1a76c0f6 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08f50cd30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.377853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.390967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.391824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.392783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.393413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.425990 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bc200ba6-6011-452c-a696-acbccfb583b0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 1066 microversion: 2.1 time: 0.299527 Apr 09 21:04:28.426849 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1368/2700] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:04:28 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 1066 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 09 21:04:28.450253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.451307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.462021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.463800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.465147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.465799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.790043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:28.800529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59ebcd4d-c739-42b0-914c-c4f20e007e70 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.355871 Apr 09 21:04:28.803790 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1369/2701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:28 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:28.817917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.819140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: cbde0439-8c37-47c0-9c32-ca5152679302] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.828315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.830170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.831437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.833165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.860505 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance cbde0439-8c37-47c0-9c32-ca5152679302 could not be found. Apr 09 21:04:28.861292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance cbde0439-8c37-47c0-9c32-ca5152679302 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:28.862615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e5b6848-3912-4743-9790-a6945ca634f4 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302" status: 404 len: 111 microversion: 2.1 time: 0.057468 Apr 09 21:04:28.863428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1370/2702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:28 2022] GET /compute/v2.1/servers/cbde0439-8c37-47c0-9c32-ca5152679302 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:28.868277 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ed66bf3-c16c-4244-976c-137c1a76c0f6 tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9768a175-8f6f-4799-947c-2642b7b31792" status: 202 len: 0 microversion: 2.1 time: 0.516970 Apr 09 21:04:28.868857 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1333/2703] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:28 2022] DELETE /compute/v2.1/os-security-groups/9768a175-8f6f-4799-947c-2642b7b31792 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:28.873965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db291da4-3f8c-4123-bf5f-874d62c2bb6e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb08edcfee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.876527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c53a90a3-be0e-4475-b556-8ca3c5367c2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] Calling method '.version_select at 0x7fb08ee9b8b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.900386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-db291da4-3f8c-4123-bf5f-874d62c2bb6e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Image not found. Apr 09 21:04:28.901406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db291da4-3f8c-4123-bf5f-874d62c2bb6e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:28.902614 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db291da4-3f8c-4123-bf5f-874d62c2bb6e tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959" status: 404 len: 62 microversion: 2.1 time: 0.034327 Apr 09 21:04:28.904615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1371/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:28 2022] DELETE /compute/v2.1/images/9d5a106a-53de-4032-b54b-747a02947959 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:04:28.912888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.913840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.923014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.923903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.924983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.925907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.944382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. Apr 09 21:04:28.945393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:28.947431 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8dd92475-77b3-4bfe-8087-25505b55c261 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 404 len: 111 microversion: 2.1 time: 0.038315 Apr 09 21:04:28.948237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1372/2705] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:28 2022] DELETE /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:28.956626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:28.957716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: f667511c-c0e4-4a11-8440-927a5977f82e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:28.964041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.964776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.965735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:28.966196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:28.981403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. Apr 09 21:04:28.982068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance f667511c-c0e4-4a11-8440-927a5977f82e could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:28.982969 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-26198452-7faf-46cc-8bf1-930df98ad4c7 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e" status: 404 len: 111 microversion: 2.1 time: 0.030343 Apr 09 21:04:28.983780 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1373/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:28 2022] GET /compute/v2.1/servers/f667511c-c0e4-4a11-8440-927a5977f82e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:28.991757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8520b160-3828-42b8-831f-b304391a0779 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb08ef7f670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:29.011716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8520b160-3828-42b8-831f-b304391a0779 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042255887" status: 202 len: 0 microversion: 2.1 time: 0.023607 Apr 09 21:04:29.012538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1374/2707] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042255887 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:29.127855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:29.128583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:29.135826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.136304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.137124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.137563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.254073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c53a90a3-be0e-4475-b556-8ca3c5367c2f tempest-SecurityGroupsTestJSON-1498493028 tempest-SecurityGroupsTestJSON-1498493028-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/f6e84827-57e9-4d49-91fa-e34ed07b1cf3" status: 202 len: 0 microversion: 2.1 time: 0.381008 Apr 09 21:04:29.260922 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1334/2708] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:04:28 2022] DELETE /compute/v2.1/os-security-groups/f6e84827-57e9-4d49-91fa-e34ed07b1cf3 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:29.267337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:29.268968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:29.292690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.293781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.295027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.295655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.619866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:29.629961 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd402c74-149b-41b2-b253-1df3e827ce0f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.508674 Apr 09 21:04:29.631366 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1375/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:29 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:29.636195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:29.637253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:29.643725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.644578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.645637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.646288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.760338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:29.764486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:29.770606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:29.773346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:29.780751 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-caf22763-595e-4400-bb21-756470f6d9a0 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1438 microversion: 2.75 time: 0.148151 Apr 09 21:04:29.781695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1376/2710] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:29 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1438 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:29.784580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1163a0ec-f85e-402f-8c5d-64f0b41eb5e8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.527967 Apr 09 21:04:29.806236 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1335/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:29 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:29.823191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:29.824769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:29.846370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.846856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.847753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:29.848192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:29.950953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:29.951546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:29.951892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:29.952303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:29.952868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:29.953553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-992047716", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ae78a474-58ef-459a-be82-a0d83b0a116d"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:30.038178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] validate_networks() for [('ae78a474-58ef-459a-be82-a0d83b0a116d', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:30.046323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:30.055483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.056189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:30.057518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.058303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:30.160075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:30.171619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:30.173654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:30.180273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1737ddac-add9-443a-8bfb-6fecd00296f8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "POST /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095/action" status: 202 len: 1495 microversion: 2.75 time: 0.372729 Apr 09 21:04:30.181615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1336/2712] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:04:29 2022] POST /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095/action => generated 1495 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 09 21:04:30.187577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:30.189347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:30.202597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.203284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:30.204867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.205926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:30.560464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:30.570080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6715ed5-fba9-436c-8ef1-299cea634199 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.387164 Apr 09 21:04:30.570691 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1337/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:30 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:30.576153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:30.576947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:30.585386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.586112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:30.587048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:30.587646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.051176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.059742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.061501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.068324 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1de765b6-88f6-4e9b-8d83-444050a2ebf1 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.495954 Apr 09 21:04:31.069101 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1338/2714] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:30 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:31.073632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4868dfa-3196-4144-b1f1-80d490cf0971 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '.version_select at 0x7fb08edc4ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.100518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b4868dfa-3196-4144-b1f1-80d490cf0971 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Image not found. Apr 09 21:04:31.101475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4868dfa-3196-4144-b1f1-80d490cf0971 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:31.102685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4868dfa-3196-4144-b1f1-80d490cf0971 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/images/9659851d-a2f8-4620-8c91-c56c297080c8" status: 404 len: 62 microversion: 2.1 time: 0.032660 Apr 09 21:04:31.106466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1339/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] DELETE /compute/v2.1/images/9659851d-a2f8-4620-8c91-c56c297080c8 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:04:31.111690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-452d5e68-d83a-4044-a600-06a669a85b48 req-a783bba5-9401-41ec-8a8c-3c6a39b6c456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4", "tag": "5f958b21-b9df-401e-9d69-3efbcd5ccc23"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:31.124669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-452d5e68-d83a-4044-a600-06a669a85b48 req-a783bba5-9401-41ec-8a8c-3c6a39b6c456 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.125184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-452d5e68-d83a-4044-a600-06a669a85b48 req-a783bba5-9401-41ec-8a8c-3c6a39b6c456 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.137923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-452d5e68-d83a-4044-a600-06a669a85b48 req-a783bba5-9401-41ec-8a8c-3c6a39b6c456 service nova] Creating event network-changed:5f958b21-b9df-401e-9d69-3efbcd5ccc23 for instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 on nch1-master-1 Apr 09 21:04:31.142870 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-452d5e68-d83a-4044-a600-06a669a85b48 req-a783bba5-9401-41ec-8a8c-3c6a39b6c456 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034939 Apr 09 21:04:31.143478 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1340/2716] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:31.149207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.150155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.156657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.157150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.157932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.158373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.305624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:31.306130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:31.306638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:31.307122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:31.307658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:31.318049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.318466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.319357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.319877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.337100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Getting quotas for project ab023af112834d0eb9a847bacc3fa37e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:31.342639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Getting quotas for user c6dfc7d9ec04440290b61e87a8fecad4 and project ab023af112834d0eb9a847bacc3fa37e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:31.358469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:31.358808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:31.410046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.420849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d79c1e7a-e97b-4eb9-bae6-e78ab54cdfad tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.275801 Apr 09 21:04:31.422580 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1341/2717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:31.424605 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-831efad3-d0c3-46e1-ae17-dd6e1d723793 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640329 Apr 09 21:04:31.426820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1377/2718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:31.434309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-135f510e-e874-4a5c-9d34-b29a37c625f5 req-e11ba8ea-42e3-43d7-b47a-367d3efed37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3a8c29-e199-4d97-8cde-57b42551b09e", "name": "network-vif-plugged", "status": "completed", "tag": "7871b15f-ec75-4638-8efa-02a7ceefbe68"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:31.434970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.435590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.442790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.444370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.444938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.445536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.480958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-135f510e-e874-4a5c-9d34-b29a37c625f5 req-e11ba8ea-42e3-43d7-b47a-367d3efed37e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.481749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-135f510e-e874-4a5c-9d34-b29a37c625f5 req-e11ba8ea-42e3-43d7-b47a-367d3efed37e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.504252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-135f510e-e874-4a5c-9d34-b29a37c625f5 req-e11ba8ea-42e3-43d7-b47a-367d3efed37e service nova] Creating event network-vif-plugged:7871b15f-ec75-4638-8efa-02a7ceefbe68 for instance bc3a8c29-e199-4d97-8cde-57b42551b09e on nch2-master-1 Apr 09 21:04:31.512400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-135f510e-e874-4a5c-9d34-b29a37c625f5 req-e11ba8ea-42e3-43d7-b47a-367d3efed37e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082011 Apr 09 21:04:31.513635 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1378/2719] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:31.524360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.526033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.538805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.539593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.540681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.541605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.573196 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. Apr 09 21:04:31.574143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:31.575286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-300de091-b6fb-46a2-b8d3-e8b32d81c131 tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 404 len: 111 microversion: 2.1 time: 0.057642 Apr 09 21:04:31.579367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1379/2720] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:31 2022] DELETE /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:31.594738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d152e9a0-3c51-4e16-b745-0b5260b2fd4d tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.595370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d152e9a0-3c51-4e16-b745-0b5260b2fd4d tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.697811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.698913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d152e9a0-3c51-4e16-b745-0b5260b2fd4d tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.705716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d152e9a0-3c51-4e16-b745-0b5260b2fd4d tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1216 microversion: 2.1 time: 0.125274 Apr 09 21:04:31.707112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1380/2721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:31.707928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1cc44a32-f577-4e54-8205-cb5ecc91fa73 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.282881 Apr 09 21:04:31.708839 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1342/2722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:31.714626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.715509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.720687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:31.721358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] [instance: 63967e76-ec68-47b4-bb9c-e0b7f0262227] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:31.724874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.725938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.727301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.727914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.730044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.730496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.731288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:31.731727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:31.747713 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] HTTP exception thrown: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. Apr 09 21:04:31.748329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] Returning 404 to user: Instance 63967e76-ec68-47b4-bb9c-e0b7f0262227 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:31.749250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66709d0b-3765-4814-a084-b01dcf456abb tempest-ImagesOneServerNegativeTestJSON-1595762154 tempest-ImagesOneServerNegativeTestJSON-1595762154-project] 10.222.0.30 "GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227" status: 404 len: 111 microversion: 2.1 time: 0.041145 Apr 09 21:04:31.749869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1381/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] GET /compute/v2.1/servers/63967e76-ec68-47b4-bb9c-e0b7f0262227 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:31.954216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:31.967044 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9dc90654-be9c-403f-89c5-a33827c5cf28 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.256348 Apr 09 21:04:31.969080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1343/2724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:31 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:32.091856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:32.094640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:32.105715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.106678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.107963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.108678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.198945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:32.209129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:32.210907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:32.216309 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7bbc5b9f-1577-4013-85fb-9c98546b9236 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.132099 Apr 09 21:04:32.217529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1382/2725] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:32 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:32.441672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:32.442879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:32.451904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.453134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.454433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.455057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.644082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:32.651994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3956414-d10d-49ab-b7c8-b8ab3dc62d3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.216730 Apr 09 21:04:32.655174 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1344/2726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:32 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:32.723907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:32.725283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:32.727019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:32.728452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:32.741187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.742001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.744002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.744450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.752925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.753828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.754980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:32.756114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:32.892215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:32.906646 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6537c1b-72a1-4dba-a3af-44806145405a tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1268 microversion: 2.1 time: 0.187089 Apr 09 21:04:32.908490 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1383/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:32 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:33.053518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.069154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56492ebe-f217-4fed-87ec-a4891bd02f17 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1317 microversion: 2.1 time: 0.347980 Apr 09 21:04:33.070107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1345/2728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:32 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:33.085666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:33.087827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:33.106945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.109605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.110630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.111234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.304952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2060496939", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:33.391245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:33.429290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.465979 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d5ea548-50a2-4f78-a3e2-0ebb6a2b02c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.392862 Apr 09 21:04:33.466600 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1346/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:33 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:33.476908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:33.477560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:33.499410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.499932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.500923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.501439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.602644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.610845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.612410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.617458 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48a18c9d-c8e2-4e7a-9bea-6127cd00f1cd tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.149852 Apr 09 21:04:33.629535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1347/2730] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:33 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:33.674989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:33.675737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:33.682390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.683417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.684479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.685209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.902541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:33.915914 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-124681ad-f506-4cda-9dff-8421a11d8b2e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.244975 Apr 09 21:04:33.916811 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1348/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:33 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:33.965567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:33.966983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:33.967691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:33.968589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:33.969011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:33.978155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.978610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.979427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:33.979871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:33.997212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:34.003731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:34.020504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:34.022881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:34.046668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08ef551f0>, body: {"keypair": {"name": "tempest-keypair-2088874733"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:34.063963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:34.077493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3508b29a-47f9-4eb7-9e91-7c601b57bc2f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166888 Apr 09 21:04:34.078158 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1384/2732] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:34.083062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.084137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.089747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:34.092417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.093277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.104624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.105122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.251611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.259977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-900e19a3-8ce2-4274-b227-65edd4093e67 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.180562 Apr 09 21:04:34.260723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:34.261431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1385/2733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.266275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.266824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:34.266964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.278123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.278583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.279391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.279838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.283526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-930f32e8-c9e3-48b3-bdf0-30ea038d8e52 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.365479 Apr 09 21:04:34.284786 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1349/2734] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:33 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.290006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05d821ab-bfb5-43dc-9cd1-256ae8381889 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.290779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05d821ab-bfb5-43dc-9cd1-256ae8381889 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.384134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05d821ab-bfb5-43dc-9cd1-256ae8381889 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.392511 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05d821ab-bfb5-43dc-9cd1-256ae8381889 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1215 microversion: 2.1 time: 0.106507 Apr 09 21:04:34.393137 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1350/2735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.406712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61ab1d85-c728-496e-a6d6-ccd7a76b4b77 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ee2de50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.414450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61ab1d85-c728-496e-a6d6-ccd7a76b4b77 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-2088874733" status: 200 len: 691 microversion: 2.1 time: 0.011640 Apr 09 21:04:34.415849 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1351/2736] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2088874733 => generated 691 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:34.427494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40bef285-2e84-4331-9f26-afbbb5f04ee4 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ef55820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.459860 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40bef285-2e84-4331-9f26-afbbb5f04ee4 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088874733" status: 202 len: 0 microversion: 2.1 time: 0.037872 Apr 09 21:04:34.464901 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1352/2737] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088874733 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:04:34.470599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08ed965e0>, body: {"keypair": {"name": "tempest-keypair-1822923464"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:34.475243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.487469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bdc60285-cc13-496c-ba9e-a6b656f97fdd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1467 microversion: 2.1 time: 0.224879 Apr 09 21:04:34.487670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:34.489457 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1386/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1467 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.494568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.495159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.501136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.501590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.502458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.502976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.510211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:34.662930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.673101 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4acdce64-a1b4-4b05-b9d2-9db95a258b8d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.182103 Apr 09 21:04:34.683168 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1387/2739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.696986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.697672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.708192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.708644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.713300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.713941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.764958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:34.770292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:34.785283 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-579fd3d2-fe41-4046-837d-06f1b7845132 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.318960 Apr 09 21:04:34.791196 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1353/2740] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:34 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.796335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.797251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.804615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.805373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.806346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.806956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.888144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.909554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.912253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.914787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:34.922575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78cc7f38-e523-425c-9614-7b8c903adf7f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.129360 Apr 09 21:04:34.924180 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1354/2741] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:34.928170 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8145be4a-e330-44b5-9d0b-66de84a24d4c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1467 microversion: 2.1 time: 0.243463 Apr 09 21:04:34.928771 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1388/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1467 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:34.932660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02b005e0-5cad-4dc4-891b-9fe26d8c13df tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ed84940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.944185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a9feef78-4ef5-478d-a9d3-8411ea523d1e req-91f5f240-4df2-40e0-9220-9c46df78d728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4", "name": "network-vif-plugged", "status": "completed", "tag": "5f958b21-b9df-401e-9d69-3efbcd5ccc23"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:34.954735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a9feef78-4ef5-478d-a9d3-8411ea523d1e req-91f5f240-4df2-40e0-9220-9c46df78d728 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.955591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a9feef78-4ef5-478d-a9d3-8411ea523d1e req-91f5f240-4df2-40e0-9220-9c46df78d728 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.958297 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02b005e0-5cad-4dc4-891b-9fe26d8c13df tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822923464" status: 202 len: 0 microversion: 2.1 time: 0.032320 Apr 09 21:04:34.962884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1355/2743] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822923464 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:34.967605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:34.968583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.974818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a9feef78-4ef5-478d-a9d3-8411ea523d1e req-91f5f240-4df2-40e0-9220-9c46df78d728 service nova] Creating event network-vif-plugged:5f958b21-b9df-401e-9d69-3efbcd5ccc23 for instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 on nch1-master-1 Apr 09 21:04:34.979994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a9feef78-4ef5-478d-a9d3-8411ea523d1e req-91f5f240-4df2-40e0-9220-9c46df78d728 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043636 Apr 09 21:04:34.980347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.980800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.980934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1389/2744] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:34.983087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.983536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.986112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-855559689"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:34.987304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:34.995271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.996003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:34.997531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:34.998049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.132350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:35.140828 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1583effc-b455-41da-a649-f466082acbcc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.180467 Apr 09 21:04:35.141551 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1356/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:34 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.154655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf98d5f1-3e94-44af-9caf-12682da64fde tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08efa2940>, body: {"keypair": {"name": "tempest-keypair-1316115868", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:35.173420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cf98d5f1-3e94-44af-9caf-12682da64fde tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.179997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cf98d5f1-3e94-44af-9caf-12682da64fde tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.227482 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf98d5f1-3e94-44af-9caf-12682da64fde tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.076337 Apr 09 21:04:35.228291 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1357/2746] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Apr 9 21:04:35 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:35.243085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f33bf9ab-8bb4-4ab3-bf9a-bf067f911a93 req-62e5c2c9-752e-4eb1-afd6-8831d344a4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f670df63-d8a9-4e25-a6c0-1758746d7c81", "tag": "2b9720ed-2fdb-4c7a-b9ab-cdf89e931153"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:35.253544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f33bf9ab-8bb4-4ab3-bf9a-bf067f911a93 req-62e5c2c9-752e-4eb1-afd6-8831d344a4a4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.254126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f33bf9ab-8bb4-4ab3-bf9a-bf067f911a93 req-62e5c2c9-752e-4eb1-afd6-8831d344a4a4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.266863 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f33bf9ab-8bb4-4ab3-bf9a-bf067f911a93 req-62e5c2c9-752e-4eb1-afd6-8831d344a4a4 service nova] Creating event network-changed:2b9720ed-2fdb-4c7a-b9ab-cdf89e931153 for instance f670df63-d8a9-4e25-a6c0-1758746d7c81 on nch2-master-1 Apr 09 21:04:35.273911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f33bf9ab-8bb4-4ab3-bf9a-bf067f911a93 req-62e5c2c9-752e-4eb1-afd6-8831d344a4a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035419 Apr 09 21:04:35.274497 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1358/2747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:35.280734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef388da8-d464-44ee-bfdc-db5045436c83 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ed968b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.308418 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef388da8-d464-44ee-bfdc-db5045436c83 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316115868" status: 202 len: 0 microversion: 2.1 time: 0.032395 Apr 09 21:04:35.309319 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1359/2748] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316115868 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:35.325559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.327874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:35.334629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06752a2a-52c1-4b1d-8740-a804f5c4a580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "POST /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24/action" status: 202 len: 0 microversion: 2.1 time: 0.351241 Apr 09 21:04:35.340626 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1390/2749] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:04:34 2022] POST /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:04:35.342401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.343223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.347912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08ee399d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-131660074"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:35.349092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.349574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.367511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.375319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.512315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.518815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.536440 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b651bf3-edad-4f05-8ef2-0becca9a9e17 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.193861 Apr 09 21:04:35.541428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1391/2750] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:35 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.542115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee726fb0-3497-40ff-91ca-bbc9f97f1142 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed56c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.601329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee726fb0-3497-40ff-91ca-bbc9f97f1142 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.063002 Apr 09 21:04:35.602274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1392/2751] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:35 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.611943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.613155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:35.620053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.620615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.622091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.622091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.641809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:35.650554 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab9c79c6-7feb-4bac-9be2-8f8827503605 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.334991 Apr 09 21:04:35.651476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1360/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:35 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.656036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08efa2820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-995380483"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:35.672382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.678591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.691927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:35.699520 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a57af83-0897-4b78-b134-1a1bc3dae6d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1273 microversion: 2.1 time: 0.093060 Apr 09 21:04:35.700106 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1393/2753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:35 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.708518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.709159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:35.715052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.715511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.716291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.716730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.776771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.782127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.797093 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48274c68-f07a-4e09-9d5e-1f22ba37f622 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.144502 Apr 09 21:04:35.797712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1361/2754] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:35 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.806902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Action: 'create', calling method: .version_select at 0x7fb08eeb5dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-978661869"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:35.820786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:35.826560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:35.913745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:35.921302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b311c550-ea54-4d77-b447-dc6da3f22a00 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.220212 Apr 09 21:04:35.922150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1394/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:35 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:35.943653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:35.944462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:35.950798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.951605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:35.952437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:35.952950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.053327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:36.061868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:36.063358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:36.068610 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48ad7883-68b3-40da-98e0-c9e4f5be6582 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.129748 Apr 09 21:04:36.074473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1395/2756] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:35 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:36.158768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.160246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:36.166675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.167140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.167904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.168318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.257767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:36.263848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Getting quotas for user 9b1cf86802694d0084818aae72131e01 and project 0bd152d85c8c464c8fd7b7cd0679876c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:36.283130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b11b651b-6d25-464f-8b6e-81f4820558cf tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.479818 Apr 09 21:04:36.283944 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1362/2757] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:35 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:36.297849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6b29dc4-b491-4a9f-83e8-8705dc488940 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08edded30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.302220 ncdv-master-1 devstack@n-api.service[141819]: WARNING oslo_db.sqlalchemy.utils [None req-d6b29dc4-b491-4a9f-83e8-8705dc488940 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 21:04:36.309861 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6b29dc4-b491-4a9f-83e8-8705dc488940 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1673 microversion: 2.1 time: 0.020068 Apr 09 21:04:36.312830 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1363/2758] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:04:36 2022] GET /compute/v2.1/os-keypairs => generated 1673 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:36.320455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-187df607-a4e7-44f1-b923-86aca757b9c4 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ed96700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.349494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-187df607-a4e7-44f1-b923-86aca757b9c4 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-978661869" status: 202 len: 0 microversion: 2.1 time: 0.031451 Apr 09 21:04:36.350158 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1364/2759] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-978661869 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:04:36.355574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:36.362482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4481180f-3cfa-4ca9-9820-4c03c421bf9f tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ee45820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.363898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80d35192-3f2b-42ca-a475-5e4e69820c1b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1328 microversion: 2.1 time: 0.209926 Apr 09 21:04:36.373729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1396/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:36 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1328 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:36.410991 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4481180f-3cfa-4ca9-9820-4c03c421bf9f tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-995380483" status: 202 len: 0 microversion: 2.1 time: 0.052526 Apr 09 21:04:36.411677 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1365/2761] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-995380483 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:04:36.420780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0059e42d-f376-4c13-bbfe-e96819518d38 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] Calling method '.version_select at 0x7fb08ee724c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.444977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0059e42d-f376-4c13-bbfe-e96819518d38 tempest-KeyPairsV2TestJSON-683626446 tempest-KeyPairsV2TestJSON-683626446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-131660074" status: 202 len: 0 microversion: 2.1 time: 0.028154 Apr 09 21:04:36.445869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1397/2762] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-131660074 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:04:36.617207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-210c65c9-e841-468e-b5c8-85f4c65f6387 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08edf1280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.666461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.667077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:36.667290 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-210c65c9-e841-468e-b5c8-85f4c65f6387 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.055881 Apr 09 21:04:36.674098 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1366/2763] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:36 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:36.675677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.675910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.676698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.677159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.716893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:36.717537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:36.723943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.724441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:36.725189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:36.725629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.486938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.496394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.507442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1c15327-bca1-4d26-b08c-a2719b2fd00e tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.844759 Apr 09 21:04:37.508263 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0acc5bb0-ac62-4f62-9a4b-b9596da587c5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.795159 Apr 09 21:04:37.509015 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1367/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:36 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:37.510545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1398/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:36 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:37.515235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:37.519054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:37.519903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:37.523363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:37.533712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.534249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.535079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.535703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.536900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.537671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.538858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.539164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.680835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.690839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.692494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.698188 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a09f1829-fb94-4e17-a41c-a6c5a0055a09 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.186484 Apr 09 21:04:37.698782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1399/2766] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:37 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:37.703487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:37.704098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:37.722637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.722637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.722637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:37.722637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:37.908224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:37.916630 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43a328cb-3e70-4e1c-9055-00fd21387594 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.406730 Apr 09 21:04:37.917470 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1368/2767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:37 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:37.930696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-affe605b-9b62-4d24-86bb-223cd76a5e4d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee388b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:37.975610 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-affe605b-9b62-4d24-86bb-223cd76a5e4d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.048677 Apr 09 21:04:37.976194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1369/2768] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:37 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.074456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:38.083553 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1dbb5f96-6272-45de-a3c4-e7ef2c1df374 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1509 microversion: 2.1 time: 0.383527 Apr 09 21:04:38.084580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1400/2769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:37 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.094050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e532161-4c37-4738-84d9-9a2bf61cafa8 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08edf1940>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:38.100634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.101295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.102156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9e532161-4c37-4738-84d9-9a2bf61cafa8 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Apr 09 21:04:38.102315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e532161-4c37-4738-84d9-9a2bf61cafa8 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:38.103197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e532161-4c37-4738-84d9-9a2bf61cafa8 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.125789 Apr 09 21:04:38.107889 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1370/2770] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:37 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:04:38.109199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.109728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.110596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.111104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.114215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08f0f0c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1021516545", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:38.128655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:38.136059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:38.156182 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 09 21:04:38.156778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:38.157656 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbfe2d94-2070-4f58-85fa-ef55d11dfdec tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.048615 Apr 09 21:04:38.162105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1371/2771] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Apr 9 21:04:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:38.170290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08eeb5ee0>, body: {"keypair": {"name": "tempest-keypair-1378535630"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:38.187418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:38.194502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:38.311499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:38.325598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b958f7af-18f2-462e-8dd8-31756142bf2d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1509 microversion: 2.1 time: 0.228408 Apr 09 21:04:38.339373 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1401/2772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.345473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.346261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.355522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.356285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.358900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.359686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.407707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:38.486401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:38.494369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:38.508826 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c946dceb-f4a1-415f-9442-661f411e4246 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 204 len: 0 microversion: 2.1 time: 0.167557 Apr 09 21:04:38.509922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1402/2773] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:38 2022] DELETE /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:38.516388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-953f8ca5-035f-40ab-b23b-6356d26f581d req-38f96557-db44-4ad4-a061-306af9293c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79", "tag": "69a00c5c-3247-4aad-9312-e3179f59e693"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:38.522503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a49f0a00-b55d-4d58-93f1-861bc7690168 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.359127 Apr 09 21:04:38.523121 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1372/2774] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:38 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.531423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-953f8ca5-035f-40ab-b23b-6356d26f581d req-38f96557-db44-4ad4-a061-306af9293c6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.531744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.532016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-953f8ca5-035f-40ab-b23b-6356d26f581d req-38f96557-db44-4ad4-a061-306af9293c6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.532771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.539571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.540025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.540815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.541283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.543847 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-953f8ca5-035f-40ab-b23b-6356d26f581d req-38f96557-db44-4ad4-a061-306af9293c6e service nova] Creating event network-changed:69a00c5c-3247-4aad-9312-e3179f59e693 for instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 on nch1-master-1 Apr 09 21:04:38.548842 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-953f8ca5-035f-40ab-b23b-6356d26f581d req-38f96557-db44-4ad4-a061-306af9293c6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036978 Apr 09 21:04:38.549540 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1403/2775] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:38.554692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.555409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.562616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.563067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.563835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.564266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.734586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:38.743976 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-583290d4-76cb-4c0c-a0bf-799488c076bc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1515 microversion: 2.1 time: 0.218738 Apr 09 21:04:38.744567 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1373/2776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.749201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.750338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.752018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:38.757981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.758677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.759640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.759954 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-765dc23e-c47f-4026-bf36-a214d2b5703b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.209074 Apr 09 21:04:38.760493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.760623 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1404/2777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.773579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08ec543a0>, body: {"keypair": {"name": "tempest-keypair-1378535630"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:38.790561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:38.795850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:38.905628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:38.913332 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bfdc6e43-b6c6-4d36-8e00-060132343450 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.167731 Apr 09 21:04:38.914316 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1374/2778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:38.919560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.920369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.926568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.927096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.928091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.928738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.949976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Key pair 'tempest-keypair-1378535630' already exists. Apr 09 21:04:38.950915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 409 to user: Key pair 'tempest-keypair-1378535630' already exists. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:38.952010 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6befcd8-5a5c-49be-a32c-a66cb50a1505 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.190547 Apr 09 21:04:38.952817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1405/2779] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:38 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:04:38.958819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:38.959432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:38.965735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.966186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:38.967007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:38.968365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.024523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:39.036458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:39.038890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:39.046818 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a64088e7-265f-4e04-8d64-9860fe01760c tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.130980 Apr 09 21:04:39.047884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1375/2780] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:39.053567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e6bae71-d536-4492-8f35-9a3f70f34316 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Calling method '.version_select at 0x7fb08ecdb430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.082556 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e6bae71-d536-4492-8f35-9a3f70f34316 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378535630" status: 202 len: 0 microversion: 2.1 time: 0.033012 Apr 09 21:04:39.083242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1376/2781] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378535630 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:39.094245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba429e08-86db-4bf3-8cd6-bf3e0fba39cb tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee38700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.158459 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba429e08-86db-4bf3-8cd6-bf3e0fba39cb tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.073699 Apr 09 21:04:39.159528 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1377/2782] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:39 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:39.163469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:39.171447 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c62f5316-11ab-4273-b29f-38f80adadc9e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.217077 Apr 09 21:04:39.172017 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1406/2783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:38 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:39.178745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3f69db2-b094-4894-a8a6-99b689b322bd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08ee2d3a0>, body: {"keypair": {"name": ""}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:39.180089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3f69db2-b094-4894-a8a6-99b689b322bd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:39.180914 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a3f69db2-b094-4894-a8a6-99b689b322bd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020414 Apr 09 21:04:39.181668 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1378/2784] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:04:39.190993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08ee39940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1296781668", "public_key": " "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:39.205230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:39.210846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:39.232509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 09 21:04:39.233139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:39.233967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2125c176-3709-4662-abff-df8522d2057b tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047264 Apr 09 21:04:39.234529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1407/2785] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:04:39.244541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b2e65e0-9c08-4b65-abab-00a2b763cfcd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08ed96ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:39.245772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b2e65e0-9c08-4b65-abab-00a2b763cfcd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:39.246578 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b2e65e0-9c08-4b65-abab-00a2b763cfcd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.006730 Apr 09 21:04:39.247295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1379/2786] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Apr 9 21:04:39 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:04:39.257650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Action: 'create', calling method: .version_select at 0x7fb08edcf0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1367622349", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:39.272080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:39.277498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Getting quotas for user 86c2cb30466f4a9184e7e8ed34aad193 and project c4993e6d7126462e9ead71ecf95a3cae. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:39.297857 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 09 21:04:39.298607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:39.300251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7b09c29-89de-445c-a5e4-b903c9372886 tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047116 Apr 09 21:04:39.301766 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1408/2787] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Apr 9 21:04:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 09 21:04:39.312372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ea5414a-a866-4f5b-a1c2-1cfae9f17cdd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Calling method '.version_select at 0x7fb08f0faca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.322785 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0ea5414a-a866-4f5b-a1c2-1cfae9f17cdd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-726304959 not found for user 86c2cb30466f4a9184e7e8ed34aad193 Apr 09 21:04:39.323723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ea5414a-a866-4f5b-a1c2-1cfae9f17cdd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] Returning 404 to user: Keypair tempest-keypair-non-existent-726304959 not found for user 86c2cb30466f4a9184e7e8ed34aad193 {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:39.324749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ea5414a-a866-4f5b-a1c2-1cfae9f17cdd tempest-KeyPairsNegativeTestJSON-473412649 tempest-KeyPairsNegativeTestJSON-473412649-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-726304959" status: 404 len: 144 microversion: 2.1 time: 0.017476 Apr 09 21:04:39.325317 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1380/2788] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-726304959 => generated 144 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:39.487295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.488287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:39.498441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.499127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.500335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.501061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.534549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:39.631773 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 204 len: 0 microversion: 2.32 time: 0.286704 Apr 09 21:04:39.632636 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1409/2789] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:04:39 2022] DELETE /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:04:39.643623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.644341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:39.651834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.652286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.653096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.653538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.762115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:39.763094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:39.772710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.773257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:39.774199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:39.774642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.005797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.016184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.019249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.020796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7b3ed42-020b-4e70-bb88-acf1f81b18f0 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2953 microversion: 2.32 time: 0.382781 Apr 09 21:04:40.033956 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1381/2790] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:39 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2953 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:40.035897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.040692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:40.041744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:40.046988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c6667a4-e794-45c2-bbd9-7901bf151feb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1515 microversion: 2.1 time: 0.289208 Apr 09 21:04:40.057232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.057232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.057232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.057232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.059263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1410/2791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:39 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:40.066129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:40.067141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:40.074778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.075226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.076006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.076437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.480844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.489700 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d595b9b-4bc8-462e-bf89-a3f09c58560d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.453500 Apr 09 21:04:40.490274 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1382/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:40 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:40.494984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:40.495792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:40.505168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.505605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.506567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.507199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.538007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.547800 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53344bab-15b6-45ca-9445-46cd3875c03f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.487031 Apr 09 21:04:40.548391 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1411/2793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:40 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:40.560977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56c2f57d-71e0-46f5-8060-78c400d39c7f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed7ac10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:40.608880 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-56c2f57d-71e0-46f5-8060-78c400d39c7f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.058748 Apr 09 21:04:40.609857 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1412/2794] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:40 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:40.612467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.615240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:40.616120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:40.622843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.623423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.623623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.624548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:40.625256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:40.626882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.633069 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7cc0d3ec-e697-46dd-b256-666c0f4216c9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.141587 Apr 09 21:04:40.633822 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1383/2795] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:40 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:40.879434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:40.887706 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2af6129e-0d7d-4827-8490-55ce1d2413d3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.276436 Apr 09 21:04:40.897568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1413/2796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:40 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:41.040097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.042563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.050799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.051768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.052730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.053502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.062311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-96a5c8c2-3de6-49fa-8619-442f25c23b3b req-6eafe6ee-16c9-48f8-97b8-59eb29554757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4", "name": "network-vif-deleted", "tag": "5f958b21-b9df-401e-9d69-3efbcd5ccc23"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:41.070642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-96a5c8c2-3de6-49fa-8619-442f25c23b3b req-6eafe6ee-16c9-48f8-97b8-59eb29554757 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.071083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-96a5c8c2-3de6-49fa-8619-442f25c23b3b req-6eafe6ee-16c9-48f8-97b8-59eb29554757 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.084918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-96a5c8c2-3de6-49fa-8619-442f25c23b3b req-6eafe6ee-16c9-48f8-97b8-59eb29554757 service nova] Creating event network-vif-deleted:5f958b21-b9df-401e-9d69-3efbcd5ccc23 for instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 on nch1-master-1 Apr 09 21:04:41.094717 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-96a5c8c2-3de6-49fa-8619-442f25c23b3b req-6eafe6ee-16c9-48f8-97b8-59eb29554757 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036514 Apr 09 21:04:41.095374 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1414/2797] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:04:41.100828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.102208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.109496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.109957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.110722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.111192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.224259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.233543 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-56fcf944-8e94-4aca-bdcd-152249868a3f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1473 microversion: 2.1 time: 0.136684 Apr 09 21:04:41.235349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1415/2798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1473 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:41.278562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.289946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.291509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.293167 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63372e32-3f2a-4e32-a85b-8de1622166ab tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2953 microversion: 2.32 time: 0.256785 Apr 09 21:04:41.293765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1384/2799] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2953 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:41.506123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.507101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.513822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.514562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.515539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.516149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.565463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.566091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.572859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.573910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.575054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.575851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.738464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.747658 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb4575b4-551d-4e93-8bc6-a2167c3dddf6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.245524 Apr 09 21:04:41.748472 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1416/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:41.762985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-725936c4-dfd0-42cf-bf5f-e1537787c001 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed7a9d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.778315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.790395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ee7edbb-89a7-46a4-8c90-0b667c2d2083 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.229645 Apr 09 21:04:41.791474 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1385/2801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:41.797320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.798328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.809344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.810505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.811649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.812456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.815102 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-725936c4-dfd0-42cf-bf5f-e1537787c001 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.056014 Apr 09 21:04:41.815973 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1417/2802] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:41.902339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.905087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:41.905753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:41.916430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.918501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.918962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.919757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:41.921094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:41.924176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:41.930308 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0360025a-aede-4b35-87fc-37b0e5319c88 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.137350 Apr 09 21:04:41.932788 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1386/2803] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:42.163737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c5a1965e-7e59-4ab6-9e08-f2d677a95417 req-953f0f58-8a23-41f3-90cc-f60be6b74759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f670df63-d8a9-4e25-a6c0-1758746d7c81", "name": "network-vif-plugged", "status": "completed", "tag": "2b9720ed-2fdb-4c7a-b9ab-cdf89e931153"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:42.176209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c5a1965e-7e59-4ab6-9e08-f2d677a95417 req-953f0f58-8a23-41f3-90cc-f60be6b74759 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.176727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c5a1965e-7e59-4ab6-9e08-f2d677a95417 req-953f0f58-8a23-41f3-90cc-f60be6b74759 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.188842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c5a1965e-7e59-4ab6-9e08-f2d677a95417 req-953f0f58-8a23-41f3-90cc-f60be6b74759 service nova] Creating event network-vif-plugged:2b9720ed-2fdb-4c7a-b9ab-cdf89e931153 for instance f670df63-d8a9-4e25-a6c0-1758746d7c81 on nch2-master-1 Apr 09 21:04:42.194374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c5a1965e-7e59-4ab6-9e08-f2d677a95417 req-953f0f58-8a23-41f3-90cc-f60be6b74759 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Apr 09 21:04:42.195769 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1387/2804] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:42.235239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:42.243008 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59e60738-ed4f-4c90-8226-6d654f69cad8 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.343066 Apr 09 21:04:42.252626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:42.253314 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1418/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:41 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:42.256175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:42.271279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.273193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.274129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.274685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.319011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:42.320105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:42.338749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.340436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.345850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.349932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.364734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.367233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.367712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lazy-loading 'fault' on Instance uuid bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:42.460807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:42.470551 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff11285f-327d-493a-80d4-fb49eb7e85d9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 200 len: 1318 microversion: 2.1 time: 0.223474 Apr 09 21:04:42.482100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1388/2806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:42 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:42.765726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:42.766522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:42.775241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.775769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.776817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.777337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.877006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:42.887605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:42.889209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:42.890581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-249bd706-906d-47a7-a8e6-1a9628891e4a tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2953 microversion: 2.32 time: 0.579921 Apr 09 21:04:42.891214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1419/2807] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:42 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2953 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:42.895832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:42.896434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:42.903205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.903912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:42.904861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:42.905496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.187902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.196442 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-709a2b5f-c2c6-4769-9ba8-2f9f9b059f15 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.434928 Apr 09 21:04:43.197204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1389/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:42 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:43.203572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1bc22c24-4c4e-4ced-82df-02d370044f72 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ecdb430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.250960 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1bc22c24-4c4e-4ced-82df-02d370044f72 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.052526 Apr 09 21:04:43.253868 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1390/2809] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:43 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:43.260681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.261584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:43.297071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.297830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.300037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.301704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.604532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.614689 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b36bdfb4-5a44-42ce-9433-5d8b45afcb53 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1316 microversion: 2.1 time: 0.722230 Apr 09 21:04:43.624496 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1420/2810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:42 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:43.631166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.632078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:43.644106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.644861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.645784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.645968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.646297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.656438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.666578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.676240 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b8c0e68-139a-4b3b-9e6b-c6636f2bc665 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.421088 Apr 09 21:04:43.678367 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1391/2811] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:43 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:43.690135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.690135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:43.697228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.697695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.698483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.698920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.713342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. Apr 09 21:04:43.713997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:43.714845 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ad4fcd0-f6e4-4a5d-990e-088ee659ab90 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 404 len: 111 microversion: 2.1 time: 0.035113 Apr 09 21:04:43.715733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1392/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:43 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:43.725612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d0c671f-d671-409d-a6c0-546ccdecf657 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '.version_select at 0x7fb08ecfb5e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.747097 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d0c671f-d671-409d-a6c0-546ccdecf657 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-2020746697" status: 202 len: 0 microversion: 2.1 time: 0.026295 Apr 09 21:04:43.748156 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1393/2813] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2020746697 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:04:43.847846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1671276605", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:43.855082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:43.864413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dcd4c3cb-7208-45ec-85ac-6ccead3d5414 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.237489 Apr 09 21:04:43.865009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1421/2814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:43 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:43.907267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:43.913312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:43.913930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:43.920589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.925481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:43.926692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:43.928774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.389299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:44.399000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:44.400774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:44.402482 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f86170b-6d93-4648-95d6-66366b4c54ea tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2953 microversion: 2.32 time: 0.493043 Apr 09 21:04:44.403817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1422/2815] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:43 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2953 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:44.410526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:44.411399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:44.423246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.423965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.425429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.426033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.779865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:44.792857 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1118c90-a8f8-4764-861f-ff7122cf3c86 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.381496 Apr 09 21:04:44.803220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1423/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:44 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:44.808454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7857e2de-4139-4f86-be2b-713eb35a2678 req-21ec4f23-df21-4418-93ee-7ef4eed7f430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-plugged", "status": "completed", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:44.827063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7857e2de-4139-4f86-be2b-713eb35a2678 req-21ec4f23-df21-4418-93ee-7ef4eed7f430 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.827524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7857e2de-4139-4f86-be2b-713eb35a2678 req-21ec4f23-df21-4418-93ee-7ef4eed7f430 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.854043 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7857e2de-4139-4f86-be2b-713eb35a2678 req-21ec4f23-df21-4418-93ee-7ef4eed7f430 service nova] Creating event network-vif-plugged:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:04:44.868855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7857e2de-4139-4f86-be2b-713eb35a2678 req-21ec4f23-df21-4418-93ee-7ef4eed7f430 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Apr 09 21:04:44.872801 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1424/2817] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:44.882925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bdb306e4-1f19-4ead-9613-b7a29d997dc8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee6e4c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:44.935163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bdb306e4-1f19-4ead-9613-b7a29d997dc8 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.060994 Apr 09 21:04:44.942168 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1425/2818] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:44 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:44.947980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:44.948996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:44.956464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.957272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.958232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.958929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.976875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:44.977438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:44.977939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:44.979042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:44.979492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:44.998358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:44.998951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:44.999878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.000326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.044439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:45.053918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:45.069018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:45.071660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:45.136296 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c002d702-d65d-4fd6-8ce4-66e611048932 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292570 Apr 09 21:04:45.138583 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1394/2819] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:04:45.146387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.147247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.164501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.165018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.165943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.166456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.373765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.385459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03bb2c64-e1eb-4b5c-a607-0bfe83f0a260 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1506 microversion: 2.1 time: 0.441792 Apr 09 21:04:45.397414 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1426/2820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:44 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:45.407773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.408746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.444536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.446753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.446753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.454231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.480187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.544588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.549741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.566795 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-80496013-4818-44c4-b48d-3b14b6054b70 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.426707 Apr 09 21:04:45.568045 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1395/2821] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:45.581851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d16ac990-0157-4721-b604-076848535962 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.586600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d16ac990-0157-4721-b604-076848535962 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.799244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d16ac990-0157-4721-b604-076848535962 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.811849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d16ac990-0157-4721-b604-076848535962 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1209 microversion: 2.1 time: 0.239598 Apr 09 21:04:45.813114 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1396/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1209 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:45.832309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.835979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.855698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.861322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:45.862444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.863607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.864273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.870667 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2adfcf3-f56a-4c61-8034-b9362fc070e5 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.472042 Apr 09 21:04:45.874902 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1427/2823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:45.885077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.888503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.907181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.909618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.910672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.914382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.914955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1e1be50-f42a-4f57-b166-3922594958f7 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips" status: 200 len: 110 microversion: 2.1 time: 0.098774 Apr 09 21:04:45.921356 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1397/2824] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips => generated 110 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:45.928032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:45.930447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:45.950097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.951560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:45.952552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:45.953203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.516623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.527417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.536458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.541700 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0070ba58-29e5-4cfa-9efc-02a918d63aa5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2932 microversion: 2.32 time: 0.661680 Apr 09 21:04:46.542345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1428/2825] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2932 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:46.557577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.558351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:46.565023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.566929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.569785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.570424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.621563 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7750bd1-27bd-4206-9e38-441466c2b108 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips" status: 200 len: 110 microversion: 2.1 time: 0.077872 Apr 09 21:04:46.622164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1429/2826] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:04:46 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips => generated 110 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:46.632822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29f2928d-7fe8-4db2-b309-46e58859ad91 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec4c3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.696205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29f2928d-7fe8-4db2-b309-46e58859ad91 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.064321 Apr 09 21:04:46.696756 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1430/2827] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:46 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:46.703386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.704019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:46.710983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.711366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.712400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.713012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.724052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.741767 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed2a0db7-07c5-41b4-80dc-aec5f5eacfac tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.823174 Apr 09 21:04:46.749611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1398/2828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:45 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:46.762317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.763094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:46.780140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.782068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.788181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.789262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.856718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa85ff5f-73e6-4898-be62-002d11ddd85f tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips/tempest-ServerAddressesTestJSON-2091557024-network" status: 200 len: 95 microversion: 2.1 time: 0.105777 Apr 09 21:04:46.859534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1399/2829] 10.222.0.30 () {58 vars in 1400 bytes} [Sat Apr 9 21:04:46 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81/ips/tempest-ServerAddressesTestJSON-2091557024-network => generated 95 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:04:46.873085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.878188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:46.899869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.900775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.901915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:46.902613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:46.910596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.935937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.940890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:46.960269 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87125782-c974-46b6-b4c0-783e36293a0f tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.260827 Apr 09 21:04:46.971606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1431/2830] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:46 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:46.997772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:46.998751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:47.021080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.022027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.023161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.023970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.103925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:47.110679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:47.119343 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd337a0d-5f86-4c4a-b965-f4674abc8c88 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1269 microversion: 2.1 time: 0.257891 Apr 09 21:04:47.119947 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1400/2831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:46 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1269 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:47.153472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:47.157494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:47.180603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.181152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.181982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.182430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.341082 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-644d91ff-3345-4d60-b100-1364f0c29a15 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 204 len: 0 microversion: 2.1 time: 0.363575 Apr 09 21:04:47.345419 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1432/2832] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:46 2022] DELETE /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:47.348730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-202f42fc-5a1b-4c38-b93d-87389fbe6305 req-472928d9-c1a8-486a-8f62-d905304eaad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79", "name": "network-vif-plugged", "status": "completed", "tag": "69a00c5c-3247-4aad-9312-e3179f59e693"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:47.374678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-202f42fc-5a1b-4c38-b93d-87389fbe6305 req-472928d9-c1a8-486a-8f62-d905304eaad5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.375130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-202f42fc-5a1b-4c38-b93d-87389fbe6305 req-472928d9-c1a8-486a-8f62-d905304eaad5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.387670 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-202f42fc-5a1b-4c38-b93d-87389fbe6305 req-472928d9-c1a8-486a-8f62-d905304eaad5 service nova] Creating event network-vif-plugged:69a00c5c-3247-4aad-9312-e3179f59e693 for instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 on nch1-master-1 Apr 09 21:04:47.404784 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-202f42fc-5a1b-4c38-b93d-87389fbe6305 req-472928d9-c1a8-486a-8f62-d905304eaad5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060568 Apr 09 21:04:47.405763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1433/2833] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:47.417345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:47.418075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:47.439987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.439987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.439987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.439987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.641498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:47.652708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-727bc51f-19f5-48dc-97a6-a6d574a97904 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.522149 Apr 09 21:04:47.666401 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1401/2834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:47 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:47.679195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:47.679888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:47.694613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.695084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:47.695909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:47.699976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.060877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.069397 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38b951c2-cdfa-4539-944d-73dd16a2fd95 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1512 microversion: 2.1 time: 0.662430 Apr 09 21:04:48.090890 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1434/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:47 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:48.096606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-be34fc15-71f3-443a-b0fb-db48cc035518 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed56430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:48.221433 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-be34fc15-71f3-443a-b0fb-db48cc035518 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.129086 Apr 09 21:04:48.222040 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1435/2836] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:48 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:48.234592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:48.235220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:48.261926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.262368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.263465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.263597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.268954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.287662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.290190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.291763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9ed528d-4cc0-40c3-9b07-2816e7ffddf5 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2864 microversion: 2.32 time: 0.623998 Apr 09 21:04:48.292667 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1402/2837] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:47 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2864 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:48.312995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-12e1f3b1-fb3d-4a77-99ca-3cadb72ce6e1 req-771a8ec2-34bb-4be6-8494-9626c69042a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-deleted", "tag": "598fea91-f00b-41e4-8273-ec325cadb0f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:48.338754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-12e1f3b1-fb3d-4a77-99ca-3cadb72ce6e1 req-771a8ec2-34bb-4be6-8494-9626c69042a1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.339257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-12e1f3b1-fb3d-4a77-99ca-3cadb72ce6e1 req-771a8ec2-34bb-4be6-8494-9626c69042a1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.368391 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12e1f3b1-fb3d-4a77-99ca-3cadb72ce6e1 req-771a8ec2-34bb-4be6-8494-9626c69042a1 service nova] Creating event network-vif-deleted:598fea91-f00b-41e4-8273-ec325cadb0f1 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:48.378911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-12e1f3b1-fb3d-4a77-99ca-3cadb72ce6e1 req-771a8ec2-34bb-4be6-8494-9626c69042a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069064 Apr 09 21:04:48.381683 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1403/2838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:48.389882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:48.391989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:48.400821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.401786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.403130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.403768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.896390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.904910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.911260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:48.921014 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6060356-b35e-467e-bbd2-53a7820f3d5d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.537483 Apr 09 21:04:48.923242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1404/2839] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:48 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:48.933325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:48.933956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:48.948931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.949438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:48.953731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:48.954199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.023565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:49.034411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d73fe38d-cfe5-45b8-b199-8c044f0a1075 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1315 microversion: 2.1 time: 0.811303 Apr 09 21:04:49.035549 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1436/2840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:48 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:49.043013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:49.043895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:49.057770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.058554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.059558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.062017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.157521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:49.167447 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43c4cad7-0c6f-41d7-9ca8-73767b17ab73 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1267 microversion: 2.1 time: 0.243055 Apr 09 21:04:49.172358 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1405/2841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:48 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:49.190403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:49.191944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:49.201092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.207129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.209583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.210721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.484419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:49.493776 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0bb8836-df6c-4494-9407-91b524650fd6 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.456776 Apr 09 21:04:49.508987 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1437/2842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:49 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:49.521296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9e77bb2-f168-4640-8085-a736ef8acdce tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec4cc10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:49.634543 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9e77bb2-f168-4640-8085-a736ef8acdce tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.130155 Apr 09 21:04:49.643932 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1438/2843] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:49 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:49.675545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:49.676879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:49.687856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.688585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.690587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.691282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.793360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:49.801076 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7acf1ec1-e32b-4066-8aa0-d10ce29256d1 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1512 microversion: 2.1 time: 0.626199 Apr 09 21:04:49.811053 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1406/2844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:49 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:49.811053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-unplugged", "status": "completed", "tag": "98efa2b7-5e44-4da7-8cbc-fbc1db0c459e"}, {"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-unplugged", "status": "completed", "tag": "aeadbd1f-8d76-4ad3-84a7-50139f5852c5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:49.836375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.837159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.866611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] Creating event network-vif-unplugged:98efa2b7-5e44-4da7-8cbc-fbc1db0c459e for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:49.867408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] Creating event network-vif-unplugged:aeadbd1f-8d76-4ad3-84a7-50139f5852c5 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:49.879546 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-312cbd86-f3e8-4c2c-a7ff-d86f45e48540 req-482779d6-9e41-4256-b627-ae9b5ca4ed67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.072180 Apr 09 21:04:49.880181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1407/2845] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:49.946304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:49.947570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:49.978074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.983479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:49.984604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:49.985355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:50.445379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.465827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.467784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.484688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-13e10f70-4990-43c9-9a08-2e883cafdba2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.544321 Apr 09 21:04:50.499235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1408/2846] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:49 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:50.505912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:50.506540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:50.526276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:50.533903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:50.535106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:50.535581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:50.635821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.652456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.654240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:50.655544 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4655ab33-477d-413c-80d7-6fcb9741feda tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2703 microversion: 2.32 time: 1.005713 Apr 09 21:04:50.675814 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1439/2847] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:49 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2703 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:50.681802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:50.682704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:50.689674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:50.690526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:50.692283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:50.692889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.245949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:51.282049 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4827dda-0580-451a-83ea-b2313d659c46 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.602438 Apr 09 21:04:51.285959 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1440/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:50 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:51.307157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:51.315801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0744306-f76b-4e79-8c14-89de4402580c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1501 microversion: 2.1 time: 0.815554 Apr 09 21:04:51.320091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:51.323315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:51.329116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1409/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:50 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1501 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:51.342832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b68a2829-2c04-442b-93b4-0409fb894a89 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ece41f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:51.348451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.351050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.351970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.357698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.427625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b68a2829-2c04-442b-93b4-0409fb894a89 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.097314 Apr 09 21:04:51.428299 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1410/2850] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:51 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:51.456422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:51.457231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:51.465520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.466135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.467063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.467942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.507903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.508383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.509012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lazy-loading 'fault' on Instance uuid f670df63-d8a9-4e25-a6c0-1758746d7c81 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:04:51.621644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dfc7d9ec04440290b61e87a8fecad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab023af112834d0eb9a847bacc3fa37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:51.633512 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ca56a31-bd50-4268-9461-9b55832aae3c tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 200 len: 1306 microversion: 2.1 time: 0.199437 Apr 09 21:04:51.634170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1411/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:51 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:51.653415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-be77c1a9-369f-4754-a028-1106eedb3737 req-444f1f06-79d0-4a02-8f6d-a4a171bb2283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-deleted", "tag": "87ea195a-9ea5-4807-8aeb-44650ead0f55"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:51.678402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be77c1a9-369f-4754-a028-1106eedb3737 req-444f1f06-79d0-4a02-8f6d-a4a171bb2283 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.679176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be77c1a9-369f-4754-a028-1106eedb3737 req-444f1f06-79d0-4a02-8f6d-a4a171bb2283 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.700060 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-be77c1a9-369f-4754-a028-1106eedb3737 req-444f1f06-79d0-4a02-8f6d-a4a171bb2283 service nova] Creating event network-vif-deleted:87ea195a-9ea5-4807-8aeb-44650ead0f55 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:51.710796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-be77c1a9-369f-4754-a028-1106eedb3737 req-444f1f06-79d0-4a02-8f6d-a4a171bb2283 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066308 Apr 09 21:04:51.714948 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1412/2852] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:51.720866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ae3e0e82-be3e-43b3-b94c-34d834af57ec req-2c0d910b-705c-4c99-834d-b3abba1f9fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f670df63-d8a9-4e25-a6c0-1758746d7c81", "name": "network-vif-deleted", "tag": "2b9720ed-2fdb-4c7a-b9ab-cdf89e931153"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:51.746517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ae3e0e82-be3e-43b3-b94c-34d834af57ec req-2c0d910b-705c-4c99-834d-b3abba1f9fc7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.750036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ae3e0e82-be3e-43b3-b94c-34d834af57ec req-2c0d910b-705c-4c99-834d-b3abba1f9fc7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.773611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ae3e0e82-be3e-43b3-b94c-34d834af57ec req-2c0d910b-705c-4c99-834d-b3abba1f9fc7 service nova] Creating event network-vif-deleted:2b9720ed-2fdb-4c7a-b9ab-cdf89e931153 for instance f670df63-d8a9-4e25-a6c0-1758746d7c81 on nch2-master-1 Apr 09 21:04:51.791067 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ae3e0e82-be3e-43b3-b94c-34d834af57ec req-2c0d910b-705c-4c99-834d-b3abba1f9fc7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074299 Apr 09 21:04:51.792416 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1413/2853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:51.798033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:51.799007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:51.811925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.815811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.817020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:51.821010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:51.866408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:04:52.046634 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42f6db9d-177d-4e4e-9381-e50d87507a1e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 204 len: 0 microversion: 2.1 time: 0.252334 Apr 09 21:04:52.050680 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1414/2854] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:04:51 2022] DELETE /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:04:52.056780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:52.063184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:52.087244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.088017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.089236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.089922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.218880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.231240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.235254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.236164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.250103 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53518da7-7bf8-48b7-ac45-3845b64516cf tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.957862 Apr 09 21:04:52.253753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c986ea0-920b-4bc0-9df3-72df67f376d2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.201275 Apr 09 21:04:52.254094 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1441/2855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:51 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:52.266386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:52.267004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:52.269260 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1415/2856] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:52.274230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-91ab89bf-d10e-41fd-a049-f089fbed8834 req-53f9764d-7311-49e3-bc5a-72b9c9d30b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-unplugged", "status": "completed", "tag": "2447064d-f2f6-4455-bc1d-f66ad73dad67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:52.283785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.284180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.284981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.285455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.298314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-91ab89bf-d10e-41fd-a049-f089fbed8834 req-53f9764d-7311-49e3-bc5a-72b9c9d30b08 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.300658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-91ab89bf-d10e-41fd-a049-f089fbed8834 req-53f9764d-7311-49e3-bc5a-72b9c9d30b08 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.314936 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-91ab89bf-d10e-41fd-a049-f089fbed8834 req-53f9764d-7311-49e3-bc5a-72b9c9d30b08 service nova] Creating event network-vif-unplugged:2447064d-f2f6-4455-bc1d-f66ad73dad67 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:52.328090 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-91ab89bf-d10e-41fd-a049-f089fbed8834 req-53f9764d-7311-49e3-bc5a-72b9c9d30b08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057242 Apr 09 21:04:52.329479 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1416/2857] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:52.340880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:52.341908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:52.362555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.363418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.364592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.365315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.771306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.785938 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fafefae7-bda9-4144-87a3-f550e46227da tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1507 microversion: 2.1 time: 0.454873 Apr 09 21:04:52.787250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1417/2858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:52.792483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:52.793387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:52.803982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.804827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.805857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:52.806455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:52.854571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.876834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.883025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:52.888982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf93706c-2ae1-4e4a-87ad-535b61966578 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2500 microversion: 2.32 time: 0.633268 Apr 09 21:04:52.896197 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1442/2859] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2500 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:52.915614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a785ed37-5c30-4c9f-832f-e7d0fcfb643f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec4cca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:52.998356 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a785ed37-5c30-4c9f-832f-e7d0fcfb643f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.100286 Apr 09 21:04:52.999316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1443/2860] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:53.018167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:53.018814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] [instance: f670df63-d8a9-4e25-a6c0-1758746d7c81] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:53.038172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.038629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.041954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.044391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.097052 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] HTTP exception thrown: Instance f670df63-d8a9-4e25-a6c0-1758746d7c81 could not be found. Apr 09 21:04:53.097680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] Returning 404 to user: Instance f670df63-d8a9-4e25-a6c0-1758746d7c81 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:53.105953 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c40d7a2-3a08-48cf-aeda-1e8d37c0f021 tempest-ServerAddressesTestJSON-573671989 tempest-ServerAddressesTestJSON-573671989-project] 10.222.0.30 "GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81" status: 404 len: 111 microversion: 2.1 time: 0.097466 Apr 09 21:04:53.109139 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1444/2861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/servers/f670df63-d8a9-4e25-a6c0-1758746d7c81 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:53.271071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:53.271766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:53.272145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:53.279897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac7d75f9-f6cb-4042-b2ae-833014845e97 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.491196 Apr 09 21:04:53.284094 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1418/2862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:52 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:53.291098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.294429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:53.294973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.297003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.301787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.309156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:53.334426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.338067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.341888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:53.344508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:53.495172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:53.509915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:53.511931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:53.524561 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-33f57765-4d5f-4d37-9ebd-9acfcba784b9 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.239074 Apr 09 21:04:53.525949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1419/2863] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:53 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:53.740720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Action: 'create', calling method: .version_select at 0x7fb08ee458b0>, body: {"keypair": {"name": "tempest-keypair-983690248"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:53.758899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:53.769160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for user fbb1a0d6db7847aa851d3f8244c998c7 and project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:54.014345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:54.029953 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc249227-9c3f-43c4-a2f6-9c9f45908955 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.763109 Apr 09 21:04:54.035244 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1445/2864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:53 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:54.047640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:54.051451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:54.067789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:54.068445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:54.069915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:54.072145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:54.468551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:54.483827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-467d7e8d-4518-4d1b-8694-4cb655d031d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 200 len: 1465 microversion: 2.1 time: 0.443264 Apr 09 21:04:54.484492 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1446/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:54 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 1465 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:54.492859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:54.497555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:54.509555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:54.513108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:54.518049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:54.518753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:54.879401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:54.888643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:54.894346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:54.896617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a9168e7-d4a4-44e4-92e7-8756b471a43c tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2500 microversion: 2.32 time: 0.409677 Apr 09 21:04:54.902091 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1447/2866] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:54 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2500 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:54.907208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c058b9e7-2ec5-45b3-9888-7b0b394ad953 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ea8e0d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:54.984503 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c058b9e7-2ec5-45b3-9888-7b0b394ad953 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.080972 Apr 09 21:04:54.985508 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1448/2867] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:54 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:54.994008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-deleted", "tag": "2447064d-f2f6-4455-bc1d-f66ad73dad67"}, {"name": "network-changed", "server_uuid": "d65d7765-2bd1-40ba-adc2-3d6fb923297b", "tag": "1fc04f79-02c1-4f55-b1c0-6258e35f28a4"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:55.016462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.017338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.056632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] Creating event network-vif-deleted:2447064d-f2f6-4455-bc1d-f66ad73dad67 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:55.057550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] Creating event network-changed:1fc04f79-02c1-4f55-b1c0-6258e35f28a4 for instance d65d7765-2bd1-40ba-adc2-3d6fb923297b on nch2-master-1 Apr 09 21:04:55.069002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ade1d221-e730-48a6-af94-a28bb2e91c9e req-5cc5d8fd-0f80-45f2-8564-28ba4f837b9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081928 Apr 09 21:04:55.070038 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1449/2868] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:55.077458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:55.079578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:55.103981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.107632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.110800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.111615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.417722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:55.435402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for user fbb1a0d6db7847aa851d3f8244c998c7 and project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:55.481970 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9221644c-48bb-4796-95a1-8528a59f77ab tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.954624 Apr 09 21:04:55.489762 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1420/2869] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:04:53 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:55.501890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:55.504152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:55.518378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.525326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.532016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.532683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.630529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:55.650522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51e33603-f244-4fae-8ae4-62cd683d99ed tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.578316 Apr 09 21:04:55.650932 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1450/2870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:55 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:55.656322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-48d23cb7-e143-4a03-b08a-2adf77b95a90 req-fc4f0463-25de-46b6-903c-eeb215b581cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79", "name": "network-vif-deleted", "tag": "69a00c5c-3247-4aad-9312-e3179f59e693"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:55.665330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-48d23cb7-e143-4a03-b08a-2adf77b95a90 req-fc4f0463-25de-46b6-903c-eeb215b581cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.666076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-48d23cb7-e143-4a03-b08a-2adf77b95a90 req-fc4f0463-25de-46b6-903c-eeb215b581cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.696009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-48d23cb7-e143-4a03-b08a-2adf77b95a90 req-fc4f0463-25de-46b6-903c-eeb215b581cd service nova] Creating event network-vif-deleted:69a00c5c-3247-4aad-9312-e3179f59e693 for instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 on nch1-master-1 Apr 09 21:04:55.703396 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-48d23cb7-e143-4a03-b08a-2adf77b95a90 req-fc4f0463-25de-46b6-903c-eeb215b581cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050994 Apr 09 21:04:55.711134 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1451/2871] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:55.718558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:55.722183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:55.732812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.733421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.733633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:55.734525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.735190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.765736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:55.769834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:55.786463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f1f6b27-b344-4382-8975-21cab3930a9e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.293045 Apr 09 21:04:55.798708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1421/2872] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:55 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:55.806808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:55.809285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:55.827762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.828378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.830570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.831305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.872813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. Apr 09 21:04:55.873835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:04:55.874802 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-036f65ef-ea7e-4da4-b2c0-e8a50b8c9ef8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 404 len: 111 microversion: 2.1 time: 0.082685 Apr 09 21:04:55.884480 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1422/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:55 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:04:55.920735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:55.921496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:55.935622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.943246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:55.945904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:55.947646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:56.294477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:56.304474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa7136ff-4a92-49ff-ba33-972dd1811e21 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.590421 Apr 09 21:04:56.309368 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1452/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:55 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:56.319688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-111397e1-e080-4f9a-9e62-ff2758fc8437 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eba58b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:56.422992 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-111397e1-e080-4f9a-9e62-ff2758fc8437 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.112291 Apr 09 21:04:56.426067 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1453/2875] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:56 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:56.443865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1907401907", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:56.471806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:56.488846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:56.490917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:56.493092 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5dbdb37c-785f-4ddf-9223-0af881e196d2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2165 microversion: 2.32 time: 0.576992 Apr 09 21:04:56.498440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1423/2876] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:55 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2165 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:56.542322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:04:56.668538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:56.669340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:56.681788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:56.683603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:56.686228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:56.689908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.238706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:57.256758 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbb96ef3-afdc-48c9-92f6-2ea657da9cbf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.586462 Apr 09 21:04:57.270466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1424/2877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:56 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:57.273763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:57.274498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:57.286054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.286972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.288200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.288875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.523841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:04:57.524424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:04:57.525405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:04:57.526092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:04:57.526580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:04:57.539020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.539562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.540718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.543482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.574779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:57.579477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:04:57.584045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:57.587945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:57.598533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6194a4c-3deb-45a2-93f9-a76ef9f7f89d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.329004 Apr 09 21:04:57.599052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1425/2878] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:57 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:57.618009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f3708fa0-109d-45ec-a677-e6a0b15982ea req-52e5e3e8-14bf-484e-8c1a-08f0c4d54acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-deleted", "tag": "aeadbd1f-8d76-4ad3-84a7-50139f5852c5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:04:57.621830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:04:57.651567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f3708fa0-109d-45ec-a677-e6a0b15982ea req-52e5e3e8-14bf-484e-8c1a-08f0c4d54acc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.652021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f3708fa0-109d-45ec-a677-e6a0b15982ea req-52e5e3e8-14bf-484e-8c1a-08f0c4d54acc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.652746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:04:57.659346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:04:57.689239 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f3708fa0-109d-45ec-a677-e6a0b15982ea req-52e5e3e8-14bf-484e-8c1a-08f0c4d54acc service nova] Creating event network-vif-deleted:aeadbd1f-8d76-4ad3-84a7-50139f5852c5 for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:04:57.700531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f3708fa0-109d-45ec-a677-e6a0b15982ea req-52e5e3e8-14bf-484e-8c1a-08f0c4d54acc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089808 Apr 09 21:04:57.702995 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1426/2879] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:04:57.718954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:57.720155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:57.730979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.743112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.745241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.746657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.769700 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46b9014a-8d61-4b13-9ae1-28e9c7af4e4f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340162 Apr 09 21:04:57.777324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1454/2880] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:04:57.810220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b8b2b56-e897-4fb2-8c27-f4123da01ed2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eb575e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:57.920130 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b8b2b56-e897-4fb2-8c27-f4123da01ed2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.141537 Apr 09 21:04:57.920986 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1455/2881] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:57 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:57.931679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:57.936554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:57.950691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.953558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:57.956492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:57.957131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:58.279212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:58.292016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a97e8863-dc2f-4deb-82a5-8e7991734ebd tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.587067 Apr 09 21:04:58.298308 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1427/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:57 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:58.312174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b2c4364-f396-4b10-98a0-df8bbfceb470 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:58.312847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b2c4364-f396-4b10-98a0-df8bbfceb470 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:58.428879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:58.440920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0b2c4364-f396-4b10-98a0-df8bbfceb470 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:58.453523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:58.456944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b2c4364-f396-4b10-98a0-df8bbfceb470 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1215 microversion: 2.1 time: 0.157390 Apr 09 21:04:58.461136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1428/2883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:58 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:58.465820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:58.467456 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c788556-7e8c-4dfd-9c7b-1822d9d2eaf2 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2051 microversion: 2.32 time: 0.544920 Apr 09 21:04:58.473277 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1456/2884] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:57 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2051 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:04:58.475012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:58.475675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:58.516762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:58.524854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:58.525924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:58.527717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:58.621824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:58.623754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:58.636505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:58.637520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:58.639870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:58.640571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.027388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:59.040542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85e56979-73d3-431f-9616-757e9511f308 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.578167 Apr 09 21:04:59.052412 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1429/2885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:58 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:59.065394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3cca5d5-7b9b-4e05-a18e-29a196208f6e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee2d820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:59.083039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:59.094644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:59.097255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:59.109084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7efd864a-26d8-4fd2-9a20-ebdf3f85139e tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.494646 Apr 09 21:04:59.110241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1457/2886] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:58 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:04:59.144643 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3cca5d5-7b9b-4e05-a18e-29a196208f6e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.090264 Apr 09 21:04:59.157950 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1430/2887] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:04:59 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:04:59.333756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:59.334389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:59.365223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.365757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.366726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.367420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.476392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:59.477238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:59.497397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.499857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.500749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.502928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.894780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:04:59.907799 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34736efd-4bd5-4157-a90d-1d69193cec51 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1275 microversion: 2.1 time: 0.437548 Apr 09 21:04:59.918814 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1431/2888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:59 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1275 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:04:59.925339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:04:59.926421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:04:59.934047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.934919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:04:59.935928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:04:59.936577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:00.076731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:00.090542 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5b610a4-6226-466a-a527-fac986d2d76b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1471 microversion: 2.1 time: 0.778420 Apr 09 21:05:00.097612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1458/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:04:59 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1471 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:00.112018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:00.114131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:00.123028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:00.124553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:00.125887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:00.127397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:00.461263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:00.474641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:00.477016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbc8f96549e4dfaaf941d571addb9c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:00.478782 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6da0a754-2000-403a-be3c-af22e9b64094 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 200 len: 2051 microversion: 2.32 time: 0.557443 Apr 09 21:05:00.479973 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1432/2890] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:04:59 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 2051 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:00.486522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:00.487379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:00.497599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:00.498089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:00.498893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:00.499333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:00.808325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:00.820724 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c4bf0f6-3c2e-4f7d-90eb-4127a7aeac4d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.717564 Apr 09 21:05:00.822165 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1459/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:00 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:00.835001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f85c51c1-167b-4659-b9a9-145ecd810c14 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eb3e3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:00.933139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f85c51c1-167b-4659-b9a9-145ecd810c14 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.107702 Apr 09 21:05:00.933649 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1460/2892] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:00 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:00.938920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2110456819", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0bc5e448-da4a-443d-9ac2-ea8630aa20c9"}], "security_groups": [{"name": "tempest-securitygroup--1387737573"}], "key_name": "tempest-keypair-983690248", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:01.328870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:01.339627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:01.342251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:01.348294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d68445f9-6a2e-4f62-9584-dbcb8369fef2 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1447 microversion: 2.75 time: 0.866944 Apr 09 21:05:01.348888 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1433/2893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:00 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1447 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:01.355587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-209f5c73-96d2-4ebd-8c01-0d1609d8209a req-667cb306-e74d-4360-b6e0-1b64b81d65d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390", "name": "network-vif-deleted", "tag": "98efa2b7-5e44-4da7-8cbc-fbc1db0c459e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:01.375854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-209f5c73-96d2-4ebd-8c01-0d1609d8209a req-667cb306-e74d-4360-b6e0-1b64b81d65d1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:01.376623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-209f5c73-96d2-4ebd-8c01-0d1609d8209a req-667cb306-e74d-4360-b6e0-1b64b81d65d1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:01.396850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] validate_networks() for [('0bc5e448-da4a-443d-9ac2-ea8630aa20c9', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:01.402793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-209f5c73-96d2-4ebd-8c01-0d1609d8209a req-667cb306-e74d-4360-b6e0-1b64b81d65d1 service nova] Creating event network-vif-deleted:98efa2b7-5e44-4da7-8cbc-fbc1db0c459e for instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 on nch2-master-1 Apr 09 21:05:01.408374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-209f5c73-96d2-4ebd-8c01-0d1609d8209a req-667cb306-e74d-4360-b6e0-1b64b81d65d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057191 Apr 09 21:05:01.409744 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1434/2894] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:01.494457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1148392746", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "4012c036-b890-423e-af25-300f42e827cd"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:01.622410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] validate_networks() for [('4012c036-b890-423e-af25-300f42e827cd', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:02.638579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for project 48b917a437e7432bbfc884a1067fdfaa. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:02.651184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for user fbb1a0d6db7847aa851d3f8244c998c7 and project 48b917a437e7432bbfc884a1067fdfaa. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:02.658314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:02.658888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:02.659343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:02.659820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:02.660297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:02.672794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:02.673598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:02.674260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:02.674852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.675389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.675898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:02.676478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:02.676735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.677351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.687051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.687794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.688725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.689308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.707194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Getting quotas for project 9867219547a94880ba048320401ac44a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:02.715754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Getting quotas for user 5981fe7d48ad4381a72d723ea5c6a08f and project 9867219547a94880ba048320401ac44a. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:02.716109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:02.722698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Getting quotas for user fbb1a0d6db7847aa851d3f8244c998c7 and project 48b917a437e7432bbfc884a1067fdfaa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:02.730314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:02.733172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:02.736437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:02.738890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:02.789978 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c39a850-8c17-49a0-b11e-68769a19d23c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378787 Apr 09 21:05:02.795589 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1435/2895] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:02.802036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:02.802956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:02.810793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.812853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.814478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.815102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.826263 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34bd5a58-8ddb-4923-9547-e975a5af721e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.891034 Apr 09 21:05:02.827431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1461/2896] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:00 2022] POST /compute/v2.1/servers => generated 407 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:02.837464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:02.841274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:02.854547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.855004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:02.855802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:02.856242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.208841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.217128 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c1cc2d2-9c35-48d1-b3be-6387cad17dff tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1477 microversion: 2.1 time: 0.388333 Apr 09 21:05:03.230852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1462/2897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:02 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.236437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.237883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:03.240343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.252527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.253241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.254165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.254270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-802c5d2a-38aa-42ca-aa67-6a4f8dfe978a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.457270 Apr 09 21:05:03.256889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.263890 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1436/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:02 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.273322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1742653f-b2c1-4349-b252-cd2fb4d6cfa1 req-63da30b8-1b87-4a61-b1ef-ce101597cd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d7765-2bd1-40ba-adc2-3d6fb923297b", "name": "network-vif-plugged", "status": "completed", "tag": "1fc04f79-02c1-4f55-b1c0-6258e35f28a4"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:03.287509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] HTTP exception thrown: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. Apr 09 21:05:03.288018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Returning 404 to user: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:03.289588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5477c3fc-cb40-48cf-89fb-c2f6c6cd9612 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 404 len: 111 microversion: 2.32 time: 0.056842 Apr 09 21:05:03.300534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1742653f-b2c1-4349-b252-cd2fb4d6cfa1 req-63da30b8-1b87-4a61-b1ef-ce101597cd87 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.300976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1742653f-b2c1-4349-b252-cd2fb4d6cfa1 req-63da30b8-1b87-4a61-b1ef-ce101597cd87 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.312921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1463/2899] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:03.318255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.324189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:03.332144 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1742653f-b2c1-4349-b252-cd2fb4d6cfa1 req-63da30b8-1b87-4a61-b1ef-ce101597cd87 service nova] Creating event network-vif-plugged:1fc04f79-02c1-4f55-b1c0-6258e35f28a4 for instance d65d7765-2bd1-40ba-adc2-3d6fb923297b on nch2-master-1 Apr 09 21:05:03.339559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.340151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.341117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.341713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.361580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1742653f-b2c1-4349-b252-cd2fb4d6cfa1 req-63da30b8-1b87-4a61-b1ef-ce101597cd87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078564 Apr 09 21:05:03.363852 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1437/2900] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:03.370753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec1f6f40-44c0-4305-8a64-ed71632ee076 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08efdddc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.488219 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec1f6f40-44c0-4305-8a64-ed71632ee076 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.122678 Apr 09 21:05:03.496548 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1438/2901] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.510662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.512374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:03.531182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.531713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.532546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.532986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.686002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.701212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.704222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.711706 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ff2db5d-fc48-4176-a9ff-43c9defb5b20 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1453 microversion: 2.75 time: 0.213794 Apr 09 21:05:03.725272 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1439/2902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:03.730796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.731763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:03.740927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.745985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.746636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.747565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.748129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.750227 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c654ed49-745e-4b3f-9412-96485043b4da tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.435954 Apr 09 21:05:03.751192 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1464/2903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.764073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.764795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:03.771995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.772545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.773612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.774076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.824274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.835202 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5cbc37ea-ed5d-4d0b-88fc-532f3fee1c34 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1229 microversion: 2.1 time: 0.107973 Apr 09 21:05:03.835839 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1440/2904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.841064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59940bd3-8f78-4630-97ec-7a8e46370ffa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '.version_select at 0x7fb08ecfb040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:03.873442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:03.886059 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-59940bd3-8f78-4630-97ec-7a8e46370ffa tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927685062" status: 204 len: 0 microversion: 2.32 time: 0.048805 Apr 09 21:05:03.886451 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7d034c8-0218-40d3-abab-1611acd35676 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1273 microversion: 2.1 time: 0.134029 Apr 09 21:05:03.886678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1441/2905] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Apr 9 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927685062 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:05:03.893191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-25c66b4c-dd96-49ca-bd70-7b07e612287e req-614fffee-3880-412f-a9dd-11bd1f8bb757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5fe469-5023-4fb7-a476-c2d2317003ad", "tag": "ae4c122c-3b88-4a0c-a595-2abb00518e1c"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:03.901703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1465/2906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:03 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:03.903723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-25c66b4c-dd96-49ca-bd70-7b07e612287e req-614fffee-3880-412f-a9dd-11bd1f8bb757 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:03.904171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-25c66b4c-dd96-49ca-bd70-7b07e612287e req-614fffee-3880-412f-a9dd-11bd1f8bb757 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:03.917198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-25c66b4c-dd96-49ca-bd70-7b07e612287e req-614fffee-3880-412f-a9dd-11bd1f8bb757 service nova] Creating event network-changed:ae4c122c-3b88-4a0c-a595-2abb00518e1c for instance 3b5fe469-5023-4fb7-a476-c2d2317003ad on nch2-master-1 Apr 09 21:05:03.948377 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-25c66b4c-dd96-49ca-bd70-7b07e612287e req-614fffee-3880-412f-a9dd-11bd1f8bb757 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059725 Apr 09 21:05:03.962640 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1442/2907] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:04.241249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.241930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:04.248506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.248981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.250153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.250602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.274378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.275394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:04.296423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.297626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.300479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.301816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.472607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:04.481801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-02cb8626-88d6-43ed-abcc-33d318f1a88d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1477 microversion: 2.1 time: 0.247765 Apr 09 21:05:04.492227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1466/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:04.514549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f986cbc-d89b-4d89-85c1-9f4015596ab6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eabb790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.567848 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f986cbc-d89b-4d89-85c1-9f4015596ab6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1454 microversion: 2.1 time: 0.059018 Apr 09 21:05:04.568703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1467/2909] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:04.684703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:04.695199 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95ff5f03-35da-4c45-bc3a-29f3d017b45d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.426842 Apr 09 21:05:04.696597 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1443/2910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:04.735430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.736317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:04.744545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.745684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.746979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.747740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.767923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.769310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:04.785531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.786272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.787438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.790056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.899222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:04.911567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:04.913869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:04.919855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3d2c2ce-690f-46bf-852a-241439c0f28d tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1453 microversion: 2.75 time: 0.191996 Apr 09 21:05:04.945452 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1468/2911] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:04.954086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:04.959837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:04.967636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.976340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:04.977369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:04.977903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.071067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:05.076237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:05.081146 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7614c9f8-0760-4300-906b-ca2152838f13 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1277 microversion: 2.1 time: 0.132944 Apr 09 21:05:05.085369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1469/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:05.094287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4cacbe87-4d92-4235-82fc-d1ae474985ea tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1309 microversion: 2.1 time: 0.330526 Apr 09 21:05:05.094916 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1444/2913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:04 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:05.095735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.096425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:05.106256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.106714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.107498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.107929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.170896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:05.179364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f9bdf1e-8119-42f0-9436-2c03982b7840 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1321 microversion: 2.1 time: 0.092885 Apr 09 21:05:05.179952 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1470/2914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:05.382553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-84e2a3a6-a442-4000-b8e2-da50a4a4758f req-787cbee7-befd-4bf7-aca1-624b5c76d271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-unplugged", "status": "completed", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:05.394950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-84e2a3a6-a442-4000-b8e2-da50a4a4758f req-787cbee7-befd-4bf7-aca1-624b5c76d271 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.396466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-84e2a3a6-a442-4000-b8e2-da50a4a4758f req-787cbee7-befd-4bf7-aca1-624b5c76d271 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.415698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-84e2a3a6-a442-4000-b8e2-da50a4a4758f req-787cbee7-befd-4bf7-aca1-624b5c76d271 service nova] Creating event network-vif-unplugged:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:05:05.424415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-84e2a3a6-a442-4000-b8e2-da50a4a4758f req-787cbee7-befd-4bf7-aca1-624b5c76d271 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049275 Apr 09 21:05:05.426250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1445/2915] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:05:05.499559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.500696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:05.508916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.509626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.511121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.513241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.584763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee08a535-e849-4596-9416-8e693732628f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ecf49d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.650010 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee08a535-e849-4596-9416-8e693732628f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1463 microversion: 2.1 time: 0.072084 Apr 09 21:05:05.659580 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1446/2916] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1463 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:05.667177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-220290d3-96d7-49bb-a103-5792feb78b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec68af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.722164 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-220290d3-96d7-49bb-a103-5792feb78b96 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 200 len: 1463 microversion: 2.1 time: 0.061402 Apr 09 21:05:05.729686 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1447/2917] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 1463 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:05.734958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.735888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:05.742999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.744589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.746473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.747285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.803609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:05.819517 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0547192-7e0c-4fec-b13e-f491893a7080 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1477 microversion: 2.1 time: 0.324518 Apr 09 21:05:05.820132 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1471/2918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:05.829178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:05.829178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:05.837622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.839234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:05.842352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:05.843104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.170541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.180089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-feba2bbb-7cbc-4308-9ca7-7b6fd191823d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.448993 Apr 09 21:05:06.180801 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1448/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:06.186109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:06.186986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.195357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.196266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.197372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.198596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.243858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.254083 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df4cfb39-893c-4ae8-811a-e31c548bc99f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1480 microversion: 2.1 time: 0.432806 Apr 09 21:05:06.255481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1472/2920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:05 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1480 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:06.262017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:06.262900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.278657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.279488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.280483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.281237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.330069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.339861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.355155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.362223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5781ed0a-d618-482f-ba56-0bbe40a1fce8 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1438 microversion: 2.75 time: 0.180087 Apr 09 21:05:06.363142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1449/2921] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:06 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:06.367931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:06.379090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.391659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.392117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.392931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.393405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.506981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.515783 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3887935d-78de-44c9-b0c7-b7cf8a40b7ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1283 microversion: 2.1 time: 0.258921 Apr 09 21:05:06.517661 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1473/2922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:06 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:06.537491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:06.538158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.547961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.548435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.550646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.551255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.661618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.682359 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfd56c26-115f-4650-bd68-a4d70835dc32 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1327 microversion: 2.1 time: 0.159185 Apr 09 21:05:06.690706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1474/2923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:06 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:06.726414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:06.736251 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-556d4611-ffe5-4354-bfa9-5da25ebb1e3b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1490 microversion: 2.1 time: 0.371830 Apr 09 21:05:06.741521 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1450/2924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:06 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1490 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:06.836410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:06.837311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.848318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.849512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.851625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.852921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.896184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:06.899008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:06.907982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.908947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:06.910861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:06.911734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:07.052882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:07.053341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:07.055180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:07.055766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:07.056361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:07.158532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:07.167729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:07.167999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:07.169320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:07.170220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:07.546793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:07.595785 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a1a590f-366f-44e2-8ddd-a12ee134cbe8 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095/action" status: 202 len: 1942 microversion: 2.75 time: 0.897451 Apr 09 21:05:07.596431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1475/2925] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:05:06 2022] POST /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095/action => generated 1942 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 09 21:05:07.617005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1671276605", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:07.710791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:07.996988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:08.005970 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ccff0497-5e28-4da3-a5c2-cd6b67319981 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1477 microversion: 2.1 time: 1.173898 Apr 09 21:05:08.015548 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1451/2926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:06 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1477 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:08.020574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:08.021227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:08.027136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:08.027594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:08.028382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:08.028823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:08.524899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:08.533473 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ecfbe10d-dcf4-4f1b-9a21-55cc3fbcb067 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.516561 Apr 09 21:05:08.534461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1452/2927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:08 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:08.539055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:08.539669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:08.545713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:08.546171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:08.546989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:08.547432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.098412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:09.106522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-478ec67e-6e99-46ab-af7e-cb07df9b40d6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1467 microversion: 2.1 time: 0.570965 Apr 09 21:05:09.107219 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1453/2928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:08 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1467 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:09.111968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:09.112649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.118738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.119203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.119981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.120420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.166074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:09.166558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:09.166950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:09.167351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:09.167755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:09.176641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.177123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.177923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.178381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.195009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:09.200241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:09.212568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:09.214758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:09.257962 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6c533b0-9997-4ba9-a85f-1dd6caec6331 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660799 Apr 09 21:05:09.258800 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1476/2929] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:09.264231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:09.264832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.274824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.275284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.276041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.276464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.421968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:09.440793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7423bf09-3a67-4493-97b7-5e07b210b0fe tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.181042 Apr 09 21:05:09.441787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1477/2930] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:09 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:09.446503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:09.447110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.453662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.454181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.454983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.455389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.632235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:09.647741 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d23bfd91-ae8f-4c17-a5f8-413d7213a4bd tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.539283 Apr 09 21:05:09.649615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1454/2931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:09 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:09.669083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:09.670109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.683635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.684253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.685220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.685865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.704509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] HTTP exception thrown: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. Apr 09 21:05:09.706997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Returning 404 to user: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:09.708204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d8a090e-446c-49c7-9296-e892060de4e4 tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 404 len: 111 microversion: 2.32 time: 0.043021 Apr 09 21:05:09.709359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1455/2932] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:09 2022] DELETE /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:09.716248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-df0296f1-adc3-4757-aa74-087036cf70b2 req-00612f0d-0489-4569-b1e7-2bd3ffd977d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-plugged", "status": "completed", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:09.726061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df0296f1-adc3-4757-aa74-087036cf70b2 req-00612f0d-0489-4569-b1e7-2bd3ffd977d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.726603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df0296f1-adc3-4757-aa74-087036cf70b2 req-00612f0d-0489-4569-b1e7-2bd3ffd977d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.744254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-df0296f1-adc3-4757-aa74-087036cf70b2 req-00612f0d-0489-4569-b1e7-2bd3ffd977d3 service nova] Creating event network-vif-plugged:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:05:09.750101 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-df0296f1-adc3-4757-aa74-087036cf70b2 req-00612f0d-0489-4569-b1e7-2bd3ffd977d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039173 Apr 09 21:05:09.751269 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1456/2933] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:09.757742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:09.765848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.786879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.787699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.788568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.789414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.838626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:09.846600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c858903c-dd62-41fa-9410-0ec17ea32987 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.403711 Apr 09 21:05:09.850069 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1478/2934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:09 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:09.878498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1510578134"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:09.879751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:09.885920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.886964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:09.887762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:09.888201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.153280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:10.162804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a884f211-70f2-4e93-ad5a-6cd496474083 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1477 microversion: 2.1 time: 0.410233 Apr 09 21:05:10.172770 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1457/2935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:09 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:10.183445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:10.184326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:10.195332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.202706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.204197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.206814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.255068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae0a3066-6a05-41fe-8e08-234199fd9418 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "POST /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e/action" status: 202 len: 0 microversion: 2.1 time: 0.393676 Apr 09 21:05:10.261578 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1479/2936] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:09 2022] POST /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:05:10.268990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:10.270007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:10.278836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.279354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.280257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.280762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.365307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:10.374415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3daf1c27-ae9d-4544-9e49-6c6a14fd954c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1261 microversion: 2.1 time: 0.200431 Apr 09 21:05:10.375526 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1458/2937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:10 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:10.380495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:10.381357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] [instance: 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:10.388270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.388745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.391563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.392077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.421969 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] HTTP exception thrown: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. Apr 09 21:05:10.422635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] Returning 404 to user: Instance 3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:10.423485 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-55ce3c68-f896-4cf2-af8f-db8d41d44d1d tempest-TaggedBootDevicesTest-883782944 tempest-TaggedBootDevicesTest-883782944-project] 10.222.0.30 "GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390" status: 404 len: 111 microversion: 2.32 time: 0.046841 Apr 09 21:05:10.427689 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1459/2938] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:10 2022] GET /compute/v2.1/servers/3cc3a7d5-f9c3-4bad-a7b3-9146f40cc390 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:10.434477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9301e030-5447-437d-9ba0-251264f0f815 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08efdd310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:10.499703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9301e030-5447-437d-9ba0-251264f0f815 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.069703 Apr 09 21:05:10.500677 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1460/2939] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:10 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:10.507696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-08e946aa-576f-4172-92dc-697383df019b req-0d7535c0-83b3-4a66-91be-7f50dfe0df77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25d5238-42cc-4933-8f4a-55af227445a6", "tag": "6988d981-f528-4831-a64a-b6fb7a50ab79"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:10.519306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08e946aa-576f-4172-92dc-697383df019b req-0d7535c0-83b3-4a66-91be-7f50dfe0df77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.521019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08e946aa-576f-4172-92dc-697383df019b req-0d7535c0-83b3-4a66-91be-7f50dfe0df77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.535505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-08e946aa-576f-4172-92dc-697383df019b req-0d7535c0-83b3-4a66-91be-7f50dfe0df77 service nova] Creating event network-changed:6988d981-f528-4831-a64a-b6fb7a50ab79 for instance d25d5238-42cc-4933-8f4a-55af227445a6 on nch1-master-1 Apr 09 21:05:10.543941 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-08e946aa-576f-4172-92dc-697383df019b req-0d7535c0-83b3-4a66-91be-7f50dfe0df77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Apr 09 21:05:10.545329 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1461/2940] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:10.557312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:10.557505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:10.564616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.565231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:10.566083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:10.566582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.050045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:11.070209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1796faf9-8e42-4e1f-86e1-aab760647552 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.523423 Apr 09 21:05:11.073869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:11.078192 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1462/2941] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:10 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:11.083486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:11.084109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:11.090566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.091025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.092009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fe2cf15-f57f-459c-8820-2cb2a8ac4f1a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.828206 Apr 09 21:05:11.092403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.092745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.103239 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1480/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:10 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:11.108562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:11.109296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:11.115718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.116337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.117155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.117589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.640210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:11.664656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:11.685096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1df18168-7654-4161-98b9-eb7dcf08564e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.603031 Apr 09 21:05:11.686687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d28af627-3bce-4d43-ba95-eaec0d6139ac tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.579309 Apr 09 21:05:11.688420 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1463/2943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:11 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:11.690138 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1481/2944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:11 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:11.712009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:11.714181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:11.715427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:11.716799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:11.732075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.733963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.735155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.735964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.737014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.737430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.737980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.738596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.868026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:11.878977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba980841-8ba7-417d-9ac9-d958a9a1a622 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1267 microversion: 2.1 time: 0.175168 Apr 09 21:05:11.880084 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1482/2945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:11 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:11.892438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ccefba1f-f763-47b5-8f76-a85b9ea1a513 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eb9bf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:11.945374 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ccefba1f-f763-47b5-8f76-a85b9ea1a513 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.063503 Apr 09 21:05:11.946732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1483/2946] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:11 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:11.952946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d1c5e5f5-4200-4fb1-8169-53ddc68d94e2 req-b01d9b28-ea60-45e8-b881-cfdb66dd2e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5fe469-5023-4fb7-a476-c2d2317003ad", "name": "network-vif-plugged", "status": "completed", "tag": "ae4c122c-3b88-4a0c-a595-2abb00518e1c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:11.962967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d1c5e5f5-4200-4fb1-8169-53ddc68d94e2 req-b01d9b28-ea60-45e8-b881-cfdb66dd2e14 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:11.963728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d1c5e5f5-4200-4fb1-8169-53ddc68d94e2 req-b01d9b28-ea60-45e8-b881-cfdb66dd2e14 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:11.977295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d1c5e5f5-4200-4fb1-8169-53ddc68d94e2 req-b01d9b28-ea60-45e8-b881-cfdb66dd2e14 service nova] Creating event network-vif-plugged:ae4c122c-3b88-4a0c-a595-2abb00518e1c for instance 3b5fe469-5023-4fb7-a476-c2d2317003ad on nch2-master-1 Apr 09 21:05:11.983088 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d1c5e5f5-4200-4fb1-8169-53ddc68d94e2 req-b01d9b28-ea60-45e8-b881-cfdb66dd2e14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Apr 09 21:05:11.984003 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1484/2947] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:12.103268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:12.105634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.115687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.117295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.118311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.119120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.343995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:12.366111 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7cb518b-4df9-4881-bb04-0a6fe6e1887e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.269340 Apr 09 21:05:12.367098 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1485/2948] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:12 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:12.371670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:12.386598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:12.387667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.391792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d72cfe8c-b5d5-472b-a1b7-ee20cdc43017 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1462 microversion: 2.1 time: 0.701328 Apr 09 21:05:12.393799 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1464/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:11 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1462 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:12.395089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.395552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.396377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.396821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.416331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:12.417358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.424119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.424552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.425506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.425936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.503093 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4337ea65-6ba1-491d-908c-b95533eb7d78 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 0 microversion: 2.1 time: 0.090279 Apr 09 21:05:12.506799 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1465/2950] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:12 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:05:12.511414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:12.512033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.518873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.519326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.520103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.520545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.551968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.552422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.552897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lazy-loading 'fault' on Instance uuid 9a922650-a7ae-40a9-ba61-a2f388b0e621 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:12.863631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:12.872213 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5572de40-d9b1-4560-9e6d-c1da960ea675 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.502037 Apr 09 21:05:12.885595 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1486/2951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:12 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:12.892714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:12.893577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.900527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.901315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.902175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.902655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.977334 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-634d5c99-0da6-46a6-acaf-a33fb2880076 tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1596 microversion: 2.1 time: 0.469404 Apr 09 21:05:12.978295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1466/2952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:12 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1596 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:12.983742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:12.984625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:12.991891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.992424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:12.993316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:12.993818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.235747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:13.243774 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a9b9d72-7066-4ede-a297-7b4225b84052 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.355872 Apr 09 21:05:13.244581 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1487/2953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:12 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:13.259941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.260752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.269765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.270221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.271011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.271449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.327346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:13.336939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02433df2-74f0-4bda-a09f-59863bafc5c3 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.357285 Apr 09 21:05:13.337553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1467/2954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:12 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:13.344761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-113d81dd-07ba-4984-98fa-8d23da77f946 req-d25e6188-3e20-48db-8168-de41e0a2f5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b96091-3ee1-49bb-95e2-f896acbdc4f3", "tag": "5448d5cd-1f29-4f3e-b6f2-73917d7094c7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:13.355676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-113d81dd-07ba-4984-98fa-8d23da77f946 req-d25e6188-3e20-48db-8168-de41e0a2f5d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.356523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-113d81dd-07ba-4984-98fa-8d23da77f946 req-d25e6188-3e20-48db-8168-de41e0a2f5d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.368937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-113d81dd-07ba-4984-98fa-8d23da77f946 req-d25e6188-3e20-48db-8168-de41e0a2f5d6 service nova] Creating event network-changed:5448d5cd-1f29-4f3e-b6f2-73917d7094c7 for instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 on nch1-master-1 Apr 09 21:05:13.374154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-113d81dd-07ba-4984-98fa-8d23da77f946 req-d25e6188-3e20-48db-8168-de41e0a2f5d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035286 Apr 09 21:05:13.375010 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1468/2955] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:13.381233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-444d9484-29df-49f2-a6fd-b190924eeef3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef565e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.429973 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-444d9484-29df-49f2-a6fd-b190924eeef3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.053464 Apr 09 21:05:13.430550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1469/2956] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:13.435104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:13.436213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.440814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:13.443363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.443805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.444572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.445000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.449441 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4fbf2601-c67b-407b-a2f1-23e083094c92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.193286 Apr 09 21:05:13.450247 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1488/2957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:13.463319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.463928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.470179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.470633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.471433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.471854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.524434 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f15eb8a3-2a1d-4a06-851b-7476ae810a0d tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action" status: 202 len: 0 microversion: 2.1 time: 0.092472 Apr 09 21:05:13.528440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1470/2958] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:13 2022] POST /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:05:13.533336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.533873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.540144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.540539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.541348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.541790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.544825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:13.561633 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dfbbaa94-ec23-4588-840c-27a4682e259a tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.101902 Apr 09 21:05:13.562215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1489/2959] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:13.672660 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a27e29ae-4187-4954-ab70-111a096dd67c tempest-ServersAdminTestJSON-1858402537 tempest-ServersAdminTestJSON-1858402537-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1613 microversion: 2.1 time: 0.142936 Apr 09 21:05:13.673279 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1471/2960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:13.689496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.689993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.696703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.697182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.697967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.698402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.723180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:13.807864 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50ea541d-3b64-478b-a593-12155f24e39f tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "DELETE /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 204 len: 0 microversion: 2.1 time: 0.121963 Apr 09 21:05:13.808568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1490/2961] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:13 2022] DELETE /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:13.817025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.817999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.825078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.825562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.826337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.826784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.891556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:13.892250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:13.898318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.898772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:13.899542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:13.899975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.152882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:14.161367 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90ddbe27-9636-46cc-b85f-1107d7454a16 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1469 microversion: 2.1 time: 0.348473 Apr 09 21:05:14.172436 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1472/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:14.178172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-95bce218-ae87-4f5b-b7cf-cd634eac1a1a req-7adf5d1c-63d0-4f17-85ab-24ed69e021cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-unplugged", "status": "completed", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:14.187010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:14.196009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d57103af-7136-471e-8275-c1f0e8dc9914 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1315 microversion: 2.1 time: 0.308766 Apr 09 21:05:14.206104 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1491/2963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:13 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:14.206316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-95bce218-ae87-4f5b-b7cf-cd634eac1a1a req-7adf5d1c-63d0-4f17-85ab-24ed69e021cc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.206316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-95bce218-ae87-4f5b-b7cf-cd634eac1a1a req-7adf5d1c-63d0-4f17-85ab-24ed69e021cc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.224287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-95bce218-ae87-4f5b-b7cf-cd634eac1a1a req-7adf5d1c-63d0-4f17-85ab-24ed69e021cc service nova] Creating event network-vif-unplugged:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:05:14.229263 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-95bce218-ae87-4f5b-b7cf-cd634eac1a1a req-7adf5d1c-63d0-4f17-85ab-24ed69e021cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055102 Apr 09 21:05:14.230235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1473/2964] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:14.261279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:14.261954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:14.269671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.270362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.271371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.271949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.354675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:14.355609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:14.362656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.363172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.364008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.364502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.557906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:14.567136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ef5337e-8ca0-404e-b0c7-1660945aac6e tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.310102 Apr 09 21:05:14.568348 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1492/2965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:14 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:14.575054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7bb73ff-c10b-45ca-924b-80e2f2133ce3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eacc700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:14.605254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:14.618293 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7268d4f-f5ed-43f4-b9e3-aa581efc693c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.267911 Apr 09 21:05:14.630614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1474/2966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:14 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:14.637401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:14.638020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:14.643640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7bb73ff-c10b-45ca-924b-80e2f2133ce3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.074043 Apr 09 21:05:14.644426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1493/2967] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:14 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:14.648670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:14.649299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:14.655957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.656416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.657268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.657706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.663778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.664224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.665007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:14.665469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:14.785508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:14.803906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ce65e1d-ad83-457c-b200-665fa4e24cca tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.158559 Apr 09 21:05:14.815940 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1494/2968] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:14 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:14.898865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:14.906647 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9756f66c-5ec9-467e-938c-fb2037b750d1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.275058 Apr 09 21:05:14.907255 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1475/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:14 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:15.179505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.181613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:15.191027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.191634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.193115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.193657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.219560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.220872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:15.227854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.228719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.229751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.230419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.430552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:15.438692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30bab028-50a2-4cd3-81c2-024ee70926cc tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1469 microversion: 2.1 time: 0.263682 Apr 09 21:05:15.439425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1495/2970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:15.446164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6101876a-e3eb-4038-a828-97477622c934 req-fc11c114-c85a-4b0e-bbe9-a4b8dcce32bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fcbc59c-ecf4-4120-9eba-e9c1900708f2", "tag": "32f41c99-3168-46f5-bb23-d071584aaeba"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:15.453018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:15.461625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-985c4a13-cbac-4ca1-a9e1-27c990c0fedc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1501 microversion: 2.1 time: 0.247381 Apr 09 21:05:15.462322 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1476/2971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:15.464752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6101876a-e3eb-4038-a828-97477622c934 req-fc11c114-c85a-4b0e-bbe9-a4b8dcce32bb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.465302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6101876a-e3eb-4038-a828-97477622c934 req-fc11c114-c85a-4b0e-bbe9-a4b8dcce32bb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.477463 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6101876a-e3eb-4038-a828-97477622c934 req-fc11c114-c85a-4b0e-bbe9-a4b8dcce32bb service nova] Creating event network-changed:32f41c99-3168-46f5-bb23-d071584aaeba for instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 on nch2-master-1 Apr 09 21:05:15.482415 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6101876a-e3eb-4038-a828-97477622c934 req-fc11c114-c85a-4b0e-bbe9-a4b8dcce32bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041612 Apr 09 21:05:15.482999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1496/2972] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:15.583804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.584865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:15.596975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.597594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.598497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.599021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.637224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.637844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:15.656482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.657087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.657987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.658579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.799933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:15.808544 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-306b2892-45fe-4517-aa7a-d4c3bb4d02e2 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.228500 Apr 09 21:05:15.815593 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1477/2973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:15.820999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1577ade6-d952-4cd9-b004-3a81e1c49430 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eddeb80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.891651 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1577ade6-d952-4cd9-b004-3a81e1c49430 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.074896 Apr 09 21:05:15.893145 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1478/2974] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:15.898300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:15.899102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:15.911955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.912819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.913947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:15.915994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:15.976946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:15.986059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66f85f5a-4447-4e02-8642-ee78b2cb1f25 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.354352 Apr 09 21:05:15.986588 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1497/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:16.010503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:16.011197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:16.027068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.027538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:16.031769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.033699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:16.080968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:16.107111 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03692afd-0085-40a2-9de8-af277dc21cf9 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.212517 Apr 09 21:05:16.107921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1479/2976] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:16.461305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:16.462556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:16.470649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.471386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:16.472388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.473017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:16.745658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:16.762069 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a484e81e-f860-4bbb-977b-6e65e62f2c7b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.757038 Apr 09 21:05:16.764600 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1498/2977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:15 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:16.828100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:16.828943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:16.840844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.842187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:16.845770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:16.846515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.059199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:17.067197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f401b566-e6f6-4bb5-8a8a-971b9800b4f0 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1469 microversion: 2.1 time: 0.612588 Apr 09 21:05:17.077866 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1480/2978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:16 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1469 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:17.083579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4c9b823-9a30-4e79-a3a9-db61e726ab2a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e294dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:17.145072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4c9b823-9a30-4e79-a3a9-db61e726ab2a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.065659 Apr 09 21:05:17.147002 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1481/2979] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:17 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:17.152316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0c028f7-71a8-49c5-ac02-f31bc59e0c82"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:17.153720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:17.160627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.161099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.162041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.162475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.249217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:17.257733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a716c8d-9b41-45e7-82fd-8e0c0fa5a2a6 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.433689 Apr 09 21:05:17.268107 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1499/2980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:16 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:17.286295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:17.287296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:17.295747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.296481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.297547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.298953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.593553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:17.610973 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6197501f-5cb9-43e1-9cd1-326b9b6ce346 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.340820 Apr 09 21:05:17.613205 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1500/2981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:17 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:17.631599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:17.632562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:17.642624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.643902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.644938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.646061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.803544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:17.848840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0dcf654-6021-4254-881b-6bb1f53fe304 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.231494 Apr 09 21:05:17.849763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1501/2982] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:17 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:17.865130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a4135bac-a6b3-4b2b-8a74-968924fd2510 req-33ddcb1d-5b5e-4432-b5c1-e13d13869710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595b235c-0268-4995-b9b6-a9681a0e728f", "name": "network-vif-deleted", "tag": "3b264ec0-cb5f-44ef-8d47-fdf046582d87"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:17.879590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a4135bac-a6b3-4b2b-8a74-968924fd2510 req-33ddcb1d-5b5e-4432-b5c1-e13d13869710 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.880293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a4135bac-a6b3-4b2b-8a74-968924fd2510 req-33ddcb1d-5b5e-4432-b5c1-e13d13869710 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.903036 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a4135bac-a6b3-4b2b-8a74-968924fd2510 req-33ddcb1d-5b5e-4432-b5c1-e13d13869710 service nova] Creating event network-vif-deleted:3b264ec0-cb5f-44ef-8d47-fdf046582d87 for instance 595b235c-0268-4995-b9b6-a9681a0e728f on nch1-master-1 Apr 09 21:05:17.909627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a4135bac-a6b3-4b2b-8a74-968924fd2510 req-33ddcb1d-5b5e-4432-b5c1-e13d13869710 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057993 Apr 09 21:05:17.910770 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1502/2983] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:17.918143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:17.919065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:17.926435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.927131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:17.928221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:17.928788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.102976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:18.117116 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9456c59d-0614-48aa-b627-412f97cd956b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.204528 Apr 09 21:05:18.118062 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1503/2984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:17 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:18.135146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:18.135921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:18.148090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.149397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.150374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.151328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.218203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.218991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.219588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lazy-loading 'fault' on Instance uuid 595b235c-0268-4995-b9b6-a9681a0e728f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:18.316469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:18.329967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b756501d-72a1-4fb1-b59b-5f21fdce65c4 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 200 len: 1303 microversion: 2.1 time: 0.210230 Apr 09 21:05:18.337123 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1504/2985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:18 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:18.337923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf05baf6-e69d-47fc-81f2-f59893cf7e88 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eb575e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:18.394131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf05baf6-e69d-47fc-81f2-f59893cf7e88 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.060912 Apr 09 21:05:18.394721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1505/2986] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:18 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:18.406927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:18.407667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:18.414502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.415171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.416094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.416665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.721992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:18.734834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d03b7bc5-17fd-4639-bde4-1378011f1bd8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.333591 Apr 09 21:05:18.735608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1506/2987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:18 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:18.741169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cb914ccd-d6eb-4c97-b4ee-57ae1fcc9fe6 req-03721b94-7583-4165-8ce2-18ae03f56e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3a8c29-e199-4d97-8cde-57b42551b09e", "name": "network-vif-plugged", "status": "completed", "tag": "7871b15f-ec75-4638-8efa-02a7ceefbe68"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:18.750582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cb914ccd-d6eb-4c97-b4ee-57ae1fcc9fe6 req-03721b94-7583-4165-8ce2-18ae03f56e1c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.751338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cb914ccd-d6eb-4c97-b4ee-57ae1fcc9fe6 req-03721b94-7583-4165-8ce2-18ae03f56e1c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.763986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cb914ccd-d6eb-4c97-b4ee-57ae1fcc9fe6 req-03721b94-7583-4165-8ce2-18ae03f56e1c service nova] Creating event network-vif-plugged:7871b15f-ec75-4638-8efa-02a7ceefbe68 for instance bc3a8c29-e199-4d97-8cde-57b42551b09e on nch2-master-1 Apr 09 21:05:18.770126 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-cb914ccd-d6eb-4c97-b4ee-57ae1fcc9fe6 req-03721b94-7583-4165-8ce2-18ae03f56e1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Apr 09 21:05:18.771446 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1507/2988] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:18.776727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:18.777891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:18.779994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.630761 Apr 09 21:05:18.780985 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1482/2989] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:05:17 2022] POST /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad/os-volume_attachments => generated 194 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:18.801624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.802083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.803007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.803644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.870614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:18.872729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:18.881482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.882338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:18.883654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:18.884481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.041845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:19.060156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd0a4292-4718-445c-acd3-cd7419fbd360 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.194319 Apr 09 21:05:19.061205 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1483/2990] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:18 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:19.134439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.135227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:19.141707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.142275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.143153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.143699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.291579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:19.301017 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee3b9de8-26f1-457c-a9b3-d22a7cc5ac0e tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.527934 Apr 09 21:05:19.311566 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1508/2991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:18 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:19.348317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.350030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 595b235c-0268-4995-b9b6-a9681a0e728f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:19.356509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.357120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.357998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.358533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.374777 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] HTTP exception thrown: Instance 595b235c-0268-4995-b9b6-a9681a0e728f could not be found. Apr 09 21:05:19.375633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Returning 404 to user: Instance 595b235c-0268-4995-b9b6-a9681a0e728f could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:19.376467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a02bf14-2788-4ebc-b5dc-9319a97b4878 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f" status: 404 len: 111 microversion: 2.1 time: 0.032317 Apr 09 21:05:19.377022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1509/2992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:19 2022] GET /compute/v2.1/servers/595b235c-0268-4995-b9b6-a9681a0e728f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:05:19.384943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.385725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:19.392388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.392991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.393937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.394511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.420364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:19.508617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:19.515122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46adb5a5-39c0-4f8a-b4f7-c2bc4231e929 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 204 len: 0 microversion: 2.1 time: 0.133467 Apr 09 21:05:19.518984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1510/2993] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:19 2022] DELETE /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:19.525351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75148542-929f-485e-aa9e-80ff3f529309 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e4b6af0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.528436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61af9404-5d8e-4590-8d89-f4599d459863 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.397865 Apr 09 21:05:19.540493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1484/2994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:19 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:19.555319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.556184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:19.562836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.563488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.564456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.565622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.579707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75148542-929f-485e-aa9e-80ff3f529309 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.061817 Apr 09 21:05:19.580512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1511/2995] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:19 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:19.752792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:19.753597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:19.761215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.761701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.762486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:19.762924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:19.824077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:19.832471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93501efd-c2cb-4950-976f-d4f17b509db9 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1470 microversion: 2.1 time: 0.290543 Apr 09 21:05:19.833081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1485/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:19 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:19.978996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:19.988246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-147b6309-c8df-4786-a2b7-f217e0dbc169 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.240237 Apr 09 21:05:19.994961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1512/2997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:19 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:20.080031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:20.084546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:20.092443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.093002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.094008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.094543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.319349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:20.320559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:20.333604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.334730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.335922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.336653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.537680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:20.558897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad98c8fc-38f2-40dc-8749-271d46e61414 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.482871 Apr 09 21:05:20.559659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1486/2998] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:20 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:20.564572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:20.565317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:20.572255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.572930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.573748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.574193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.776538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:20.795295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50f2e72d-aa62-491e-ba35-f3f212d38500 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.480454 Apr 09 21:05:20.796167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1513/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:20 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:20.806778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d89fa6c6-75a0-44ee-b3a1-cd98fb92d534 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08f398b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:20.810367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:20.819452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-729de369-5a0f-452e-9e2e-29861e11ea38 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.258061 Apr 09 21:05:20.819861 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1487/3000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:20 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:20.824603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25d5238-42cc-4933-8f4a-55af227445a6", "name": "network-vif-plugged", "status": "completed", "tag": "6988d981-f528-4831-a64a-b6fb7a50ab79"}, {"server_uuid": "87b96091-3ee1-49bb-95e2-f896acbdc4f3", "name": "network-vif-plugged", "status": "completed", "tag": "5448d5cd-1f29-4f3e-b6f2-73917d7094c7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:20.835703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.836213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.852159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] Creating event network-vif-plugged:6988d981-f528-4831-a64a-b6fb7a50ab79 for instance d25d5238-42cc-4933-8f4a-55af227445a6 on nch1-master-1 Apr 09 21:05:20.852766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] Creating event network-vif-plugged:5448d5cd-1f29-4f3e-b6f2-73917d7094c7 for instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 on nch1-master-1 Apr 09 21:05:20.860092 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e7921976-fa32-4bf8-b783-74fa3d3bd364 req-7933e6a1-3175-471e-b440-07c2db31680d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038699 Apr 09 21:05:20.861081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1488/3001] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:20.866324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:20.867233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:20.868620 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d89fa6c6-75a0-44ee-b3a1-cd98fb92d534 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.071700 Apr 09 21:05:20.869644 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1514/3002] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:20 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:20.874074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.874682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:20.876791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:20.877430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.007339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:21.008710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:21.015297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.016017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.016805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.017267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.407950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:21.415636 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d0869c6-c7cb-4587-8440-d58dfda72b23 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1470 microversion: 2.1 time: 0.553129 Apr 09 21:05:21.416224 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1489/3003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:20 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1470 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:21.468149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:21.475506 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6fde7dc0-d05d-47b6-835b-e521cf86f4ec tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1325 microversion: 2.1 time: 0.473725 Apr 09 21:05:21.476090 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1515/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:21 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:21.579039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:21.579661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:21.586283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.586745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.587536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.587997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.701478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:21.724954 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f97cd3c1-4741-4dea-a56b-b2dc964a086f tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.149833 Apr 09 21:05:21.725924 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1490/3005] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:21 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:21.813714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:21.814845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:21.827397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.828193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.829162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.830274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.835685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:21.836301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:21.850372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.851045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:21.852230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:21.852807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.192155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:22.211340 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5a44aff-d41c-43ce-9094-1d9b1f414d04 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.377135 Apr 09 21:05:22.212447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1491/3006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:21 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:22.225305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c971e908-8cb3-4e1e-9995-270a25d0e5c2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec681f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:22.260651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:22.272155 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f47bd3f9-85e3-428e-b5df-2e9135cc0cd8 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1395 microversion: 2.1 time: 0.463886 Apr 09 21:05:22.273680 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1516/3007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:21 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1395 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:22.278999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7f9d46f5-5c97-4599-a733-8d2ef15bb0aa req-4b3d22b5-c339-4076-ae7c-ed9c81c3f9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b708a-25bb-4c08-9163-5dfa571dbf7d", "name": "network-vif-deleted", "tag": "170bd20a-07a4-4369-8224-c4d2d705ad7c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:22.290930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f9d46f5-5c97-4599-a733-8d2ef15bb0aa req-4b3d22b5-c339-4076-ae7c-ed9c81c3f9ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.291476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f9d46f5-5c97-4599-a733-8d2ef15bb0aa req-4b3d22b5-c339-4076-ae7c-ed9c81c3f9ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.305122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7f9d46f5-5c97-4599-a733-8d2ef15bb0aa req-4b3d22b5-c339-4076-ae7c-ed9c81c3f9ba service nova] Creating event network-vif-deleted:170bd20a-07a4-4369-8224-c4d2d705ad7c for instance bd2b708a-25bb-4c08-9163-5dfa571dbf7d on nch1-master-1 Apr 09 21:05:22.313271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7f9d46f5-5c97-4599-a733-8d2ef15bb0aa req-4b3d22b5-c339-4076-ae7c-ed9c81c3f9ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036497 Apr 09 21:05:22.315942 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1517/3008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:22.329314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:22.330641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:22.344640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c971e908-8cb3-4e1e-9995-270a25d0e5c2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.129528 Apr 09 21:05:22.346801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.347037 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1492/3009] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:22 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:22.347609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.349535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.353167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.428199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:22.433759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:22.444427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:22.463816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.467069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.469314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.470358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.570196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.571133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.573978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lazy-loading 'fault' on Instance uuid bd2b708a-25bb-4c08-9163-5dfa571dbf7d {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:22.622932 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 204 len: 0 microversion: 2.1 time: 0.304492 Apr 09 21:05:22.623910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1518/3010] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:22 2022] DELETE /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:22.634533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:22.635474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:22.643075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.643775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.645176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.645760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.658816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:22.670735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d84d218-a45a-4d1b-a911-c3f0ca5a43c3 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 200 len: 1304 microversion: 2.1 time: 0.240611 Apr 09 21:05:22.681254 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1493/3011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:22 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:22.717808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:22.718731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:22.727631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.728444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.729510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:22.730274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:22.981110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:23.002067 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94dde5b5-f0ad-410b-82cc-bc5d24e051a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1553 microversion: 2.1 time: 0.325968 Apr 09 21:05:23.002683 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1494/3012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:22 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:23.023769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:23.032701 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa80890e-f84b-44a4-bc44-0dae0fca0b22 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1523 microversion: 2.1 time: 0.407444 Apr 09 21:05:23.032854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.033355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.033995 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1519/3013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:22 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:23.038827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ef1df26b-a49b-4b2e-bbab-4415178e023b req-4d872469-c24f-45bd-9830-1c0ba48d8390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fcbc59c-ecf4-4120-9eba-e9c1900708f2", "name": "network-vif-plugged", "status": "completed", "tag": "32f41c99-3168-46f5-bb23-d071584aaeba"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:23.055232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.055421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.056226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.062195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ef1df26b-a49b-4b2e-bbab-4415178e023b req-4d872469-c24f-45bd-9830-1c0ba48d8390 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.062846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ef1df26b-a49b-4b2e-bbab-4415178e023b req-4d872469-c24f-45bd-9830-1c0ba48d8390 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.066300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.077629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ef1df26b-a49b-4b2e-bbab-4415178e023b req-4d872469-c24f-45bd-9830-1c0ba48d8390 service nova] Creating event network-vif-plugged:32f41c99-3168-46f5-bb23-d071584aaeba for instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 on nch2-master-1 Apr 09 21:05:23.083180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ef1df26b-a49b-4b2e-bbab-4415178e023b req-4d872469-c24f-45bd-9830-1c0ba48d8390 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047869 Apr 09 21:05:23.084162 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1520/3014] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:23.090235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.091777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.107301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.108103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.112560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.113277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.157225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] HTTP exception thrown: Instance is not a member of specified network Apr 09 21:05:23.173574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Returning 404 to user: Instance is not a member of specified network {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:23.174994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c0cbff4-f60b-47a5-846f-f8482b730df4 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.089525 Apr 09 21:05:23.178427 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1521/3015] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6/ips/invalid => generated 91 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:05:23.209834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef7d1530-b3f9-402f-a088-b4dc7ada5b8f tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.215240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ef7d1530-b3f9-402f-a088-b4dc7ada5b8f tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Failed to fetch instance by id 999 {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:05:23.217474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ef7d1530-b3f9-402f-a088-b4dc7ada5b8f tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] HTTP exception thrown: Instance 999 could not be found. Apr 09 21:05:23.219447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef7d1530-b3f9-402f-a088-b4dc7ada5b8f tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Returning 404 to user: Instance 999 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:23.220692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef7d1530-b3f9-402f-a088-b4dc7ada5b8f tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018193 Apr 09 21:05:23.222226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1522/3016] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:05:23.230933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.231956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.240837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.242553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.248240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.248979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.259054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:23.284149 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87cac519-4137-4517-a66d-e574b9d89b8b tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.267347 Apr 09 21:05:23.300453 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1495/3017] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:23.306015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.306571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.357442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.358555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.360218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.360836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.424789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:23.583772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:23.598138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b0469d8-4b6b-4448-a8a5-d8396f7372e8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 204 len: 0 microversion: 2.1 time: 0.294200 Apr 09 21:05:23.599020 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1496/3018] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:23 2022] DELETE /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:23.603387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c988cbcb-2469-4332-8e55-e266080f7f07 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.377181 Apr 09 21:05:23.606152 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1523/3019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:23.614773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.616376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.617220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a08bcdfe-ca59-432d-b5c1-8474d10b20ad tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ea97550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.631421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.633083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.635074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.635971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.709172 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a08bcdfe-ca59-432d-b5c1-8474d10b20ad tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.100036 Apr 09 21:05:23.709777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1524/3020] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:23.715354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:23.715354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:23.724224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.724911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:23.726385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:23.727011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.118216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:24.128306 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe1ae721-4e76-4276-9d87-57c6c23a7ead tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1575 microversion: 2.1 time: 0.523358 Apr 09 21:05:24.129695 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1497/3021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1575 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:24.135732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.136548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: bd2b708a-25bb-4c08-9163-5dfa571dbf7d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.146450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.148262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.150345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.150962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.179747 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] HTTP exception thrown: Instance bd2b708a-25bb-4c08-9163-5dfa571dbf7d could not be found. Apr 09 21:05:24.181708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Returning 404 to user: Instance bd2b708a-25bb-4c08-9163-5dfa571dbf7d could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:24.182755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73a6b393-1768-49bf-a825-8cbd2b9d9a65 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d" status: 404 len: 111 microversion: 2.1 time: 0.051321 Apr 09 21:05:24.184096 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1498/3022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/bd2b708a-25bb-4c08-9163-5dfa571dbf7d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:24.192823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.193577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.215759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.216688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.217820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.218269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.235654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:24.250106 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f50479b3-7ae1-42d7-82f5-82bf8cf6bfc8 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1529 microversion: 2.1 time: 0.538993 Apr 09 21:05:24.254737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1525/3023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:23 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1529 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:24.262913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.264638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.279318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.280203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.281261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.281890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.483406 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e05f52b5-384c-48b5-89d1-da68b03a3b6c tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227186 Apr 09 21:05:24.484201 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1526/3024] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:24.489278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.490016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.517631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.518198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.519103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.519552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.549745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:24.584469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:24.597139 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-368f915d-d95b-4ad1-b245-1c4961dfc5cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1553 microversion: 2.1 time: 0.411598 Apr 09 21:05:24.606577 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1499/3025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1553 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:24.606577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.606577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.619425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.620183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.621234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.621823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.720007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:24.728969 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64102828-4eed-451a-aefc-958e19829e96 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 204 len: 0 microversion: 2.1 time: 0.234906 Apr 09 21:05:24.732834 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1527/3026] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:24 2022] DELETE /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:24.751735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a41dd05c-59d1-48ea-a73b-6c8ca0d7bf85 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.152026 Apr 09 21:05:24.764372 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1500/3027] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:24.764550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.764550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.764740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b241804a-23d5-4a56-8551-5ef73fcd8293 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08efdd310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.764827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.764942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.765783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.766222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.818342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b241804a-23d5-4a56-8551-5ef73fcd8293 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.063713 Apr 09 21:05:24.819066 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1501/3028] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:24.825537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:24.826384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:24.833226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.834406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:24.835391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:24.835391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.048119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:25.068243 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d411f42-7d8a-462a-9f21-c9e9d64b9b3e tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1468 microversion: 2.1 time: 0.247091 Apr 09 21:05:25.068915 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1502/3029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:25.127762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:25.135625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-daadb0b2-ac60-49f5-9e99-fde4d444ad92 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1309 microversion: 2.1 time: 0.397484 Apr 09 21:05:25.142045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1528/3030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:24 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:25.271138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:25.271821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:25.281599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.282155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.282968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.283418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.614458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:25.615295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:25.629420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.630684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.631686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.632277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.731818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:25.739535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ab9e1b4-c049-4525-b2a0-006367b123bc tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1529 microversion: 2.1 time: 0.472276 Apr 09 21:05:25.746132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1503/3031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:25 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1529 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:25.772128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:25.773078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:25.804009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.804843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:25.805979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:25.806625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.011904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:26.053662 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0bca632a-9be2-4194-b5f3-7737ac31da83 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.283347 Apr 09 21:05:26.055108 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1504/3032] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:25 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:26.071701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30d1b2cd-9e3b-4862-8093-116dd5cba8a0 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e24a0d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:26.156210 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30d1b2cd-9e3b-4862-8093-116dd5cba8a0 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.097691 Apr 09 21:05:26.162609 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1505/3033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:26 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:26.170424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:26.171450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:26.180524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.181207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.182155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.196652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.359795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:26.372623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-deed1aae-c610-400d-8540-744d46736992 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 200 len: 1553 microversion: 2.1 time: 0.762070 Apr 09 21:05:26.375782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1529/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:25 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 1553 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:26.390794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:26.391426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:26.398246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.399506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.400338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.400790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.850331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:26.867461 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d941b366-f95d-4bfd-be46-f04ef35e7f0b tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1468 microversion: 2.1 time: 0.703072 Apr 09 21:05:26.868600 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1506/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:26 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1468 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:26.874289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:26.886270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:26.904173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.904671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:26.905932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:26.906389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.030264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:27.039384 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0cf94c7b-1c80-4e2e-ae89-d91e4a1a7f53 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1490 microversion: 2.1 time: 0.653273 Apr 09 21:05:27.045223 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1530/3036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:26 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1490 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:27.060594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1c225d63-70dd-4178-8368-b39450d8d03e req-535fa6ed-b0e5-4268-b7cf-ae3fd2f65daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b96091-3ee1-49bb-95e2-f896acbdc4f3", "tag": "5448d5cd-1f29-4f3e-b6f2-73917d7094c7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:27.073296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1c225d63-70dd-4178-8368-b39450d8d03e req-535fa6ed-b0e5-4268-b7cf-ae3fd2f65daa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.081794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1c225d63-70dd-4178-8368-b39450d8d03e req-535fa6ed-b0e5-4268-b7cf-ae3fd2f65daa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.094764 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1c225d63-70dd-4178-8368-b39450d8d03e req-535fa6ed-b0e5-4268-b7cf-ae3fd2f65daa service nova] Creating event network-changed:5448d5cd-1f29-4f3e-b6f2-73917d7094c7 for instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 on nch1-master-1 Apr 09 21:05:27.115119 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1c225d63-70dd-4178-8368-b39450d8d03e req-535fa6ed-b0e5-4268-b7cf-ae3fd2f65daa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068411 Apr 09 21:05:27.116000 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1531/3037] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:27.128534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:27.129492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:27.147244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.148039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.148997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.149609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.687966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:27.706944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd630a27-3165-4ecc-aa51-e8b42bc72d59 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1529 microversion: 2.1 time: 0.589562 Apr 09 21:05:27.708345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1532/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:27 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1529 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:27.719004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-136eb43f-2d99-440e-bdf7-aae50794f79f req-3525c798-7442-41e9-b74f-4e32ce11e244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5fe469-5023-4fb7-a476-c2d2317003ad", "name": "network-vif-deleted", "tag": "ae4c122c-3b88-4a0c-a595-2abb00518e1c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:27.730966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:27.744678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-136eb43f-2d99-440e-bdf7-aae50794f79f req-3525c798-7442-41e9-b74f-4e32ce11e244 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.746907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f35ee8b-e3fe-4f22-b03d-f71e44b7f1e7 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1575 microversion: 2.1 time: 0.876511 Apr 09 21:05:27.747271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-136eb43f-2d99-440e-bdf7-aae50794f79f req-3525c798-7442-41e9-b74f-4e32ce11e244 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.747547 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1507/3039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:26 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1575 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:27.762563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:27.763870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:27.776764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.781923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.782791 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-136eb43f-2d99-440e-bdf7-aae50794f79f req-3525c798-7442-41e9-b74f-4e32ce11e244 service nova] Creating event network-vif-deleted:ae4c122c-3b88-4a0c-a595-2abb00518e1c for instance 3b5fe469-5023-4fb7-a476-c2d2317003ad on nch2-master-1 Apr 09 21:05:27.783824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.786052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.799637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-136eb43f-2d99-440e-bdf7-aae50794f79f req-3525c798-7442-41e9-b74f-4e32ce11e244 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087664 Apr 09 21:05:27.803852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1533/3040] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:27.815167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:27.816292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:27.824660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.825387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:27.826586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:27.827299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:28.489048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:28.545106 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-826784e7-c9e0-46b9-8b4b-7b3481eddd2e tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.733102 Apr 09 21:05:28.545712 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1534/3041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:27 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:28.553166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-281a5cc0-e53a-413f-be31-ee157251f376 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e29b430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:28.641452 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-281a5cc0-e53a-413f-be31-ee157251f376 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.094366 Apr 09 21:05:28.643057 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1535/3042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:28 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:28.660425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:28.661286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:28.684413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:28.685023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:28.685981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:28.686522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:28.708280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. Apr 09 21:05:28.709724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:28.710778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c078ccbf-449b-4afa-a2a3-7c289a98063a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 404 len: 111 microversion: 2.1 time: 0.066180 Apr 09 21:05:28.711926 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1536/3043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:28 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:28.740422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:28.755999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:28.770532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:28.776365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:28.779670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:28.783239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:28.959638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:28.969443 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf3174e7-c8cc-4414-b940-65fe45903bd6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1490 microversion: 2.1 time: 1.220786 Apr 09 21:05:28.984802 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1508/3044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:27 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1490 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:28.990081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:28.990937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:28.999073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:28.999846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.000853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.001515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.029298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d1c24bc22654cab94bc0b7b8e271c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a9d66010e4404c82a529dd4bd18c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:29.043574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96f491de-c41d-4f31-9d12-c079d481a29d tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 200 len: 1426 microversion: 2.1 time: 0.328921 Apr 09 21:05:29.044974 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1537/3045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:28 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 1426 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:29.056442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.060540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:29.073543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.074246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.075368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.078910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.103871 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. Apr 09 21:05:29.104480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:29.105726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9af6fe2-2740-446d-9078-636fcf7a93ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058959 Apr 09 21:05:29.106563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1538/3046] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:05:29 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:29.112570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.113540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:29.120421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.122373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.124250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.125114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.216120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5981fe7d48ad4381a72d723ea5c6a08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9867219547a94880ba048320401ac44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:29.228215 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ad5dff4-497a-4012-b3d3-8133e4e6c02c tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 200 len: 1487 microversion: 2.1 time: 0.241976 Apr 09 21:05:29.240190 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1509/3047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:28 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 1487 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:29.350762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-265316473", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:29.425022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:29.476773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:29.488345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d58bf4ed-03c3-442e-9847-501c74acc4c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1490 microversion: 2.1 time: 0.380569 Apr 09 21:05:29.489068 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1539/3048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:29 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1490 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:29.510236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.511045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:29.517881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.518638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.521984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.522712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.554653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:29.685779 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20ae156a-aaf8-4d46-bb8c-1be451a46475 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 204 len: 0 microversion: 2.1 time: 0.180403 Apr 09 21:05:29.690437 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1540/3049] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:29 2022] DELETE /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:29.696688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.697563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:29.704669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.705146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.706137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.706584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.822748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:29.852289 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a997690-45b0-4024-818a-342fbb64e011 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.159951 Apr 09 21:05:29.853200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1541/3050] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:29 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:29.861927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9971ce9-f10c-485c-b434-56e90450d791 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ec363a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.923299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9971ce9-f10c-485c-b434-56e90450d791 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.065928 Apr 09 21:05:29.925593 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1542/3051] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:29 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:29.931287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:29.931927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:29.940373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.940971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:29.941969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:29.942815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.282496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:30.283002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:30.283363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:30.283927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:30.284555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:30.288478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:30.298536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e668e33f-d13f-4a44-b376-28fde676fdcd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1496 microversion: 2.1 time: 0.371560 Apr 09 21:05:30.300244 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1543/3052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:29 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1496 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:30.300361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.300979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.302287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.303188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.319872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25d5238-42cc-4933-8f4a-55af227445a6", "name": "network-vif-deleted", "tag": "6988d981-f528-4831-a64a-b6fb7a50ab79"}, {"server_uuid": "9a922650-a7ae-40a9-ba61-a2f388b0e621", "name": "network-vif-deleted", "tag": "413538b1-c0e7-410b-b551-a900c613c97a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:30.323248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:30.329200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:30.345243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:30.348725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:30.348953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.350785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.388233 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] Creating event network-vif-deleted:6988d981-f528-4831-a64a-b6fb7a50ab79 for instance d25d5238-42cc-4933-8f4a-55af227445a6 on nch1-master-1 Apr 09 21:05:30.388687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] Creating event network-vif-deleted:413538b1-c0e7-410b-b551-a900c613c97a for instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 on nch1-master-1 Apr 09 21:05:30.400137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b1031921-d448-4c5c-a97e-8319b8f38e84 req-04fd0315-df29-4947-b30b-d8d9ad6c74db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097876 Apr 09 21:05:30.400874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1544/3053] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:30.410493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:30.411555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] [instance: 9a922650-a7ae-40a9-ba61-a2f388b0e621] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:30.412626 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3daee661-b9e1-4adb-bb31-2560ab0e556b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066377 Apr 09 21:05:30.413893 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1510/3054] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:30.421854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:30.423094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] [instance: d25d5238-42cc-4933-8f4a-55af227445a6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:30.428989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.429550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.430413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.430913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.431102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.431632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.432538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:30.433289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:30.449559 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] HTTP exception thrown: Instance d25d5238-42cc-4933-8f4a-55af227445a6 could not be found. Apr 09 21:05:30.450444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] Returning 404 to user: Instance d25d5238-42cc-4933-8f4a-55af227445a6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:30.451488 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac247a14-f779-4ce4-b0eb-864cee39f906 tempest-ServerAddressesNegativeTestJSON-1242050790 tempest-ServerAddressesNegativeTestJSON-1242050790-project] 10.222.0.30 "GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6" status: 404 len: 111 microversion: 2.1 time: 0.036029 Apr 09 21:05:30.452638 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1511/3055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:30 2022] GET /compute/v2.1/servers/d25d5238-42cc-4933-8f4a-55af227445a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:30.460053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8fb16fc6-d237-47be-8962-6aff498ef1de tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:30.460670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8fb16fc6-d237-47be-8962-6aff498ef1de tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:30.473121 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] HTTP exception thrown: Instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 could not be found. Apr 09 21:05:30.474919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] Returning 404 to user: Instance 9a922650-a7ae-40a9-ba61-a2f388b0e621 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:30.476242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e53dae90-2ea7-43c9-8059-b7d55eaae276 tempest-ServersAdminTestJSON-552762836 tempest-ServersAdminTestJSON-552762836-project] 10.222.0.30 "GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621" status: 404 len: 111 microversion: 2.1 time: 0.074182 Apr 09 21:05:30.477887 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1545/3056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:30 2022] GET /compute/v2.1/servers/9a922650-a7ae-40a9-ba61-a2f388b0e621 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:30.586533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fb16fc6-d237-47be-8962-6aff498ef1de tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:30.597169 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8fb16fc6-d237-47be-8962-6aff498ef1de tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73" status: 200 len: 1214 microversion: 2.1 time: 0.143145 Apr 09 21:05:30.610895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1512/3057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:30 2022] GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:30.618997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aabcbcef-9828-4549-93a4-60ea9592d323 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:30.635785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aabcbcef-9828-4549-93a4-60ea9592d323 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:30.678672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aabcbcef-9828-4549-93a4-60ea9592d323 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:30.990564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-567887139", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "aca23e59-7431-4b5d-8caa-e391d337ad7c"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:31.121391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] validate_networks() for [('aca23e59-7431-4b5d-8caa-e391d337ad7c', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:31.322657 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-aabcbcef-9828-4549-93a4-60ea9592d323 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Instance Mapping does not exist while attempting local delete cleanup. Apr 09 21:05:31.328206 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aabcbcef-9828-4549-93a4-60ea9592d323 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73" status: 204 len: 0 microversion: 2.1 time: 0.711797 Apr 09 21:05:31.330612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1513/3058] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:30 2022] DELETE /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:05:31.341061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:31.342214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:31.351496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:31.352193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:31.353246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:31.353948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:31.519747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:31.568989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82bb7ae4-0886-4f3e-bbda-e06c7dd71dbb tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.232839 Apr 09 21:05:31.585570 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1514/3059] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:31 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:31.595329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97c2afd3-a5a1-4686-9b8c-afdf6bb24626 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1d8160>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:31.687928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97c2afd3-a5a1-4686-9b8c-afdf6bb24626 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.100046 Apr 09 21:05:31.690007 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1515/3060] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:31 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:31.750916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:31.752297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:31.773411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:31.774170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:31.775294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:31.776139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:32.036078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:32.045182 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ca1cbba-6dd9-43aa-8444-00f8d0bbd011 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1496 microversion: 2.1 time: 0.353942 Apr 09 21:05:32.053645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1516/3061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:31 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1496 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:32.059305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ea848f4-8f03-4a7f-a89e-eb1a4e778a9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:32.059935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ea848f4-8f03-4a7f-a89e-eb1a4e778a9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:32.076023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3ea848f4-8f03-4a7f-a89e-eb1a4e778a9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. Apr 09 21:05:32.076864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ea848f4-8f03-4a7f-a89e-eb1a4e778a9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:32.077898 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ea848f4-8f03-4a7f-a89e-eb1a4e778a9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73" status: 404 len: 111 microversion: 2.1 time: 0.023230 Apr 09 21:05:32.093971 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1517/3062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:32 2022] GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:32.227703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:32.229177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:32.230207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:32.230888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:32.231446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:32.248450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:32.248906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:32.249818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:32.250259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:32.286561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-575899240", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:32.320351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:32.333543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for user 4719eac69a2f4f25bbb1abfb3ef7c980 and project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:32.354879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:32.380398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:32.383187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:32.496760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5b7b7cb-2e2a-4335-acdd-62dba87eb3e3 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000195 Apr 09 21:05:32.498251 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1546/3063] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:05:32.509690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7def3335-89b8-431f-85fe-b22d2df118f5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:32.511115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7def3335-89b8-431f-85fe-b22d2df118f5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:32.681829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7def3335-89b8-431f-85fe-b22d2df118f5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:32.692998 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7def3335-89b8-431f-85fe-b22d2df118f5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1217 microversion: 2.1 time: 0.187857 Apr 09 21:05:32.694578 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1547/3064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:32 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:32.700958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:32.701827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:32.727808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:32.730874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:32.733783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:32.734483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.100382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:33.152120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4cb9d05f-7088-4f56-9821-552afa6f5437 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.454560 Apr 09 21:05:33.152979 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1548/3065] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:32 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:33.186918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfe41a74-d210-48c0-b8e8-ee13b979a02a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e4f9790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:33.281595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfe41a74-d210-48c0-b8e8-ee13b979a02a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.127075 Apr 09 21:05:33.282225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1549/3066] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:33 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:33.298718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:33.305395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:33.324212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.324690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.325487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.326093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.534060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:33.555087 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-220c039c-5635-4116-9c60-f7b6ddb9ab4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 200 len: 1454 microversion: 2.1 time: 0.271744 Apr 09 21:05:33.559060 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1550/3067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:33 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 1454 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:33.566455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:33.568115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:33.568818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:33.569600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:33.570341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:33.599290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.599732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-18ae3a1b-845a-4ed5-99ad-e1a0714bf3be req-f4534757-9064-45f0-bcca-e3e2fc8c23f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fcbc59c-ecf4-4120-9eba-e9c1900708f2", "name": "network-vif-deleted", "tag": "32f41c99-3168-46f5-bb23-d071584aaeba"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:33.600976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.602809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.607407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.645109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-18ae3a1b-845a-4ed5-99ad-e1a0714bf3be req-f4534757-9064-45f0-bcca-e3e2fc8c23f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.648214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-18ae3a1b-845a-4ed5-99ad-e1a0714bf3be req-f4534757-9064-45f0-bcca-e3e2fc8c23f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.662359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:33.673546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:33.687493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-18ae3a1b-845a-4ed5-99ad-e1a0714bf3be req-f4534757-9064-45f0-bcca-e3e2fc8c23f3 service nova] Creating event network-vif-deleted:32f41c99-3168-46f5-bb23-d071584aaeba for instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 on nch2-master-1 Apr 09 21:05:33.700152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:33.702992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:33.704812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-18ae3a1b-845a-4ed5-99ad-e1a0714bf3be req-f4534757-9064-45f0-bcca-e3e2fc8c23f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124073 Apr 09 21:05:33.712071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1551/3068] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:33.723376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:33.729549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:33.749509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.752445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.753562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:33.754254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:33.848617 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-680c2336-44a8-4878-9772-aa8acb7c5756 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565883 Apr 09 21:05:33.852547 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1518/3069] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:33.864304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e43552fd-3bf6-4250-b4be-860d59fa0aca tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:33.868636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:33.869885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e43552fd-3bf6-4250-b4be-860d59fa0aca tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:33.877485 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58af9312-d6b3-4b84-883b-efd6244ef7b0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1269 microversion: 2.1 time: 0.163764 Apr 09 21:05:33.918690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1552/3070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:33 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:33.966127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e43552fd-3bf6-4250-b4be-860d59fa0aca tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:33.978549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e43552fd-3bf6-4250-b4be-860d59fa0aca tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1214 microversion: 2.1 time: 0.120336 Apr 09 21:05:33.980646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1519/3071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:33 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:34.174338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.174973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:34.186085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.186646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.187453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.188518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.305785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ef5c237-eadb-46af-872e-95169e52211a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e2ae4c0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.416261 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ef5c237-eadb-46af-872e-95169e52211a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.114269 Apr 09 21:05:34.416853 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1520/3072] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:34 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:34.520174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:34.576614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.577897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:34.579064 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5861f92d-e760-400b-8ab0-a566ac149c05 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.409093 Apr 09 21:05:34.596562 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1553/3073] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:34 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:34.597386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.597846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.598650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.599089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.632489 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. Apr 09 21:05:34.634260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:34.635312 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4df39ba8-bc3a-4f56-80d6-c6b46bb88c3c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 404 len: 111 microversion: 2.1 time: 0.063433 Apr 09 21:05:34.638737 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1521/3074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:34 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:05:34.648394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.649305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:34.670696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.675757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.675757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.681215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.732919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:34.894373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-875ab3ab-945b-4849-98fc-92742464d706 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 204 len: 0 microversion: 2.1 time: 0.252144 Apr 09 21:05:34.896840 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1554/3075] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:34 2022] DELETE /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:34.898658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.904631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:34.918095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:34.920915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:34.934458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.936457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.937827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.943089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.944082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.944547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:34.949599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:34.955780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:35.160148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:35.171298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-abe1f479-ebc7-48ca-b424-f2b52c43edd2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1275 microversion: 2.1 time: 0.277690 Apr 09 21:05:35.174511 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1522/3076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:34 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:35.190796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:35.191666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:35.204526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:35.206637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:35.209280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:35.209948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:35.319743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:35.333536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fe90286-eda9-43e9-be9b-e61080de523a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1218 microversion: 2.1 time: 0.156952 Apr 09 21:05:35.346260 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1523/3077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:35 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:35.388772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:35.397972 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a050b7be-f7f6-4a1c-bb4a-5942f5de2a4b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1496 microversion: 2.1 time: 0.496359 Apr 09 21:05:35.411710 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1555/3078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:34 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1496 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:35.429878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db22f4a1-7f2e-4356-b1b6-38f557800efe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e24a790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:35.504901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db22f4a1-7f2e-4356-b1b6-38f557800efe tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.079174 Apr 09 21:05:35.505733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1524/3079] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:35 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:35.606552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:35.607217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:35.617598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:35.618059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:35.618863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:35.619303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:35.747942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:35.780704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-00331228-be57-46bb-8d71-dc184835b591 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.180196 Apr 09 21:05:35.784263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1556/3080] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:35 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:36.003430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-324631404", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:36.019412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:36.020850 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:36.020850 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:36.022177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.022694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.023595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.024631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.086963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] validate_networks() for [('0bf24866-60b3-4101-b866-75be687eaa36', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:36.101841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a92724fc-664d-4df2-b7ba-a109359a7b41 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.273216 Apr 09 21:05:36.110386 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1557/3081] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:35 2022] GET /compute/v2.1/os-services => generated 947 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:36.124693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:36.126082 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:36.126082 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:36.127321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.127772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.128577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.129012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.156679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5470d5d3-19f4-414e-b76c-7a8665adac82 tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.045107 Apr 09 21:05:36.164820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1558/3082] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Apr 9 21:05:36 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:36.169908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:36.171456 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:36.171456 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:36.172992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.173621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.174601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.175203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.205143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66d8405a-ac1b-47a1-9c5c-23a8ec04e41a tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038840 Apr 09 21:05:36.218477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1559/3083] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 21:05:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:36.227750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:36.229696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:36.236570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.237844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:36.252178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:36.252847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.264835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:37.282004 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-156486c2-6f0d-41f3-af08-e83d16bbfe36 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 1.058024 Apr 09 21:05:37.282633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1560/3084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:36 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:37.294870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:37.296406 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:37.296406 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:37.297958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.298635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.299853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.300475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.331410 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7921e7fb-2b13-4811-a652-f28708585b0d tempest-ServicesAdminTestJSON-920661097 tempest-ServicesAdminTestJSON-920661097-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.047696 Apr 09 21:05:37.332620 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1561/3085] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:37 2022] GET /compute/v2.1/os-services => generated 947 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:37.338621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:37.338972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:37.345592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.346047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.346836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.347273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.518711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:37.530311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1794e8aa-0f08-4252-9376-1942c1a39e9a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1272 microversion: 2.1 time: 0.196290 Apr 09 21:05:37.530949 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1562/3086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:37 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:37.541234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:37.549746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:37.562290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.562823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.568014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.568735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.597091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:37.598240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:37.598889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:37.599488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:37.600292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:37.622126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.622807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.623901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:37.624659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:37.685920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Getting quotas for project f502d4df1e734e299d496111206e0bf0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:37.710389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Getting quotas for user f1b45ff3203a45609c6a2a57b3004dd3 and project f502d4df1e734e299d496111206e0bf0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:37.765019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:37.772796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:37.861536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d8f6284-dca0-42e6-82e2-1af5ff259426 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.040025 Apr 09 21:05:37.862987 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1525/3087] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:37.875093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65515832-df36-4964-b34e-5c4d9b4fbf34 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e294820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:37.974275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65515832-df36-4964-b34e-5c4d9b4fbf34 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.109814 Apr 09 21:05:37.974872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1526/3088] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:37 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:37.979496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:37.995052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:38.009549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.010007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.012471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.012471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.194525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:38.227191 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ddf20b6-afb2-4a07-86b6-94c1d5a0ae44 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1929 microversion: 2.75 time: 0.251050 Apr 09 21:05:38.227803 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1527/3089] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:37 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:38.251932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c5a414a-76c5-4a18-a3bd-2fe54f379932 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:38.261755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c5a414a-76c5-4a18-a3bd-2fe54f379932 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:38.323661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:38.345323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99fe01d9-f09a-43b9-8f68-9682ce6c78d8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 200 len: 1496 microversion: 2.1 time: 0.807377 Apr 09 21:05:38.347430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1563/3090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:37 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 1496 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:38.370822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6cae96b1-f06e-45b7-a863-bdeaac5107a3 req-dd568bfc-d80e-4e61-96cc-9d8c2a1487d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d7765-2bd1-40ba-adc2-3d6fb923297b", "name": "network-vif-deleted", "tag": "1fc04f79-02c1-4f55-b1c0-6258e35f28a4"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:38.402289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6cae96b1-f06e-45b7-a863-bdeaac5107a3 req-dd568bfc-d80e-4e61-96cc-9d8c2a1487d8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.403075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6cae96b1-f06e-45b7-a863-bdeaac5107a3 req-dd568bfc-d80e-4e61-96cc-9d8c2a1487d8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.425444 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6cae96b1-f06e-45b7-a863-bdeaac5107a3 req-dd568bfc-d80e-4e61-96cc-9d8c2a1487d8 service nova] Creating event network-vif-deleted:1fc04f79-02c1-4f55-b1c0-6258e35f28a4 for instance d65d7765-2bd1-40ba-adc2-3d6fb923297b on nch2-master-1 Apr 09 21:05:38.433757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6cae96b1-f06e-45b7-a863-bdeaac5107a3 req-dd568bfc-d80e-4e61-96cc-9d8c2a1487d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074795 Apr 09 21:05:38.434564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1564/3091] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:38.444390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:38.445174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:38.463123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.463668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.466805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.467261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.470777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c5a414a-76c5-4a18-a3bd-2fe54f379932 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:38.479569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c5a414a-76c5-4a18-a3bd-2fe54f379932 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1223 microversion: 2.1 time: 0.250518 Apr 09 21:05:38.480177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1528/3092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:38 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1223 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:38.547941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:38.548809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:38.556135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.568734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.569651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:38.570101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:38.853429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:38.861677 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e3e9fa7-8b26-4197-9ca9-69e851e7dc21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.425669 Apr 09 21:05:38.862281 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1565/3093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:38 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:38.988501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3755ae0-631b-4843-b66a-ef469004cdc2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e2bcb80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:39.069781 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3755ae0-631b-4843-b66a-ef469004cdc2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.086143 Apr 09 21:05:39.076093 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1566/3094] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:38 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:39.246332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:39.246993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:39.254549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.254908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.255717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.256131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.298144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:39.305973 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-808d66ef-ecc7-46f5-8dcb-7b07e09691d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.762163 Apr 09 21:05:39.311943 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1529/3095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:38 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:39.364036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:39.365332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:39.397679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.403678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.408649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.409740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.422122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:39.437888 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. Apr 09 21:05:39.438748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:39.439765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-675d61dc-0a83-41c6-93f3-cbbcedb9086e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 404 len: 111 microversion: 2.1 time: 0.079682 Apr 09 21:05:39.441126 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1530/3096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:39 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:39.490550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4d06eb6-42d3-4e81-9486-aee408812a03 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1947 microversion: 2.75 time: 0.238438 Apr 09 21:05:39.497029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:39.497678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:39.508799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.511030 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1567/3097] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:39 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1947 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:39.515171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.524813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.525303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.595274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-710973241", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:39.702246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:39.726288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3903c54b-f524-472c-a6ae-2ae21322fe63 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1275 microversion: 2.1 time: 0.233429 Apr 09 21:05:39.726813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:05:39.736856 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1531/3098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:39 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:39.880632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:39.881419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:39.891939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.894185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:39.901134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:39.904738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.171661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:40.180060 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-88fa5e5e-845f-4f28-8169-64f80d67b782 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.304670 Apr 09 21:05:40.189306 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1532/3099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:39 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:40.200932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-274c9a1c-76e7-4d5b-8735-bb75b4980851 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e20a9d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:40.262544 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-274c9a1c-76e7-4d5b-8735-bb75b4980851 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1455 microversion: 2.1 time: 0.075065 Apr 09 21:05:40.268307 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1533/3100] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:40 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:40.272816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9dd82792-bb62-4c74-b921-e9f15f220350 req-9b9e05f0-0810-4139-aaae-e34afa30b772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f547d94a-a0fa-49d6-8a26-369b8f5a1c59", "tag": "43f0ad35-e33b-4e7f-859c-ad2d7fe472ea"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:40.291474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9dd82792-bb62-4c74-b921-e9f15f220350 req-9b9e05f0-0810-4139-aaae-e34afa30b772 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.291925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9dd82792-bb62-4c74-b921-e9f15f220350 req-9b9e05f0-0810-4139-aaae-e34afa30b772 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.319146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9dd82792-bb62-4c74-b921-e9f15f220350 req-9b9e05f0-0810-4139-aaae-e34afa30b772 service nova] Creating event network-changed:43f0ad35-e33b-4e7f-859c-ad2d7fe472ea for instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 on nch2-master-1 Apr 09 21:05:40.335716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9dd82792-bb62-4c74-b921-e9f15f220350 req-9b9e05f0-0810-4139-aaae-e34afa30b772 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066290 Apr 09 21:05:40.336629 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1534/3101] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:40.342109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:40.342875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:40.349778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.350350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.351619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.352166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.627969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:40.628548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:40.628849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:40.630865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:40.631300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:40.658936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.661329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.665138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.666070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.712022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:40.721687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:40.737170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:05:40.740177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:05:40.772608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:40.780388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c877bacd-8268-4921-b62f-415401b4c129 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.442487 Apr 09 21:05:40.789819 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1535/3102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:40 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:40.789819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-08abaae2-0650-415e-971d-aecd3904254b req-41b14412-89f8-4311-82ed-738778737e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b84c86-30cb-41cd-9654-0f3a7569149f", "tag": "048d8001-0bf8-4fc1-81cf-7a1f07ec5f03"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:40.803742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08abaae2-0650-415e-971d-aecd3904254b req-41b14412-89f8-4311-82ed-738778737e90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.804088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08abaae2-0650-415e-971d-aecd3904254b req-41b14412-89f8-4311-82ed-738778737e90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.832745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-08abaae2-0650-415e-971d-aecd3904254b req-41b14412-89f8-4311-82ed-738778737e90 service nova] Creating event network-changed:048d8001-0bf8-4fc1-81cf-7a1f07ec5f03 for instance 95b84c86-30cb-41cd-9654-0f3a7569149f on nch1-master-1 Apr 09 21:05:40.842965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-08abaae2-0650-415e-971d-aecd3904254b req-41b14412-89f8-4311-82ed-738778737e90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060573 Apr 09 21:05:40.843579 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1536/3103] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:40.856149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:40.856926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:40.867328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.867828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.868630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.874230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.927896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3a1d5fe-5ef5-47b0-8803-52f1ecc1f44f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338246 Apr 09 21:05:40.936879 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1568/3104] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:05:40.956670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:40.959725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:40.978910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.983530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:40.985892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:40.986379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.071427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:41.092910 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed036f6e-e2ad-4c21-8874-3b18cce1f146 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1935 microversion: 2.75 time: 0.247951 Apr 09 21:05:41.093458 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1537/3105] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:40 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1935 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:41.099308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-873cebe7-ca13-4df4-860c-f1f6f341ac6d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.099975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-873cebe7-ca13-4df4-860c-f1f6f341ac6d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:41.104611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:41.114453 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c49b988-e673-45bd-a6f3-dfe2514d1b61 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1293 microversion: 2.1 time: 0.175018 Apr 09 21:05:41.121549 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1569/3106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:40 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:41.196841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.197534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:41.204250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.204726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.205554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.205993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.228927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-873cebe7-ca13-4df4-860c-f1f6f341ac6d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:41.237164 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-873cebe7-ca13-4df4-860c-f1f6f341ac6d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1208 microversion: 2.1 time: 0.142624 Apr 09 21:05:41.239645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1538/3107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:41.281786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de4a6b7e-106b-4ca7-abf5-5fa01f47f314 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ecfb430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.371411 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de4a6b7e-106b-4ca7-abf5-5fa01f47f314 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1464 microversion: 2.1 time: 0.097025 Apr 09 21:05:41.377472 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1539/3108] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:41.388708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c3f52aa-7107-490e-91d1-97a4ca2a1de6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e18e790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.462344 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c3f52aa-7107-490e-91d1-97a4ca2a1de6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 200 len: 1464 microversion: 2.1 time: 0.080970 Apr 09 21:05:41.465785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1540/3109] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:41.478841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.487294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:41.496314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.497347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.499664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.500613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.517956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:41.529143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-754c2cbb-fb6a-4ee8-98f4-89642d94f117 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.335989 Apr 09 21:05:41.531941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1570/3110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:41.721492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:41.735211 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5acdeb71-04ab-4621-b281-ce9c97f03c6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1480 microversion: 2.1 time: 0.261383 Apr 09 21:05:41.735818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1541/3111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1480 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:41.797522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:41.798253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:41.805765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.806396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:41.807325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:41.807915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.010812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.018599 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3689bda0-65aa-478b-b916-61b014b1ddae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.225675 Apr 09 21:05:42.028098 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1571/3112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:41 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:42.115726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.116350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.123236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.123697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.124498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.124937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.138773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.139434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.145838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.146607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.147561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.148144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.200656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] Lazy-loading 'services' on Instance uuid 532e4e59-36d5-4382-97c7-0fe1c4529095 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:05:42.218640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5093a22-476f-482b-bf84-cb0b209be6f5 tempest-ServersAdmin275Test-1386852732 tempest-ServersAdmin275Test-1386852732-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1920 microversion: 2.75 time: 0.106572 Apr 09 21:05:42.219553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1542/3113] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1920 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:42.247614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.248115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.255450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.255988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.256678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.257145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.282614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:42.291652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.299641 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7bd60cce-2322-40c9-99a1-cb1c097c18ff tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.165060 Apr 09 21:05:42.300224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1572/3114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:42.305141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.305884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.311884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.312338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.313379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.313792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.376604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.379999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a023edc-f376-4ccd-9ef6-d0414e3a6789 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "DELETE /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 204 len: 0 microversion: 2.75 time: 0.136056 Apr 09 21:05:42.380769 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1543/3115] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:42 2022] DELETE /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:05:42.384769 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30796ca9-7b49-43ef-a0a7-e89fcbd63ddf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1212 microversion: 2.1 time: 0.083356 Apr 09 21:05:42.385446 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1573/3116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:42.400295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.401005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.407874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.408322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.409339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.409924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.481777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.491900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.494031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:42.499046 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84791631-d471-40df-a538-7750ee581dbc tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1444 microversion: 2.75 time: 0.111937 Apr 09 21:05:42.500116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1544/3117] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:05:42.643375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Action: 'update', calling method: .version_select at 0x7fb08e24f280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:42.644882 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:42.644882 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:42.647843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.659647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.676022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e5bc7a8b-d7eb-4470-bf25-d704a7ff37e0 req-b1a711a3-1b8a-4bce-8a92-d6bcfedd2eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3a8c29-e199-4d97-8cde-57b42551b09e", "name": "network-vif-unplugged", "status": "completed", "tag": "7871b15f-ec75-4638-8efa-02a7ceefbe68"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:42.687123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e5bc7a8b-d7eb-4470-bf25-d704a7ff37e0 req-b1a711a3-1b8a-4bce-8a92-d6bcfedd2eed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.687563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e5bc7a8b-d7eb-4470-bf25-d704a7ff37e0 req-b1a711a3-1b8a-4bce-8a92-d6bcfedd2eed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.693070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.693508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.701271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] HTTP exception thrown: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. Apr 09 21:05:42.702262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Returning 404 to user: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:42.703181 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c12967c2-9392-4f09-a6a8-efee5c493cad tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3" status: 404 len: 110 microversion: 2.53 time: 0.189383 Apr 09 21:05:42.703967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1574/3118] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Apr 9 21:05:42 2022] PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 => generated 110 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:42.704933 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e5bc7a8b-d7eb-4470-bf25-d704a7ff37e0 req-b1a711a3-1b8a-4bce-8a92-d6bcfedd2eed service nova] Creating event network-vif-unplugged:7871b15f-ec75-4638-8efa-02a7ceefbe68 for instance bc3a8c29-e199-4d97-8cde-57b42551b09e on nch2-master-1 Apr 09 21:05:42.710330 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e5bc7a8b-d7eb-4470-bf25-d704a7ff37e0 req-b1a711a3-1b8a-4bce-8a92-d6bcfedd2eed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167230 Apr 09 21:05:42.710934 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1545/3119] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:05:42.713446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.714260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.717445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Action: 'update', calling method: .version_select at 0x7fb08e271670>, body: {"status": "disabled"} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:42.718889 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:42.718889 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:05:42.720470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.721194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.722028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.722707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.723506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.724088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.729527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.730067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.737469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] HTTP exception thrown: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. Apr 09 21:05:42.738185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Returning 404 to user: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:42.739097 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-993bc8a0-da67-405f-ab6f-f795331565be tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3" status: 404 len: 110 microversion: 2.53 time: 0.026883 Apr 09 21:05:42.744347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1546/3120] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Apr 9 21:05:42 2022] PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:42.751224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Action: 'update', calling method: .version_select at 0x7fb08ecfb820>, body: {"status": "enabled"} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:42.753705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.754377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.760792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.761290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.766914 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] HTTP exception thrown: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. Apr 09 21:05:42.767515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Returning 404 to user: Service eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:42.768451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d05cf1fd-6fe6-4207-8309-a890421fbc4f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3" status: 404 len: 110 microversion: 2.53 time: 0.022805 Apr 09 21:05:42.769050 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1547/3121] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Apr 9 21:05:42 2022] PUT /compute/v2.1/os-services/eef4ed16-c6a3-4d2e-ab7c-c38325e445d3 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:05:42.776988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:42.777766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:42.784769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.785313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:42.786152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:42.786600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.539922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:43.548473 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7ab57ed-5f83-4c00-ba3c-03eb846a7421 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1480 microversion: 2.1 time: 0.778412 Apr 09 21:05:43.549084 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1548/3122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1480 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:43.554058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:43.555475 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:43.555475 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:05:43.557007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.557663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.558643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.559337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.565912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:43.576967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-375d0499-26a5-47d2-a422-d535216e2c0c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.871723 Apr 09 21:05:43.578200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1575/3123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:42 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:43.593406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:43.594221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:43.595616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2049f8ad-17f6-4516-b334-20712406ca82 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.045051 Apr 09 21:05:43.596476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1549/3124] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Apr 9 21:05:43 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:43.602364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:43.607776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.608467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.609512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.610095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.612394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:43.621776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.622373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.623318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.624227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.932366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:43.940072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b944ced-4abb-4a32-8fe9-adab8204dd6a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.341877 Apr 09 21:05:43.940959 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1550/3125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:43 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:43.941159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:43.945977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:43.946596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:43.949637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3af7f2f-7d08-43d9-83fb-a8de64eff044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.360631 Apr 09 21:05:43.950227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1576/3126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:43 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:43.952635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.953281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.954070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.954509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.955559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:43.956220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:43.963514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.963958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:43.964728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:43.965501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.060853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:44.063986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:44.070058 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd351d59-ec30-48f7-8402-09522c374852 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1212 microversion: 2.1 time: 0.127897 Apr 09 21:05:44.075415 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1551/3127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:43 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1212 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:44.075681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:44.075874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '877cb7c7f5da43638d8cb4fe28a927ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9455ce3b4e4d268c23b32258d8eeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:44.079941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.081717 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9b99dc6-948e-4c0f-9b6e-d9552d860abf tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 200 len: 1444 microversion: 2.75 time: 0.130026 Apr 09 21:05:44.081936 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.081936 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:05:44.082502 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1577/3128] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:43 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:44.083182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.083956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.084785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.085409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.110114 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61832ee2-ea85-4851-9cfb-7db8e7c02696 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.038364 Apr 09 21:05:44.110941 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1552/3129] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:44.123834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.125109 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.125109 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:44.126312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.126767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.127581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.128017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.190037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0baef603-c21e-4965-a246-a4802cfc6b40 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.069851 Apr 09 21:05:44.191550 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1578/3130] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:44.203138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.206345 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.206345 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:05:44.207777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.208382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.209247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.209689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.249897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2f7d690-001c-46f1-82ca-5dd8bac24819 tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.050628 Apr 09 21:05:44.250966 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1553/3131] 10.222.0.30 () {60 vars in 1236 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:44.263130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.264490 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.264490 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:44.265998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.267312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.269442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.271275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.303632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3f52a49c-4a3d-440a-ad01-70f8f92d84ec tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.045702 Apr 09 21:05:44.304623 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1579/3132] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:05:44.321359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.322873 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.322873 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:05:44.324203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.324701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.325562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.326010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.353501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-67837ed6-f53a-45d6-b1e7-a4a7d2593f9f tempest-ServicesAdminNegativeV253TestJSON-112714787 tempest-ServicesAdminNegativeV253TestJSON-112714787-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040253 Apr 09 21:05:44.354456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1554/3133] 10.222.0.30 () {60 vars in 1238 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:44.438380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-538bd51a-0aea-4d77-aa79-62f6bbacda57 req-69bb610d-c480-4afc-8fe6-643181505ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9b17d2-4843-4ccd-99cb-202ac14e17bc", "tag": "95e85505-89f4-484e-85ba-776f685b7c44"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:44.452785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-538bd51a-0aea-4d77-aa79-62f6bbacda57 req-69bb610d-c480-4afc-8fe6-643181505ab3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.453290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-538bd51a-0aea-4d77-aa79-62f6bbacda57 req-69bb610d-c480-4afc-8fe6-643181505ab3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.465975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-538bd51a-0aea-4d77-aa79-62f6bbacda57 req-69bb610d-c480-4afc-8fe6-643181505ab3 service nova] Creating event network-changed:95e85505-89f4-484e-85ba-776f685b7c44 for instance 0b9b17d2-4843-4ccd-99cb-202ac14e17bc on nch1-master-1 Apr 09 21:05:44.471049 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-538bd51a-0aea-4d77-aa79-62f6bbacda57 req-69bb610d-c480-4afc-8fe6-643181505ab3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037029 Apr 09 21:05:44.471673 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1555/3134] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:05:44.506805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05201bf5-ce5d-4a3f-b25e-42099be7f89a tempest-ServicesAdminNegativeV253TestJSON-83309321 tempest-ServicesAdminNegativeV253TestJSON-83309321-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.508119 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:05:44.508119 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:05:44.509209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-05201bf5-ce5d-4a3f-b25e-42099be7f89a tempest-ServicesAdminNegativeV253TestJSON-83309321 tempest-ServicesAdminNegativeV253TestJSON-83309321-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '51454cd474cc4b2c8d6ac3b4546c9da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead5a374fd746ebbe70d73a43bedf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:44.509842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05201bf5-ce5d-4a3f-b25e-42099be7f89a tempest-ServicesAdminNegativeV253TestJSON-83309321 tempest-ServicesAdminNegativeV253TestJSON-83309321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:44.510638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-05201bf5-ce5d-4a3f-b25e-42099be7f89a tempest-ServicesAdminNegativeV253TestJSON-83309321 tempest-ServicesAdminNegativeV253TestJSON-83309321-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.148742 Apr 09 21:05:44.511154 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1580/3135] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:44.566325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.567028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:44.573618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.574067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.574848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.575281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.595445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:44.596252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:44.603115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.603628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:44.604459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:44.605425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.124002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:45.133623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:45.135719 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1c85528d-8936-4f21-a070-6836ab556455 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1467 microversion: 2.1 time: 0.573649 Apr 09 21:05:45.148513 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0589e3d-e573-42bd-a150-2f9db924ad5b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.554780 Apr 09 21:05:45.149724 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1556/3136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1467 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:45.155868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1581/3137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:44 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:45.156822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:45.158064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:45.163594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:45.165763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:45.166575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.167041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.167844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.168297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.182782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.183615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.184631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.185287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.711219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:45.723090 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9510f9ae-9575-4120-8f64-652e33e4a9f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.565732 Apr 09 21:05:45.724008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1582/3138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:45 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:45.729263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:45.730344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:45.737870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:45.738740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.739354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.740374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.740885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.746906 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3cf8c243-d7ed-4b18-8c85-2a0022c6cefd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.595539 Apr 09 21:05:45.747720 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1557/3139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:45 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:45.752605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:45.753481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] [instance: 532e4e59-36d5-4382-97c7-0fe1c4529095] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:45.760006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.760601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.761425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.761870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.776536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] HTTP exception thrown: Instance 532e4e59-36d5-4382-97c7-0fe1c4529095 could not be found. Apr 09 21:05:45.777446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] Returning 404 to user: Instance 532e4e59-36d5-4382-97c7-0fe1c4529095 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:45.778636 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dc177ab0-060b-4f89-869e-c5527362a6f5 tempest-ServersAdmin275Test-1374329397 tempest-ServersAdmin275Test-1374329397-project] 10.222.0.30 "GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095" status: 404 len: 111 microversion: 2.75 time: 0.029679 Apr 09 21:05:45.782609 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1558/3140] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:05:45 2022] GET /compute/v2.1/servers/532e4e59-36d5-4382-97c7-0fe1c4529095 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:45.788435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-458663107"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:45.789920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:45.797490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.800387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.801224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.801693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:45.925753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:45.935952 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80e391cb-2be2-42bc-894e-d3f12c21b7f7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1266 microversion: 2.1 time: 0.210649 Apr 09 21:05:45.938211 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1583/3141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:45 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:45.954758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-44005124-0446-4948-8b44-0795b484b200 req-05ab5ee8-ff61-4bdc-a888-7f5d50b411dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b84c86-30cb-41cd-9654-0f3a7569149f", "name": "network-vif-plugged", "status": "completed", "tag": "048d8001-0bf8-4fc1-81cf-7a1f07ec5f03"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:45.989153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-44005124-0446-4948-8b44-0795b484b200 req-05ab5ee8-ff61-4bdc-a888-7f5d50b411dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:45.989567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-44005124-0446-4948-8b44-0795b484b200 req-05ab5ee8-ff61-4bdc-a888-7f5d50b411dd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:46.003258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-44005124-0446-4948-8b44-0795b484b200 req-05ab5ee8-ff61-4bdc-a888-7f5d50b411dd service nova] Creating event network-vif-plugged:048d8001-0bf8-4fc1-81cf-7a1f07ec5f03 for instance 95b84c86-30cb-41cd-9654-0f3a7569149f on nch1-master-1 Apr 09 21:05:46.009898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-44005124-0446-4948-8b44-0795b484b200 req-05ab5ee8-ff61-4bdc-a888-7f5d50b411dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058671 Apr 09 21:05:46.010826 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1584/3142] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:46.159023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f3bd284-70c2-40d1-9cf1-652fb634f691 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "POST /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24/action" status: 202 len: 0 microversion: 2.1 time: 0.374883 Apr 09 21:05:46.160164 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1559/3143] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:45 2022] POST /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:05:46.171934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f267589c-7a36-4b55-953b-204792f6271b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e20a0d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:46.174365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:46.177308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:46.191876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:46.193939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:46.195099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:46.196102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:46.228524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f267589c-7a36-4b55-953b-204792f6271b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.062773 Apr 09 21:05:46.229671 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1560/3144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:46 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:46.743435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:46.744278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:46.757202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:46.757664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:46.758468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:46.758921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:47.160843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:47.171369 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fdeceb3-2168-49e6-8f8d-546ff67fd399 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 1.011919 Apr 09 21:05:47.172257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1585/3145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:46 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.177415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.178544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:47.187334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:47.188226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:47.189325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:47.190334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:47.264423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:47.278156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-866240f6-4181-4733-bcda-5f89c841157d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.542002 Apr 09 21:05:47.279664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1561/3146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:46 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.285883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.286717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:47.293610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:47.294070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:47.294852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:47.296513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:47.583587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:47.592997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88001157-a156-46e9-a796-53c47ea50138 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.419315 Apr 09 21:05:47.594455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1586/3147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.599542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71dde9a2-bc5f-4e02-8cb6-2da215a0bb6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e255550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.620602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:47.628224 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16f88ede-6be0-404a-986e-635262ad0ebd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.347272 Apr 09 21:05:47.628801 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1562/3148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.661688 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71dde9a2-bc5f-4e02-8cb6-2da215a0bb6f tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.065896 Apr 09 21:05:47.662568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1587/3149] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.885313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5feb43c-9e96-4498-97ef-d6e2cc01d4e3 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.894122 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5feb43c-9e96-4498-97ef-d6e2cc01d4e3 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.264120 Apr 09 21:05:47.894659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1563/3150] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:47.908235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e8b9180a-fa26-408d-a665-192ffdaf8dac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.928526 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e8b9180a-fa26-408d-a665-192ffdaf8dac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.024972 Apr 09 21:05:47.929317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1588/3151] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:47.941779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-077a5175-69a8-4b70-b3b0-8655dfe593ac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.950689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-077a5175-69a8-4b70-b3b0-8655dfe593ac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012973 Apr 09 21:05:47.951259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1564/3152] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:47.963280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-423fc19f-39aa-4968-ad54-8b100e1d7020 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:47.971766 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-423fc19f-39aa-4968-ad54-8b100e1d7020 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012654 Apr 09 21:05:47.972339 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1589/3153] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:47.982810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1e82d02-da43-4455-9c2e-27aac1edc0a4 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.008380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1e82d02-da43-4455-9c2e-27aac1edc0a4 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.029417 Apr 09 21:05:48.009022 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1565/3154] 10.222.0.30 () {58 vars in 1164 bytes} [Sat Apr 9 21:05:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.022785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9566ba5e-ef56-4e29-ae23-8146a10f9101 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.031330 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9566ba5e-ef56-4e29-ae23-8146a10f9101 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012341 Apr 09 21:05:48.031921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1590/3155] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.042599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34fbe15b-9948-4c04-9abe-a5f2da5edf05 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.067962 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34fbe15b-9948-4c04-9abe-a5f2da5edf05 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029144 Apr 09 21:05:48.069077 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1566/3156] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.082166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de6a1912-dfce-4812-8145-d1922f1a7c09 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.093988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de6a1912-dfce-4812-8145-d1922f1a7c09 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.015932 Apr 09 21:05:48.094566 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1591/3157] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.106768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4006060-d593-4e6b-b82b-c0dcc9026307 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.114741 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4006060-d593-4e6b-b82b-c0dcc9026307 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011997 Apr 09 21:05:48.115390 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1567/3158] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.126116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b717fc06-880c-42d5-809b-502c84d059c1 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.164986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b717fc06-880c-42d5-809b-502c84d059c1 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.042843 Apr 09 21:05:48.165626 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1592/3159] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:48.184446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-37dd0dac-8699-4095-a7a4-b4fc27598ee0 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.189624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.190270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:48.193734 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-37dd0dac-8699-4095-a7a4-b4fc27598ee0 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013187 Apr 09 21:05:48.194477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1568/3160] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.202351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.202805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.203644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.204048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.209220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4faf346-36c7-4691-a2c4-7ac8ebee5e71 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.228666 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4faf346-36c7-4691-a2c4-7ac8ebee5e71 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.026772 Apr 09 21:05:48.229568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1569/3161] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:48.243489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a317c845-8394-464f-aa0a-7616bba73c42 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.257535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a317c845-8394-464f-aa0a-7616bba73c42 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018826 Apr 09 21:05:48.261171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1570/3162] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.270209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a1217b41-553b-4692-9171-6f706efc753c tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.285171 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a1217b41-553b-4692-9171-6f706efc753c tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019067 Apr 09 21:05:48.285884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1571/3163] 10.222.0.30 () {58 vars in 1147 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.298069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7660bfe5-3c9d-42ac-a53d-d9787e93b8ac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.312908 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7660bfe5-3c9d-42ac-a53d-d9787e93b8ac tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018811 Apr 09 21:05:48.313855 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1572/3164] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.323374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.324221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:48.332108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.332973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.333645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.334530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.442375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:48.453452 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ee0329e-6539-4743-9b3c-d104e421a599 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1317 microversion: 2.1 time: 0.269296 Apr 09 21:05:48.463027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1593/3165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.470523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e563b498-6d84-4cfc-b9a5-4c5ff3939472 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.480963 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e563b498-6d84-4cfc-b9a5-4c5ff3939472 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016609 Apr 09 21:05:48.481760 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1594/3166] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.492010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-13ded294-21f3-4e06-994a-15dd73a94bcf tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.531678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-13ded294-21f3-4e06-994a-15dd73a94bcf tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.043267 Apr 09 21:05:48.542074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1595/3167] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.549231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5fb869d-af6f-4e39-8304-6fac74ed4f27 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.587150 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5fb869d-af6f-4e39-8304-6fac74ed4f27 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042665 Apr 09 21:05:48.600890 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1596/3168] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.612538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04d60b38-f702-43cd-bc8e-365c123a4bd4 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.621595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04d60b38-f702-43cd-bc8e-365c123a4bd4 tempest-FlavorsV2TestJSON-209961919 tempest-FlavorsV2TestJSON-209961919-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019310 Apr 09 21:05:48.622199 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1597/3169] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.642172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.643745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:48.660113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.660725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.661915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.662222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.690272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:48.699207 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4ffd539-27cc-4084-9c62-e8c67e33cbbb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.384154 Apr 09 21:05:48.699822 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1573/3170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:48.726717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-986e69c0-ff5c-4b0b-9369-9a5e75d0012c req-5c63d389-fb5d-4b83-a7ba-084e85fcc1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f547d94a-a0fa-49d6-8a26-369b8f5a1c59", "name": "network-vif-plugged", "status": "completed", "tag": "43f0ad35-e33b-4e7f-859c-ad2d7fe472ea"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:48.762040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-986e69c0-ff5c-4b0b-9369-9a5e75d0012c req-5c63d389-fb5d-4b83-a7ba-084e85fcc1c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.762570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-986e69c0-ff5c-4b0b-9369-9a5e75d0012c req-5c63d389-fb5d-4b83-a7ba-084e85fcc1c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.787509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-986e69c0-ff5c-4b0b-9369-9a5e75d0012c req-5c63d389-fb5d-4b83-a7ba-084e85fcc1c6 service nova] Creating event network-vif-plugged:43f0ad35-e33b-4e7f-859c-ad2d7fe472ea for instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 on nch2-master-1 Apr 09 21:05:48.795698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-986e69c0-ff5c-4b0b-9369-9a5e75d0012c req-5c63d389-fb5d-4b83-a7ba-084e85fcc1c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086234 Apr 09 21:05:48.796702 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1574/3171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:48.806489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:48.807285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:48.815052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.815710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:48.816695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:48.817390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.087743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:49.101262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a2ce3c1-4c5f-42d8-a1f4-59365d71911b tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.477760 Apr 09 21:05:49.102073 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1598/3172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.118042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04b46c0b-9391-45de-b5c7-cf98aba492f2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e2b5790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:49.122867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:49.132352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1c95c22b-4628-468f-a1f6-167598992387 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.332727 Apr 09 21:05:49.133341 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1575/3173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:48 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.166032 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04b46c0b-9391-45de-b5c7-cf98aba492f2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.052719 Apr 09 21:05:49.166811 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1599/3174] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:49 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.302156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-743b4311-3eb7-4b04-9dbb-4b5184f71632 req-83a97a08-8492-4e90-b827-92bf627fc49c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4064abe2-3845-4a26-b84f-225c78721845", "tag": "8286fc01-3389-4ec0-9d0a-d4698c966afc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:49.311268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-743b4311-3eb7-4b04-9dbb-4b5184f71632 req-83a97a08-8492-4e90-b827-92bf627fc49c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.311713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-743b4311-3eb7-4b04-9dbb-4b5184f71632 req-83a97a08-8492-4e90-b827-92bf627fc49c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.323437 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-743b4311-3eb7-4b04-9dbb-4b5184f71632 req-83a97a08-8492-4e90-b827-92bf627fc49c service nova] Creating event network-changed:8286fc01-3389-4ec0-9d0a-d4698c966afc for instance 4064abe2-3845-4a26-b84f-225c78721845 on nch2-master-1 Apr 09 21:05:49.332960 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-743b4311-3eb7-4b04-9dbb-4b5184f71632 req-83a97a08-8492-4e90-b827-92bf627fc49c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198167 Apr 09 21:05:49.333566 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1576/3175] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:49.471005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:49.471908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:49.478731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.479280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.480399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.480926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.692026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:49.701522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1aecf05c-9715-43e6-9cc0-7080eb9fa1a0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1506 microversion: 2.1 time: 0.234793 Apr 09 21:05:49.702432 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1600/3176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:49 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.718964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:49.719061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:49.719591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:49.719759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:49.725987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.727052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.728439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.729168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.733874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.734332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.735128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.735568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.944667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:49.948229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:49.952846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cef4712c-f434-424d-b089-8648e8d5eafd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.239070 Apr 09 21:05:49.953713 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1577/3177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:49 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.962414 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b4f8a83c-eccf-4e2b-84aa-a9ac52c17c4a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1506 microversion: 2.1 time: 0.243631 Apr 09 21:05:49.969805 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1601/3178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:49 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:49.975498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:49.977840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:49.984248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.984729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:49.985695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:49.986278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.067538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:05:50.067893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:05:50.068374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:05:50.068873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:05:50.069215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:05:50.119680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.120642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:50.128370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.128943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.130081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.130756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.142930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:50.152637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.154047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.155298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.156111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.188361 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a110e1d-4a09-44ae-9c8b-452a71130b52 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "POST /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f/action" status: 202 len: 1108 microversion: 2.1 time: 0.216702 Apr 09 21:05:50.189381 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1578/3179] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:49 2022] POST /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f/action => generated 1108 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 09 21:05:50.194542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.195388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:50.202524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.203196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.204134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.204719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.409659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:50.419614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:50.434348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b43eb62-0eb4-40e2-a9af-4c535f001a37 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.320247 Apr 09 21:05:50.436265 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee398409-2cf9-4ff8-82de-0d849f8d3c8b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.245272 Apr 09 21:05:50.436869 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1579/3180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:50.438501 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1602/3181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:50.443824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c289d1d9-cd16-454f-923f-d22e52a425b5 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ecf41f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.464547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.468767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:50.478040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.478509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.479426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.479974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.500945 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c289d1d9-cd16-454f-923f-d22e52a425b5 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.062808 Apr 09 21:05:50.502925 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1580/3182] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:50.508687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba13f0bb-5b18-4496-81d9-ddf639d243a4 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08ec5a280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.566935 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba13f0bb-5b18-4496-81d9-ddf639d243a4 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19" status: 200 len: 637 microversion: 2.1 time: 0.062680 Apr 09 21:05:50.568256 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1581/3183] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19 => generated 637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:50.632955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:50.640830 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee267da1-5736-4fcb-9ca1-8d8d83e3ded5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.201228 Apr 09 21:05:50.641437 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1603/3184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:50.654503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d586a007-7511-43d6-8094-35ff31c528a6 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08e29ef70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:50.687135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] Calling method '.version_select at 0x7fb08e18ed30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.697541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.697994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.698820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.699119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d586a007-7511-43d6-8094-35ff31c528a6 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:50.699238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.704394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d586a007-7511-43d6-8094-35ff31c528a6 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:50.719091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c773676f-a6f1-4b68-b24c-1ea80db3580b tempest-AbsoluteLimitsTestJSON-1478041429 tempest-AbsoluteLimitsTestJSON-1478041429-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.144742 Apr 09 21:05:50.719719 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1582/3185] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:05:50.975061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:50.975931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:50.983377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.983914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:50.985011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:50.985604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.135371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d586a007-7511-43d6-8094-35ff31c528a6 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.484525 Apr 09 21:05:51.135991 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1604/3186] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:50 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:51.145469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37eeefc5-0b71-4666-98e6-c6e4e5830546 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e23f700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.160449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:51.170347 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf5cce08-67a3-43ec-a4fc-8c03067f73be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.203359 Apr 09 21:05:51.175394 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1583/3187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:50 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:51.451950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.452584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:51.463394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.464417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.466194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.466860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.501104 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37eeefc5-0b71-4666-98e6-c6e4e5830546 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "DELETE /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.359653 Apr 09 21:05:51.501806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1605/3188] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 21:05:51 2022] DELETE /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_version => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:51.506767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.507493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:51.514041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.514600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.515641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.516084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.667899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:51.675807 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb1f1eeb-b59b-4c5c-b852-b7627d303dd6 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.228121 Apr 09 21:05:51.678794 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1584/3189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:51 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:51.692223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-987ec526-263a-42eb-91b2-f03115fee60b tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08ee38ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.724589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:51.733462 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c73eb3ed-715e-4393-9172-88c640c28ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.230626 Apr 09 21:05:51.734033 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1606/3190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:51 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:51.735657 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-987ec526-263a-42eb-91b2-f03115fee60b tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 37 microversion: 2.1 time: 0.047178 Apr 09 21:05:51.736238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1585/3191] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:05:51 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 37 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:51.747478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-870cab5f-ab44-4a50-ae51-1ce07df93c2d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e2205e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.747702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:51.748468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:51.755473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.755990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.756962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:51.757493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:51.794264 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-870cab5f-ab44-4a50-ae51-1ce07df93c2d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.059068 Apr 09 21:05:51.794847 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1607/3192] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:51 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:51.801503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-351fdd9d-206c-41c0-bffb-a947d6b8a359 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08e220940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:51.847656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-351fdd9d-206c-41c0-bffb-a947d6b8a359 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:51.852650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-351fdd9d-206c-41c0-bffb-a947d6b8a359 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:51.909716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:51.918523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f308f7c-16f5-4a03-b43c-2fbf2aea772d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.181122 Apr 09 21:05:51.919204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1586/3193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:51 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:52.152893 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-351fdd9d-206c-41c0-bffb-a947d6b8a359 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.356909 Apr 09 21:05:52.153595 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1608/3194] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:51 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:52.162657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8a217d2-9aa4-44ac-b1c2-f311ec9ccc12 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e18e310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:52.192561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:52.193375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:52.201433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.202028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.203250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.203854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.212076 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8a217d2-9aa4-44ac-b1c2-f311ec9ccc12 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.053236 Apr 09 21:05:52.212746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1587/3195] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_distro => generated 33 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:05:52.223675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9bdbe44-c3e4-43f9-a126-a3413d590dfb tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08e20af70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:52.277181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b9bdbe44-c3e4-43f9-a126-a3413d590dfb tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:52.282772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b9bdbe44-c3e4-43f9-a126-a3413d590dfb tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:52.360815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:52.375942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d033dd66-1cfb-4770-9aeb-8d44e033ea4b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1314 microversion: 2.1 time: 0.187205 Apr 09 21:05:52.376626 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1609/3196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:52.529531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9bdbe44-c3e4-43f9-a126-a3413d590dfb tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.309691 Apr 09 21:05:52.530136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1588/3197] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:52 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:05:52.540765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e99274b-7e7a-4f89-9236-9ab87da3e959 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e23bf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:52.583936 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e99274b-7e7a-4f89-9236-9ab87da3e959 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.046965 Apr 09 21:05:52.584606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1610/3198] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:52.596974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e46fe046-78b4-4529-8f09-fef0cb18c54c tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08ecf4160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:52.643920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e46fe046-78b4-4529-8f09-fef0cb18c54c tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:52.649307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e46fe046-78b4-4529-8f09-fef0cb18c54c tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:52.695015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:52.695997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:52.707817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.708286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.709144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.709796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.933911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e46fe046-78b4-4529-8f09-fef0cb18c54c tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.342386 Apr 09 21:05:52.934525 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1589/3199] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:52 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:05:52.935274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:52.943312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:52.943878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:52.944283 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-091ad292-80eb-40d1-95a4-931cff6aa347 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.252655 Apr 09 21:05:52.950741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.951516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.952957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:52.954108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:52.954220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1611/3200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:52.963806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-977435f3-c736-40c0-af0c-fe39219376b3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23bf70>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:53.024536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-977435f3-c736-40c0-af0c-fe39219376b3 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.065513 Apr 09 21:05:53.025729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1612/3201] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:53.031895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:53.032846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:53.039980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.040776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.041793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.042450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.338568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:53.352783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e569c305-0497-4b6f-8911-cce099ca0197 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.409842 Apr 09 21:05:53.363331 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1590/3202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:52 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:53.368706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-892e1dd6-6ad1-44d4-b0ed-77adc006a874 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08edcce50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:53.383832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:53.393970 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d4e5f7b-d360-4ff4-96c9-48b3ea2713c8 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.367134 Apr 09 21:05:53.395006 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1613/3203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:53 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:53.413282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:53.415954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:53.429157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-892e1dd6-6ad1-44d4-b0ed-77adc006a874 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:53.429858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.430316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.431110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.431538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.444679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-892e1dd6-6ad1-44d4-b0ed-77adc006a874 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:53.757288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:53.766994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1dc0fc0d-edd3-43a8-a0ac-f9e997c73117 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1500 microversion: 2.1 time: 0.360629 Apr 09 21:05:53.778256 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1614/3204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:53 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1500 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:53.778256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5a0259f6-e019-4443-8b79-06827f171bd4 req-a417306e-4bb3-4de7-bb0a-2a74eb8de60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9b17d2-4843-4ccd-99cb-202ac14e17bc", "name": "network-vif-plugged", "status": "completed", "tag": "95e85505-89f4-484e-85ba-776f685b7c44"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:53.780813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5a0259f6-e019-4443-8b79-06827f171bd4 req-a417306e-4bb3-4de7-bb0a-2a74eb8de60e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.781695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5a0259f6-e019-4443-8b79-06827f171bd4 req-a417306e-4bb3-4de7-bb0a-2a74eb8de60e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.796621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5a0259f6-e019-4443-8b79-06827f171bd4 req-a417306e-4bb3-4de7-bb0a-2a74eb8de60e service nova] Creating event network-vif-plugged:95e85505-89f4-484e-85ba-776f685b7c44 for instance 0b9b17d2-4843-4ccd-99cb-202ac14e17bc on nch1-master-1 Apr 09 21:05:53.802326 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5a0259f6-e019-4443-8b79-06827f171bd4 req-a417306e-4bb3-4de7-bb0a-2a74eb8de60e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Apr 09 21:05:53.803921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1615/3205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:53.809564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:53.825865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:53.842381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.842918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.843870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.844791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.875288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-892e1dd6-6ad1-44d4-b0ed-77adc006a874 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.510511 Apr 09 21:05:53.878397 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1591/3206] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:53 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 64 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:53.891796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-58cddb8b-1692-44e2-9192-927d53655c5e tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e20a700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:53.951230 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-58cddb8b-1692-44e2-9192-927d53655c5e tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.066740 Apr 09 21:05:53.952082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1592/3207] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:05:53 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 64 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:05:53.963081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:53.963934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:53.978005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.981467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:53.983693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:53.985530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.022957 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-82153910-343b-48d8-bd75-20104acbbd41 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59/action" status: 202 len: 0 microversion: 2.1 time: 0.216618 Apr 09 21:05:54.028010 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1616/3208] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:05:53 2022] POST /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:05:54.036342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6d182b0-7304-4e60-9c77-78789559f4c5 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08e23f160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:54.099643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f6d182b0-7304-4e60-9c77-78789559f4c5 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:54.106885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f6d182b0-7304-4e60-9c77-78789559f4c5 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:54.174744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:54.195939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-460d335d-eb10-405d-bcbf-d8ea922257bc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.237694 Apr 09 21:05:54.197256 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1593/3209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:53 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:54.204508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:54.205416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:54.215273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.216323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.217675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.218333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.468023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:54.480354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b5b9f40-b475-42c8-a9d3-b9aef71aee54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1505 microversion: 2.1 time: 0.281739 Apr 09 21:05:54.481183 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1594/3210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:54 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:54.492819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eacbeed6-9dd6-4a80-9055-088785f94ff4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee2d0d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:54.542524 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6d182b0-7304-4e60-9c77-78789559f4c5 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.512504 Apr 09 21:05:54.543389 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1617/3211] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:54 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:54.549407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:54.551323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:54.563978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.564427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.565450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.566039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.568378 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eacbeed6-9dd6-4a80-9055-088785f94ff4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.085881 Apr 09 21:05:54.569426 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1595/3212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:54 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:54.574695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:54.575862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:54.582710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.583455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.584454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:54.585122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:54.787367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:54.800507 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-566c474d-50f1-4d62-abd4-f3952ddc4a27 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.254729 Apr 09 21:05:54.802490 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1618/3213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:54 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:54.807960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41d5bf2e-da32-4779-81d5-ceaf7867115d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update', calling method: .version_select at 0x7fb08ec36670>, body: {"meta": {"os_version": "alt"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:54.821331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:54.829628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2113981-bc9b-43d8-9f4b-eebab79a4c2e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.259030 Apr 09 21:05:54.830601 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1596/3214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:54 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:54.875303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-41d5bf2e-da32-4779-81d5-ceaf7867115d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:54.880780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-41d5bf2e-da32-4779-81d5-ceaf7867115d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:55.212981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.213886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:55.226294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.226967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.228540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.229215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.281283 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41d5bf2e-da32-4779-81d5-ceaf7867115d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.477501 Apr 09 21:05:55.287861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1619/3215] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Apr 9 21:05:54 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata/os_version => generated 31 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:55.294366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58145755-04fd-4a48-a0fe-d16fc0a13e3f tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e23b820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.370652 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58145755-04fd-4a48-a0fe-d16fc0a13e3f tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 58 microversion: 2.1 time: 0.081171 Apr 09 21:05:55.371266 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1620/3216] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 58 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:55.384517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d2fc3fe-da6e-4cae-8b3a-1668ba2af374 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'update_all', calling method: .version_select at 0x7fb08e4a41f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:55.480025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0d2fc3fe-da6e-4cae-8b3a-1668ba2af374 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:55.485632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0d2fc3fe-da6e-4cae-8b3a-1668ba2af374 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:55.501114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:55.509955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e470e2ef-01f3-4db7-902d-f622527fffb5 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1323 microversion: 2.1 time: 0.300765 Apr 09 21:05:55.510791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1597/3217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:55.516269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.517188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:55.523683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.524469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.526015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.526568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.694281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:55.703789 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d6d5978-ae7b-4c4b-a50c-7f829fb6b9d7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1485 microversion: 2.1 time: 0.191546 Apr 09 21:05:55.704801 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1598/3218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1485 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:55.709780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9861aae1-626f-4ab0-ad72-390f8c0f6009 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed965e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.756685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9861aae1-626f-4ab0-ad72-390f8c0f6009 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.050569 Apr 09 21:05:55.757505 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1599/3219] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:55.766354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.767071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:55.774335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.774985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.775923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.776541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.809266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:55.906864 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d2fc3fe-da6e-4cae-8b3a-1668ba2af374 tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.528328 Apr 09 21:05:55.907717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1621/3220] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:05:55 2022] PUT /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 61 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:55.913782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.914395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:55.925501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.926128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.927100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.927642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.954786 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ff2632c-675b-4ef3-9400-7a770b845901 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 204 len: 0 microversion: 2.1 time: 0.195811 Apr 09 21:05:55.957329 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1600/3221] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:55 2022] DELETE /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:55.965937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:55.966838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:55.975071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.976237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:55.978201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:55.978814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.183607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:56.186019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:56.195054 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b81d43c-5131-49ca-b139-86e66b70494e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.285868 Apr 09 21:05:56.204191 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1622/3222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:56.204549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa25a018-1e10-488f-926f-1bdceba18031 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.233643 Apr 09 21:05:56.204635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c2431a2e-2e2d-4bcc-a213-fc7f42771862 req-84e05380-516c-4c7c-b354-ef18761b19f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-plugged", "status": "completed", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:56.214003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1601/3223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:55 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:56.216554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2431a2e-2e2d-4bcc-a213-fc7f42771862 req-84e05380-516c-4c7c-b354-ef18761b19f4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:56.217604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2431a2e-2e2d-4bcc-a213-fc7f42771862 req-84e05380-516c-4c7c-b354-ef18761b19f4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.224300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac462d9c-7054-4022-bcdf-871b1ddc23cf tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Action: 'create', calling method: .version_select at 0x7fb08ed34310>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:56.232474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c2431a2e-2e2d-4bcc-a213-fc7f42771862 req-84e05380-516c-4c7c-b354-ef18761b19f4 service nova] Creating event network-vif-plugged:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:05:56.239382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c2431a2e-2e2d-4bcc-a213-fc7f42771862 req-84e05380-516c-4c7c-b354-ef18761b19f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042348 Apr 09 21:05:56.240950 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1623/3224] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:56.247036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:56.248097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:56.257820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:56.258546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.259341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:56.259775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.311205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac462d9c-7054-4022-bcdf-871b1ddc23cf tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:56.326121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac462d9c-7054-4022-bcdf-871b1ddc23cf tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Getting quotas for user 51e0eda090fe47abb90b99dfcdc663c8 and project 521149a43ad4462a915b38310df08c37. Resources: dict_keys(['metadata_items']) {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:56.498287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:56.507672 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a4d4ee1-884a-4830-a098-6b28d5053296 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1491 microversion: 2.1 time: 0.265361 Apr 09 21:05:56.510767 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1624/3225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:56 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1491 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:56.535705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:56.535949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:56.552576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:56.553061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.553901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:56.554338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:56.754785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:56.764218 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9748d1e5-4014-4f98-802f-fc8f7e512cdf tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1518 microversion: 2.1 time: 0.240807 Apr 09 21:05:56.777866 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1625/3226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:56 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:56.788852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7647018-77d5-4df5-ab0d-a70b11fb0720 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23f940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:56.827808 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac462d9c-7054-4022-bcdf-871b1ddc23cf tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "POST /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.612573 Apr 09 21:05:56.828516 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1602/3227] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Apr 9 21:05:56 2022] POST /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 85 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:56.848353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4aafc14-451a-4fe9-afaf-d9cb2562f40d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] Calling method '.version_select at 0x7fb08e2711f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:56.857346 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7647018-77d5-4df5-ab0d-a70b11fb0720 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.078034 Apr 09 21:05:56.858816 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1626/3228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:56 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:56.905969 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4aafc14-451a-4fe9-afaf-d9cb2562f40d tempest-ImagesMetadataTestJSON-1743163879 tempest-ImagesMetadataTestJSON-1743163879-project] 10.222.0.30 "GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.070894 Apr 09 21:05:56.906988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1603/3229] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:05:56 2022] GET /compute/v2.1/images/e44e79bf-116a-40b0-a5e3-3134537dbf19/metadata => generated 85 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:05:56.941411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-32881d6f-9687-4578-8824-9440d2f3a2a9 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1874456190", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:56.944641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-32881d6f-9687-4578-8824-9440d2f3a2a9 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:56.945772 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-32881d6f-9687-4578-8824-9440d2f3a2a9 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008399 Apr 09 21:05:56.947317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1627/3230] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:56.961654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e264158-b64a-42d9-bdeb-f0001336adcd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:56.962497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e264158-b64a-42d9-bdeb-f0001336adcd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 74b6a142-517d-4613-b5a4-f2da444db825] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:56.970549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0e264158-b64a-42d9-bdeb-f0001336adcd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] HTTP exception thrown: Instance 74b6a142-517d-4613-b5a4-f2da444db825 could not be found. Apr 09 21:05:56.971696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e264158-b64a-42d9-bdeb-f0001336adcd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 404 to user: Instance 74b6a142-517d-4613-b5a4-f2da444db825 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:56.972808 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e264158-b64a-42d9-bdeb-f0001336adcd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/74b6a142-517d-4613-b5a4-f2da444db825/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016821 Apr 09 21:05:56.974118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1604/3231] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:05:56 2022] GET /compute/v2.1/servers/74b6a142-517d-4613-b5a4-f2da444db825/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:57.038408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36f1906e-a385-4489-b87f-a0ca4625b6fd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1088681067", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:57.040162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36f1906e-a385-4489-b87f-a0ca4625b6fd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:57.041248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-36f1906e-a385-4489-b87f-a0ca4625b6fd tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.008261 Apr 09 21:05:57.042341 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1628/3232] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:05:57.094751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b11ffd8a-e9a7-4584-920b-443fd5243555 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1138520093", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:57.096275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b11ffd8a-e9a7-4584-920b-443fd5243555 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:57.097149 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b11ffd8a-e9a7-4584-920b-443fd5243555 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006442 Apr 09 21:05:57.097863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1605/3233] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:05:57.157078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fcd65add-ccc7-48c1-9b5e-9fcf8d8a4627 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1415196169", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:57.158686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fcd65add-ccc7-48c1-9b5e-9fcf8d8a4627 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:57.159504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fcd65add-ccc7-48c1-9b5e-9fcf8d8a4627 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006983 Apr 09 21:05:57.160286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1629/3234] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:05:57 2022] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Apr 09 21:05:57.219136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55d25e5d-990b-4afc-9dd7-5495536a8bfa tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-194708938", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0bf24866-60b3-4101-b866-75be687eaa36"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:57.223074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:57.223708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:57.226458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55d25e5d-990b-4afc-9dd7-5495536a8bfa tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:57.227299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-55d25e5d-990b-4afc-9dd7-5495536a8bfa tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017142 Apr 09 21:05:57.228027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1630/3235] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Apr 9 21:05:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 09 21:05:57.242824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.245806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:57.246422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:57.247993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.249085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.250054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.263445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.264520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.265578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.267241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.596719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:57.604363 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72318a08-5e20-48a5-b0ea-54e186fa6bab tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.368725 Apr 09 21:05:57.604924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1631/3236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:57 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:57.627304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2560246-df81-4007-bc4a-d399899eb892 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:57.631132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d2560246-df81-4007-bc4a-d399899eb892 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 1d4b9d64-c8cc-406b-8219-23a5c8052421] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:57.645354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:57.661025 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ac686ee-7c53-4db0-8a6b-869d3a954f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.453001 Apr 09 21:05:57.661639 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1606/3237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:57 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:57.663411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d2560246-df81-4007-bc4a-d399899eb892 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] HTTP exception thrown: Instance 1d4b9d64-c8cc-406b-8219-23a5c8052421 could not be found. Apr 09 21:05:57.667355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2560246-df81-4007-bc4a-d399899eb892 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 404 to user: Instance 1d4b9d64-c8cc-406b-8219-23a5c8052421 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:05:57.669241 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2560246-df81-4007-bc4a-d399899eb892 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/1d4b9d64-c8cc-406b-8219-23a5c8052421/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.049977 Apr 09 21:05:57.673782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1632/3238] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Apr 9 21:05:57 2022] GET /compute/v2.1/servers/1d4b9d64-c8cc-406b-8219-23a5c8052421/metadata/test2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:05:57.693960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:57.695442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:57.696016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:57.698211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:57.709636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.710816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.713377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.713991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.716237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.719348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.721534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:57.723530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:57.778181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:05:57.930253 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8eb8738-db3e-4b63-9a57-a236651a0a3a tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 204 len: 0 microversion: 2.1 time: 0.243593 Apr 09 21:05:57.932473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1633/3239] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:05:57 2022] DELETE /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:05:57.967056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f13e0bfe-36e1-4ead-8cd6-27743832c678 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23f940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:58.055880 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f13e0bfe-36e1-4ead-8cd6-27743832c678 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.120588 Apr 09 21:05:58.056633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1634/3240] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:57 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:58.071641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:58.072512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:58.080159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.082061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.083076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.083782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.207245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:58.218470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba00c284-3250-46ca-a9fb-19f0e47ac4e3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1491 microversion: 2.1 time: 0.546226 Apr 09 21:05:58.221787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1607/3241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:57 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1491 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:58.406576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:58.425819 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9350c855-dc52-4061-9b69-54bf0d55dd14 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1524 microversion: 2.1 time: 0.367742 Apr 09 21:05:58.426934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1635/3242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:58 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1524 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:58.441795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-27fb3605-5566-4236-8281-1522d2ec03ee req-e2757689-59f4-423c-abaa-aa705574ca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4064abe2-3845-4a26-b84f-225c78721845", "name": "network-vif-plugged", "status": "completed", "tag": "8286fc01-3389-4ec0-9d0a-d4698c966afc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:58.460463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Action: 'create', calling method: .version_select at 0x7fb08ec5a1f0>, body: {"keypair": {"name": "tempest-keypair-769702859"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:58.468548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-27fb3605-5566-4236-8281-1522d2ec03ee req-e2757689-59f4-423c-abaa-aa705574ca6a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.469251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-27fb3605-5566-4236-8281-1522d2ec03ee req-e2757689-59f4-423c-abaa-aa705574ca6a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.475985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for project b4603cd745c848eba3a1645f624e590e. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:58.483162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for user 0f54a88615644f5da8173e9bade66599 and project b4603cd745c848eba3a1645f624e590e. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:58.492981 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-27fb3605-5566-4236-8281-1522d2ec03ee req-e2757689-59f4-423c-abaa-aa705574ca6a service nova] Creating event network-vif-plugged:8286fc01-3389-4ec0-9d0a-d4698c966afc for instance 4064abe2-3845-4a26-b84f-225c78721845 on nch2-master-1 Apr 09 21:05:58.507008 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-27fb3605-5566-4236-8281-1522d2ec03ee req-e2757689-59f4-423c-abaa-aa705574ca6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078894 Apr 09 21:05:58.508318 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1636/3243] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:58.622459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:58.623401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:58.630068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.631026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.632066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.632724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.836067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for project b4603cd745c848eba3a1645f624e590e. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:05:58.842402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for user 0f54a88615644f5da8173e9bade66599 and project b4603cd745c848eba3a1645f624e590e. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:05:58.861815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0327f21-1c51-4685-98ec-10d0a9a1d81d tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.602731 Apr 09 21:05:58.862997 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1608/3244] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:05:58 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:05:58.868557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:58.869463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:58.877331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.877978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:58.879100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:58.879705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:59.161314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:59.174096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95cbfeba-e3ad-4991-891a-22edb46e6c86 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.556054 Apr 09 21:05:59.186227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1637/3245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:58 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:59.199622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3976802a-3479-471e-bbb5-203a764d8b6b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23fd30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:59.275214 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3976802a-3479-471e-bbb5-203a764d8b6b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.087185 Apr 09 21:05:59.276054 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1638/3246] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:05:59 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:59.288019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:59.288844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:59.302415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:59.303110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:59.315022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:59.317942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:59.420668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:59.431161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ffd9de71-975e-46b3-a23c-a04260f1fadb tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1308 microversion: 2.1 time: 0.566904 Apr 09 21:05:59.457456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1609/3247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:58 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:59.496705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-31304b53-ee65-4cac-a861-ba2d8f9d71ab req-50522016-016d-4f21-a57f-5299794e13c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f547d94a-a0fa-49d6-8a26-369b8f5a1c59", "name": "network-vif-deleted", "tag": "43f0ad35-e33b-4e7f-859c-ad2d7fe472ea"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:05:59.540071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-31304b53-ee65-4cac-a861-ba2d8f9d71ab req-50522016-016d-4f21-a57f-5299794e13c2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:59.541174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-31304b53-ee65-4cac-a861-ba2d8f9d71ab req-50522016-016d-4f21-a57f-5299794e13c2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:59.561002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:05:59.566731 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-31304b53-ee65-4cac-a861-ba2d8f9d71ab req-50522016-016d-4f21-a57f-5299794e13c2 service nova] Creating event network-vif-deleted:43f0ad35-e33b-4e7f-859c-ad2d7fe472ea for instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 on nch2-master-1 Apr 09 21:05:59.572577 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2caeb030-2948-4620-9abb-4fee46f8615f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 200 len: 1449 microversion: 2.1 time: 0.294850 Apr 09 21:05:59.574122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1639/3248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:59 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 1449 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:05:59.580809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-31304b53-ee65-4cac-a861-ba2d8f9d71ab req-50522016-016d-4f21-a57f-5299794e13c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117319 Apr 09 21:05:59.584459 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1610/3249] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:05:59.588921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:05:59.590593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:05:59.607834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:59.611566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:05:59.612678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:05:59.613357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:00.015503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:00.029903 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-354ae436-7659-451c-a4e5-2567e23bf5cc tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1524 microversion: 2.1 time: 0.453120 Apr 09 21:06:00.030510 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1640/3250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:05:59 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1524 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:00.192404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:00.193416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:00.212330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:00.213147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:00.214108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:00.215062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:00.289815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8911277-f21c-42e3-9b12-6ad4b48561b7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23f1f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:00.361675 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8911277-f21c-42e3-9b12-6ad4b48561b7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.076161 Apr 09 21:06:00.362286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1641/3251] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:00 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:00.457208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:00.457851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:00.489350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:00.489817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:00.500002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:00.500800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.131435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:01.145453 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a14174a-e30f-4dad-a36f-0d1db9ee9912 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1489 microversion: 2.1 time: 0.698226 Apr 09 21:06:01.150143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1642/3252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:00 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1489 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:01.160131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:01.160765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:01.185184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.185940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.186670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.187121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.197370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:01.208838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d648cac4-9486-44f3-9493-c5afbbdc87d5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 1.020539 Apr 09 21:06:01.211610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1611/3253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:00 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:01.222555 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. Apr 09 21:06:01.223098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:01.226004 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-090faff8-3e33-4e07-ae76-00fa28627596 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 404 len: 111 microversion: 2.1 time: 0.073070 Apr 09 21:06:01.233717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1643/3254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:01 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:01.244874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:01.254705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:01.281493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.283398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.286121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.286563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.420835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbe95b5a-2816-4963-813d-8aa14d69bf33 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Calling method '.version_select at 0x7fb08ee9bee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:01.460832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cbe95b5a-2816-4963-813d-8aa14d69bf33 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:01.461481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbe95b5a-2816-4963-813d-8aa14d69bf33 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:01.462404 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbe95b5a-2816-4963-813d-8aa14d69bf33 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "DELETE /compute/v2.1/images/2bcbdc72-e71c-42dc-ba1a-2cdc753dbf17/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.249510 Apr 09 21:06:01.463423 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1612/3255] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:06:01 2022] DELETE /compute/v2.1/images/2bcbdc72-e71c-42dc-ba1a-2cdc753dbf17/metadata/os_distro => generated 62 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:01.489919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:01.491376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:01.517128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.518214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.519255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:01.519897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:01.610130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b45ff3203a45609c6a2a57b3004dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f502d4df1e734e299d496111206e0bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:01.622084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d6fca93-3ef5-4039-a8bd-bc94fbf9a96d tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 200 len: 1524 microversion: 2.1 time: 0.390974 Apr 09 21:06:01.622765 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1644/3256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:01 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:01.630451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93bbfe62-8db8-4d73-8002-073d0f6f819d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "PUT /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1084 microversion: 2.1 time: 0.160128 Apr 09 21:06:01.631381 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1613/3257] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:06:01 2022] PUT /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1084 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:01.651367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c0cb36e-210e-4457-a615-bf4497452548 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e23f3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:01.658980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1040751375", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:01.793392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:01.799137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c0cb36e-210e-4457-a615-bf4497452548 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.160773 Apr 09 21:06:01.800851 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1645/3258] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:01 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:01.837064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e7f00d7-4dee-4c86-9309-fa56963e8551 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Calling method '.version_select at 0x7fb08e24f790>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:02.001182 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0e7f00d7-4dee-4c86-9309-fa56963e8551 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:02.001800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e7f00d7-4dee-4c86-9309-fa56963e8551 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:02.002656 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e7f00d7-4dee-4c86-9309-fa56963e8551 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "GET /compute/v2.1/images/37895758-7c46-4c6c-8e58-d749cd724e01/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.184657 Apr 09 21:06:02.003756 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1646/3259] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:06:01 2022] GET /compute/v2.1/images/37895758-7c46-4c6c-8e58-d749cd724e01/metadata/os_version => generated 62 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:02.010856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:02.011490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:02.029395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.030818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.035088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.035989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.325302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:02.340573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf83f1f0-ca89-494c-86cd-e55f6933954a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1510 microversion: 2.1 time: 0.334870 Apr 09 21:06:02.340871 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1647/3260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:02 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:02.350397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3f2a03d3-286c-4d9b-8dcf-0e403560b8ac req-c6452187-a1b3-4585-a6cc-7c3383fc4e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9b17d2-4843-4ccd-99cb-202ac14e17bc", "name": "network-vif-deleted", "tag": "95e85505-89f4-484e-85ba-776f685b7c44"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:02.369730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3f2a03d3-286c-4d9b-8dcf-0e403560b8ac req-c6452187-a1b3-4585-a6cc-7c3383fc4e2d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.371910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3f2a03d3-286c-4d9b-8dcf-0e403560b8ac req-c6452187-a1b3-4585-a6cc-7c3383fc4e2d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.400784 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3f2a03d3-286c-4d9b-8dcf-0e403560b8ac req-c6452187-a1b3-4585-a6cc-7c3383fc4e2d service nova] Creating event network-vif-deleted:95e85505-89f4-484e-85ba-776f685b7c44 for instance 0b9b17d2-4843-4ccd-99cb-202ac14e17bc on nch1-master-1 Apr 09 21:06:02.423547 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3f2a03d3-286c-4d9b-8dcf-0e403560b8ac req-c6452187-a1b3-4585-a6cc-7c3383fc4e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080019 Apr 09 21:06:02.424353 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1648/3261] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:02.436853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84d02af9-3335-4783-92b6-a5925a1bd615 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Calling method '.version_select at 0x7fb08e1d6820>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:02.494584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-84d02af9-3335-4783-92b6-a5925a1bd615 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:02.497070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84d02af9-3335-4783-92b6-a5925a1bd615 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:02.498356 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-84d02af9-3335-4783-92b6-a5925a1bd615 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "GET /compute/v2.1/images/ab39437e-e269-4255-a827-c0bcb1df17f8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072909 Apr 09 21:06:02.499401 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1649/3262] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Apr 9 21:06:02 2022] GET /compute/v2.1/images/ab39437e-e269-4255-a827-c0bcb1df17f8/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:02.507627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:02.508550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:02.521796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.522506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.523451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.524041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.772198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:02.775817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:02.776528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:02.777620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:02.778226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:02.779030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:02.783595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-74128f36-8983-4cb4-a68e-e33dc2bfed89 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.282632 Apr 09 21:06:02.787113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1650/3263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:02 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:02.795525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:02.799991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:02.803805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.807171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.808262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.809228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.822327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.823025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.826547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:02.827030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:02.834291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:02.841826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:02.859077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:02.861815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:02.976225 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5bfa5d0-e546-4b81-ae14-93f12dc33018 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333311 Apr 09 21:06:02.978327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1614/3264] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:02.987424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b394ca5c-0198-4c16-9217-964e8786fa0a tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Action: 'update_all', calling method: .version_select at 0x7fb08ee38d30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:03.056529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:03.058395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b394ca5c-0198-4c16-9217-964e8786fa0a tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:03.059012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b394ca5c-0198-4c16-9217-964e8786fa0a tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:03.060577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b394ca5c-0198-4c16-9217-964e8786fa0a tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "PUT /compute/v2.1/images/753d543c-98b0-42f7-b531-3a5987b8e173/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081155 Apr 09 21:06:03.061184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1615/3265] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:06:02 2022] PUT /compute/v2.1/images/753d543c-98b0-42f7-b531-3a5987b8e173/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:03.068750 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3184b8d-538d-4da1-b09d-e9aff4ec4a22 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1510 microversion: 2.1 time: 0.280060 Apr 09 21:06:03.069842 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1651/3266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:02 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:03.071968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.072591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] [instance: 0b9b17d2-4843-4ccd-99cb-202ac14e17bc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:03.074800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4b4fdc3-ca88-4f47-b38b-26706eb83375 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1d6b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.093743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.094197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.094988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.095426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.131827 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] HTTP exception thrown: Instance 0b9b17d2-4843-4ccd-99cb-202ac14e17bc could not be found. Apr 09 21:06:03.133608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] Returning 404 to user: Instance 0b9b17d2-4843-4ccd-99cb-202ac14e17bc could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:03.136161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-13338150-9496-4aa6-9e14-1d69d0ecef92 tempest-ServerMetadataNegativeTestJSON-661981176 tempest-ServerMetadataNegativeTestJSON-661981176-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc" status: 404 len: 111 microversion: 2.1 time: 0.068293 Apr 09 21:06:03.137499 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1616/3267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/servers/0b9b17d2-4843-4ccd-99cb-202ac14e17bc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:03.174025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ba9eb2b-fae1-4755-8931-f6b4396b3fe0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.174915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ba9eb2b-fae1-4755-8931-f6b4396b3fe0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:03.184456 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4b4fdc3-ca88-4f47-b38b-26706eb83375 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.113354 Apr 09 21:06:03.192755 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1652/3268] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:03.200684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd4fc171-7101-4bc1-a507-9d0d60218dc2 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Action: 'update', calling method: .version_select at 0x7fb08e23f5e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:03.242887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cd4fc171-7101-4bc1-a507-9d0d60218dc2 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:03.243492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd4fc171-7101-4bc1-a507-9d0d60218dc2 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:03.245140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd4fc171-7101-4bc1-a507-9d0d60218dc2 tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "PUT /compute/v2.1/images/551ee195-723c-48ef-bb58-066da9a811e3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055774 Apr 09 21:06:03.246694 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1653/3269] 10.222.0.30 () {60 vars in 1309 bytes} [Sat Apr 9 21:06:03 2022] PUT /compute/v2.1/images/551ee195-723c-48ef-bb58-066da9a811e3/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:03.257780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.258367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:03.273963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.278247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.279893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.280347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.343519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:03.353784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0ba9eb2b-fae1-4755-8931-f6b4396b3fe0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:03.360916 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ba9eb2b-fae1-4755-8931-f6b4396b3fe0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1215 microversion: 2.1 time: 0.222153 Apr 09 21:06:03.366897 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1617/3270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:03.384110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0718c8ef-742c-4457-91e9-4741f189ebec tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Action: 'create', calling method: .version_select at 0x7fb08ec5a8b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:03.435839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0718c8ef-742c-4457-91e9-4741f189ebec tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] HTTP exception thrown: Image not found. Apr 09 21:06:03.436701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0718c8ef-742c-4457-91e9-4741f189ebec tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] Returning 404 to user: Image not found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:03.437751 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0718c8ef-742c-4457-91e9-4741f189ebec tempest-ImagesMetadataNegativeTestJSON-503507109 tempest-ImagesMetadataNegativeTestJSON-503507109-project] 10.222.0.30 "POST /compute/v2.1/images/7d485ace-0b88-4b77-bdac-b063b02bc095/metadata" status: 404 len: 62 microversion: 2.1 time: 0.067258 Apr 09 21:06:03.438777 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1618/3271] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Apr 9 21:06:03 2022] POST /compute/v2.1/images/7d485ace-0b88-4b77-bdac-b063b02bc095/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:06:03.597462 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec01f6e9-114e-4b51-979d-e96644555719 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 204 len: 0 microversion: 2.1 time: 0.349628 Apr 09 21:06:03.598349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1654/3272] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:03 2022] DELETE /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:03.614957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.616176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:03.632158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.634481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.639910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.642698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.708268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.711854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:03.712622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Searching by: {'deleted': False, 'project_id': '48b917a437e7432bbfc884a1067fdfaa'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:06:03.737819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.738288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.739137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.739578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.820827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:06:03.910712 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f0829ea-1f5a-4814-be0b-f34ae61cf188 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.208105 Apr 09 21:06:03.927425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1655/3273] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/servers => generated 334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:03.937478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:03.938222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:03.954786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.955489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:03.956460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:03.961618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.080240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:04.093421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93837cc4-b0e5-4b09-9509-4cba421d67bd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1516 microversion: 2.1 time: 0.485928 Apr 09 21:06:04.103695 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1619/3274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1516 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:04.109373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:04.117602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:04.118830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Searching by: {'deleted': False, 'project_id': '48b917a437e7432bbfc884a1067fdfaa'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:06:04.132990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:04.133901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.134895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:04.135495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.200898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:06:04.371824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:04.376395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:04.382308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b21fa117-7ed3-4109-b759-334c37afa829 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.453717 Apr 09 21:06:04.383249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1656/3275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:03 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:04.384990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:04.385505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.404426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b4e34fc-5c8d-474b-bd02-d74dee6f882e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e220d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:04.496986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b4e34fc-5c8d-474b-bd02-d74dee6f882e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.111637 Apr 09 21:06:04.497558 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1657/3276] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:04 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:04.511570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:04.513136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:04.520280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:04.520963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.521996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:04.522591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:04.689913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:04.705457 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-447fa651-30bc-47ff-99b5-5c950e94ce8b tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.600069 Apr 09 21:06:04.706334 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1620/3277] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:06:04 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:04.731246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d455b034-0329-4cbc-826c-3be42fd05837 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1267 microversion: 2.1 time: 0.231648 Apr 09 21:06:04.733629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21c5f20c-b2cf-42b9-a6f6-7a4a9689fd2f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:04.748209 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1658/3278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:04 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:04.748534 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21c5f20c-b2cf-42b9-a6f6-7a4a9689fd2f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015971 Apr 09 21:06:04.751259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1621/3279] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:06:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:05.111791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:05.113027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:05.132547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.132958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.134815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.136444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.185020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:05.185675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:05.199748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.206445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.207116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.209025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.318717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:05.573890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8adeb81-23e4-49d7-967e-5b121fcfb70f tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "DELETE /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 204 len: 0 microversion: 2.1 time: 0.366296 Apr 09 21:06:05.575998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1622/3280] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:05 2022] DELETE /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:05.596760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:05.597809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:05.607295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.607891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.608888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:05.609941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:05.915944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:05.923699 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95993f9a-1c73-434e-a378-b449068605a3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1516 microversion: 2.1 time: 0.817684 Apr 09 21:06:05.930750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1659/3281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:05 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1516 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:05.935650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-32439eae-3812-4bca-8341-bb5118f5d1f4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1d9940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:06.006580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-32439eae-3812-4bca-8341-bb5118f5d1f4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.074680 Apr 09 21:06:06.007492 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1660/3282] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:05 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:06.012234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:06.013109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:06.024723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.029885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:06.031099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.031747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:06.349729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:06.383925 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6b55cf0-23a4-45d5-bd52-d5f975081ad0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.805354 Apr 09 21:06:06.386858 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1623/3283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:05 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:06.392749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:06.412249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:06.427306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:06.431233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.432864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:06.433904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.442276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:06.458790 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e0aea3f-3343-40b7-8b31-bbe0d6c05e39 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1700 microversion: 2.1 time: 0.448160 Apr 09 21:06:06.469541 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1661/3284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:06 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1700 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:06.488246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-712032154", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b5e7dd12-c055-4f23-9dbd-e9c65e743202"}], "security_groups": [{"name": "tempest-securitygroup--388510496"}], "key_name": "tempest-keypair-769702859", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:06.798717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:06.815306 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56a1bdd2-30c2-4be1-a14b-dc4df67f7b0c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1273 microversion: 2.1 time: 0.426994 Apr 09 21:06:06.825862 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1624/3285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:06 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1273 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:06.946916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:06.947750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:06.972574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.973080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:06.973891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:06.974343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:07.197219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] validate_networks() for [('b5e7dd12-c055-4f23-9dbd-e9c65e743202', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:07.480490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:07.494406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdd27a24-fea0-4a69-b11c-348cb5253a10 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 200 len: 1474 microversion: 2.1 time: 0.558357 Apr 09 21:06:07.495843 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1625/3286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:06 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:07.517464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c7e5f45-16a2-4e72-a456-b4dea9491d01 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed84700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:07.616499 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c7e5f45-16a2-4e72-a456-b4dea9491d01 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.119183 Apr 09 21:06:07.619151 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1626/3287] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:07 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:07.968503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1292268283", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:08.096578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] validate_networks() for None {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:08.917319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:08.918413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:08.919327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:08.919887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:08.920441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:08.938732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:08.939747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:08.940839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:08.943106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:08.993115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Getting quotas for project c8db9d188edc4c1fb6fb85e81e8dba79. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:09.005595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Getting quotas for user 4bc27b3989d24806b90e581b5f605288 and project c8db9d188edc4c1fb6fb85e81e8dba79. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:09.037122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:09.039638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:09.143774 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90cf676d-c8f3-41cf-a14c-e4cb9d6e24b6 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518298 Apr 09 21:06:09.144885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1627/3288] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:09.157959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:09.159934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:09.176107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for project b4603cd745c848eba3a1645f624e590e. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:09.194319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for user 0f54a88615644f5da8173e9bade66599 and project b4603cd745c848eba3a1645f624e590e. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:09.195765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.201882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.205805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.206509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.224862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:09.225297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:09.231881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:09.232625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:09.233354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:09.242943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.243487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.244525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.247926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.292222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for project b4603cd745c848eba3a1645f624e590e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:09.304903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Getting quotas for user 0f54a88615644f5da8173e9bade66599 and project b4603cd745c848eba3a1645f624e590e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:09.416336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:09.418531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15',volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:09.645251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.174332 Apr 09 21:06:09.651920 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1662/3289] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:09.662332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:09.663965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:09.670863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.671418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.672258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:09.672749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:09.985777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb1a0d6db7847aa851d3f8244c998c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b917a437e7432bbfc884a1067fdfaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:09.997077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11a44217-75d3-42ae-84e6-ee68d1c4f315 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 200 len: 1632 microversion: 2.1 time: 0.342163 Apr 09 21:06:09.997699 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1663/3290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:09 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 1632 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.008104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-da90172c-d805-44c8-8399-1755384b1b3f req-aa4d4069-50be-42b2-8534-0077ab55b1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4064abe2-3845-4a26-b84f-225c78721845", "name": "network-vif-deleted", "tag": "8286fc01-3389-4ec0-9d0a-d4698c966afc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:10.029901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-da90172c-d805-44c8-8399-1755384b1b3f req-aa4d4069-50be-42b2-8534-0077ab55b1fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.030702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-da90172c-d805-44c8-8399-1755384b1b3f req-aa4d4069-50be-42b2-8534-0077ab55b1fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.046627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-da90172c-d805-44c8-8399-1755384b1b3f req-aa4d4069-50be-42b2-8534-0077ab55b1fb service nova] Creating event network-vif-deleted:8286fc01-3389-4ec0-9d0a-d4698c966afc for instance 4064abe2-3845-4a26-b84f-225c78721845 on nch2-master-1 Apr 09 21:06:10.063593 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-da90172c-d805-44c8-8399-1755384b1b3f req-aa4d4069-50be-42b2-8534-0077ab55b1fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059183 Apr 09 21:06:10.064215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1664/3291] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:10.073113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:10.073823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:10.091304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.092016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.092971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.093612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.332952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:10.345993 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7b0de04-0d51-446c-a1e3-84d2348781bd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 1.199409 Apr 09 21:06:10.347471 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1628/3292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:09 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.353314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:10.354172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:10.361972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.362750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.363579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.371863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.387773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. Apr 09 21:06:10.388549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:10.389633 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-996f0ec0-4c19-4a13-9985-2e37bb46e5cc tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 404 len: 111 microversion: 2.1 time: 0.040657 Apr 09 21:06:10.393824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1629/3293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:10 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:10.395884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:10.399481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd65abdb-7a76-44d2-a4c4-92f8dbb6c8df tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef818b0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:10.412219 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17707dbc-63d2-450b-ac20-df88f846a16d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.345984 Apr 09 21:06:10.413990 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1665/3294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:10 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.422939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:10.423736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:10.438966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.441971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.446528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.447235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.544601 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd65abdb-7a76-44d2-a4c4-92f8dbb6c8df tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.142244 Apr 09 21:06:10.545626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1630/3295] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:10 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.624477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:10.633260 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85123e4c-97a5-4a1c-8be8-cabcb219dc0c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1268 microversion: 2.1 time: 0.217333 Apr 09 21:06:10.633864 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1666/3296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:10 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.654951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:10.655709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:10.657470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561598500", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:10.672977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.673648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.674284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:10.674789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:10.755078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] validate_networks() for [('ad62b125-1df7-49ad-953e-ad87b77a57c1', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:10.846958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:10.857910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97aa62b9-4f7c-48a9-ac13-de83f7a47138 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1170 microversion: 2.1 time: 0.210930 Apr 09 21:06:10.868838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1667/3297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:10 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1170 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:10.880600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1262650745", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cdd9fe53-654b-4110-9856-85e40c331c54"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:10.972327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] validate_networks() for [('cdd9fe53-654b-4110-9856-85e40c331c54', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:12.639796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:12.640347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:12.640680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:12.641270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:12.641695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:12.654680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.655066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:12.655887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.656316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:12.713230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Getting quotas for project 3e27519c6c114724bf36126f0362a7c0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:12.742547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Getting quotas for user cdab30a578b947068144a0509c85eb0c and project 3e27519c6c114724bf36126f0362a7c0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:12.765249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:12.769892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:12.838841 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4775c8fb-a761-45a6-9bd7-f4d868f8a552 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290464 Apr 09 21:06:12.840967 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1631/3298] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:12.846643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:12.848433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] [instance: 87b96091-3ee1-49bb-95e2-f896acbdc4f3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:12.856942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.858390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:12.859463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.860435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:12.888048 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] HTTP exception thrown: Instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 could not be found. Apr 09 21:06:12.888714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Returning 404 to user: Instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:12.889996 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3bef8507-ec76-4029-8edc-7b6ecaf92e80 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3" status: 404 len: 111 microversion: 2.1 time: 0.047681 Apr 09 21:06:12.894633 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1632/3299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:12 2022] GET /compute/v2.1/servers/87b96091-3ee1-49bb-95e2-f896acbdc4f3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:12.919614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:12.922390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:12.936711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.937528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:12.938595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:12.939712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:13.450869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:13.451890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:13.452588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:13.453228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:13.453851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:13.471646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:13.472263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:13.475871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:13.477665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:13.539146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:13.546049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Getting quotas for user 121a5a2fcd9f4420885f2a78c1dfc339 and project f87849ca88bb4519b329fab033911446. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:13.562586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:13.565353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:13.652809 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-120754a4-d2ba-4730-b067-97b155e7fadf tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.779819 Apr 09 21:06:13.662844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1668/3300] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:13.679254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:13.700846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:13.736528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:13.737275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:13.738340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:13.739358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.021839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:14.037590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03c38db5-a39d-4075-9310-4e839ddfca4b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 1.141528 Apr 09 21:06:14.040794 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1633/3301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:12 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.052838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff0dd603-a3d8-4caf-8f78-08e1cd23be9a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee5cc10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.146483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff0dd603-a3d8-4caf-8f78-08e1cd23be9a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.103586 Apr 09 21:06:14.148191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1634/3302] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:14 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.170318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.173457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:14.228726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:14.243921 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2f4ebdb-ffe9-4494-81f4-6c160dac5497 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.576834 Apr 09 21:06:14.244698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.245556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.254455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1669/3303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:13 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.262097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.262260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.266113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.268128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:14.282180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.282896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.285974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.286963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.558317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:14.577076 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-213015ff-2929-4d48-a75c-327cc8844101 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1274 microversion: 2.1 time: 0.424050 Apr 09 21:06:14.579863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1635/3304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:14 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1274 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.591568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2ac2d37b-5b5b-43d0-b41d-c9e6d6b59242 req-5ed2fbe8-43ac-4d73-ae74-d4ccf5514541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b96091-3ee1-49bb-95e2-f896acbdc4f3", "name": "network-vif-deleted", "tag": "5448d5cd-1f29-4f3e-b6f2-73917d7094c7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:14.613335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2ac2d37b-5b5b-43d0-b41d-c9e6d6b59242 req-5ed2fbe8-43ac-4d73-ae74-d4ccf5514541 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.614049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2ac2d37b-5b5b-43d0-b41d-c9e6d6b59242 req-5ed2fbe8-43ac-4d73-ae74-d4ccf5514541 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.644134 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2ac2d37b-5b5b-43d0-b41d-c9e6d6b59242 req-5ed2fbe8-43ac-4d73-ae74-d4ccf5514541 service nova] Creating event network-vif-deleted:5448d5cd-1f29-4f3e-b6f2-73917d7094c7 for instance 87b96091-3ee1-49bb-95e2-f896acbdc4f3 on nch1-master-1 Apr 09 21:06:14.681641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2ac2d37b-5b5b-43d0-b41d-c9e6d6b59242 req-5ed2fbe8-43ac-4d73-ae74-d4ccf5514541 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097521 Apr 09 21:06:14.683708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1636/3305] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:14.703808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.706271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:14.723585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.730184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.736160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.738624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.849117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:14.856888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf8904ab-2e41-4033-b0e7-73fc67d7927f tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.598627 Apr 09 21:06:14.857521 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1670/3306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:14 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.871141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14f2f9f5-74be-4ad1-8f60-91f92fd4f5c5 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] Calling method '.version_select at 0x7fb08e29e940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.881392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:14.898383 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5890286-2300-4359-bd07-980344c4a903 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1268 microversion: 2.1 time: 0.206594 Apr 09 21:06:14.899591 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1637/3307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:14 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:14.910230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:14.911050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:14.915806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14f2f9f5-74be-4ad1-8f60-91f92fd4f5c5 tempest-ServersTestJSON-1941715800 tempest-ServersTestJSON-1941715800-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983690248" status: 202 len: 0 microversion: 2.1 time: 0.048417 Apr 09 21:06:14.919778 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1671/3308] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983690248 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:14.943976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.946857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:14.947937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:14.950858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:15.043681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2ac86e24-9863-4680-bbfb-8fa3f1dde50b req-1cd91ede-0a23-4f30-8429-b976094b2ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65bd15c9-6492-4273-a5fc-12f183befa1c", "tag": "71880d13-76a1-445e-a3c8-e6054d854829"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:15.064408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2ac86e24-9863-4680-bbfb-8fa3f1dde50b req-1cd91ede-0a23-4f30-8429-b976094b2ae0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:15.066558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2ac86e24-9863-4680-bbfb-8fa3f1dde50b req-1cd91ede-0a23-4f30-8429-b976094b2ae0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:15.095818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2ac86e24-9863-4680-bbfb-8fa3f1dde50b req-1cd91ede-0a23-4f30-8429-b976094b2ae0 service nova] Creating event network-changed:71880d13-76a1-445e-a3c8-e6054d854829 for instance 65bd15c9-6492-4273-a5fc-12f183befa1c on nch2-master-1 Apr 09 21:06:15.103908 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2ac86e24-9863-4680-bbfb-8fa3f1dde50b req-1cd91ede-0a23-4f30-8429-b976094b2ae0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182827 Apr 09 21:06:15.106362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1672/3309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:15.122938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:15.124069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:15.134764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:15.136409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:15.141152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:15.142343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:15.143016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:15.152201 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c519a0b8-1875-4c98-a0f4-77120bd3c92a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1205 microversion: 2.1 time: 0.251135 Apr 09 21:06:15.157228 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1638/3310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:14 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1205 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:15.180425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d246f08d-5359-4878-ba84-2d176fa96ed2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08edc4040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:15.261994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d246f08d-5359-4878-ba84-2d176fa96ed2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.101043 Apr 09 21:06:15.263433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1639/3311] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:15 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:15.270045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:15.271175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:15.280807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:15.281940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:15.283684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:15.286081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.242311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:16.251600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6fcf6d00-6997-4aa3-93cf-c542a02fb417 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 1.143631 Apr 09 21:06:16.252123 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1673/3312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:15 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:16.265365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:16.265990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:16.277565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.278066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.278847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.279289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.398110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:16.407832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1149d3d-efd6-4853-a659-d87affd41411 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 1.142995 Apr 09 21:06:16.408875 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1640/3313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:15 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:16.425010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:16.425935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:16.436712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.437599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.439399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.440059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.843190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:16.856299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49bbe76e-5590-4163-9df4-8e56fe9c5d67 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.594727 Apr 09 21:06:16.856936 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1674/3314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:16 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:16.870896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:16.871540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:16.887763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.888664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.891098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.892220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.929720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:16.938408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a442afcb-15b0-4d2a-bc6b-1da917e3b842 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.517637 Apr 09 21:06:16.943346 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1641/3315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:16 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:16.961005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:16.964230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:16.978845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.980279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:16.983549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:16.984365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.103264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:17.123149 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b44361e6-dc7a-4007-84f7-4dea6e7b775f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1274 microversion: 2.1 time: 0.252324 Apr 09 21:06:17.124395 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1675/3316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:16 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:17.144279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d4729f7-3810-42cb-82d1-a65e48de2412 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1e3550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:17.163935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:17.182567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65bc5a79-ea02-48b7-87ba-23dfc141b373 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1267 microversion: 2.1 time: 0.229130 Apr 09 21:06:17.192979 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1642/3317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:16 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:17.205443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-07f6bf94-9176-45b6-b7eb-ece26576f7c0 req-bcb169d5-f361-4c60-aa1d-0068e4bbe439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276af9a8-cb98-49e4-b5f7-b53121790a25", "tag": "d3221b95-beb4-4b92-b232-c7521907646e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:17.225296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-07f6bf94-9176-45b6-b7eb-ece26576f7c0 req-bcb169d5-f361-4c60-aa1d-0068e4bbe439 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.225861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-07f6bf94-9176-45b6-b7eb-ece26576f7c0 req-bcb169d5-f361-4c60-aa1d-0068e4bbe439 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.249665 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-07f6bf94-9176-45b6-b7eb-ece26576f7c0 req-bcb169d5-f361-4c60-aa1d-0068e4bbe439 service nova] Creating event network-changed:d3221b95-beb4-4b92-b232-c7521907646e for instance 276af9a8-cb98-49e4-b5f7-b53121790a25 on nch1-master-1 Apr 09 21:06:17.255918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d4729f7-3810-42cb-82d1-a65e48de2412 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1454 microversion: 2.1 time: 0.121650 Apr 09 21:06:17.264698 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1676/3318] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:17 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:17.264901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-07f6bf94-9176-45b6-b7eb-ece26576f7c0 req-bcb169d5-f361-4c60-aa1d-0068e4bbe439 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070018 Apr 09 21:06:17.265373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1643/3319] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:17.290500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:17.291691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:17.302254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.306129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.307348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.309679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.426900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:17.428445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:17.441313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.451659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.455184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.457650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.803806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:17.811744 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0500d4f1-b8ec-449d-8231-9aab59028478 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.544971 Apr 09 21:06:17.812612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1644/3320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:17 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:17.876616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:17.878108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:17.888906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.890288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:17.892439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:17.893728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.081532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:18.090588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3124e22-5f46-4853-8428-f457be93d8a5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.669899 Apr 09 21:06:18.099946 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1677/3321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:17 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:18.105342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:18.105965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:18.112371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.113160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.114198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.114760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.535227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:18.543752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-654d3158-49b0-455b-abd8-e2b7f56cabec tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.673835 Apr 09 21:06:18.544767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1645/3322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:17 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:18.551493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:18.553262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:18.561536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.562121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.563039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.563726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.696745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:18.711768 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f933658-0c8e-4155-b91f-3949ad7afa07 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.610361 Apr 09 21:06:18.712689 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1678/3323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:18 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:18.724913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:18.725568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:18.746273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.746765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:18.747559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:18.748045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:19.693100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:19.732091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee260912-fbdc-4ff3-b5d3-cf2175355f54 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 1.182072 Apr 09 21:06:19.736314 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1646/3324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:18 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:19.747552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9289e902-ea55-412b-9068-d1a42fb9c06b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08edc4af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:19.785842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:19.808566 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a30a34d-0278-4010-9da1-c9e095ae8e83 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 1.093646 Apr 09 21:06:19.820187 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1679/3325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:18 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:19.827558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:19.831154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:19.835536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9289e902-ea55-412b-9068-d1a42fb9c06b tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1463 microversion: 2.1 time: 0.097782 Apr 09 21:06:19.836921 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1647/3326] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:19 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1463 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:19.845202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:19.846422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:19.847497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:19.847950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:19.853485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:19.854119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:19.862753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:19.863470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:19.864413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:19.864997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:20.370604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:20.399420 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6878d817-7004-4683-a03d-f1b04a9f9d78 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.547518 Apr 09 21:06:20.400856 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1648/3327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:19 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:20.409597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:20.414173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:20.448093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:20.449520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:20.451222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:20.451789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:20.482042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:20.492822 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec1e852f-3466-4925-a329-a32c8d952e5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1513 microversion: 2.1 time: 0.671137 Apr 09 21:06:20.494403 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1680/3328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:19 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1513 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:20.499226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6acbe16d-254f-4130-a2c1-f2417417d787 req-27195080-60e0-4b6a-b0d2-ddb93b7470fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af9a8-cb98-49e4-b5f7-b53121790a25", "name": "network-vif-plugged", "status": "completed", "tag": "d3221b95-beb4-4b92-b232-c7521907646e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:20.514424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6acbe16d-254f-4130-a2c1-f2417417d787 req-27195080-60e0-4b6a-b0d2-ddb93b7470fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:20.519336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6acbe16d-254f-4130-a2c1-f2417417d787 req-27195080-60e0-4b6a-b0d2-ddb93b7470fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:20.532665 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6acbe16d-254f-4130-a2c1-f2417417d787 req-27195080-60e0-4b6a-b0d2-ddb93b7470fb service nova] Creating event network-vif-plugged:d3221b95-beb4-4b92-b232-c7521907646e for instance 276af9a8-cb98-49e4-b5f7-b53121790a25 on nch1-master-1 Apr 09 21:06:20.538173 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6acbe16d-254f-4130-a2c1-f2417417d787 req-27195080-60e0-4b6a-b0d2-ddb93b7470fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042419 Apr 09 21:06:20.539016 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1681/3329] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:20.546360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:20.547556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:20.558474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:20.559880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:20.560847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:20.561965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.066249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:21.075036 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed4826a9-d47a-4ce4-b2ca-6e60f4aacb92 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.672679 Apr 09 21:06:21.075733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1649/3330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:20 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:21.083204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95e77007-62e0-4b84-9448-9f97690bc6be tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee453a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:21.132040 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95e77007-62e0-4b84-9448-9f97690bc6be tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 200 len: 1463 microversion: 2.1 time: 0.053646 Apr 09 21:06:21.132706 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1650/3331] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:21 2022] GET /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:21.137745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8f1b5457-aaee-4304-b7d8-a15003880615 req-8522243f-bee5-4960-ac57-f7f3483858b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0f03ed-0631-4764-ad2b-f9982421cce5", "tag": "9ad8016c-e56d-42b1-a21b-8f530a861360"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:21.151009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8f1b5457-aaee-4304-b7d8-a15003880615 req-8522243f-bee5-4960-ac57-f7f3483858b4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.152033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:21.152593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8f1b5457-aaee-4304-b7d8-a15003880615 req-8522243f-bee5-4960-ac57-f7f3483858b4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.165630 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d9beee9-9ad5-4d5d-8d25-34ab5c2f9262 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.625147 Apr 09 21:06:21.166487 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1682/3332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:20 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:21.171043 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8f1b5457-aaee-4304-b7d8-a15003880615 req-8522243f-bee5-4960-ac57-f7f3483858b4 service nova] Creating event network-changed:9ad8016c-e56d-42b1-a21b-8f530a861360 for instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 on nch2-master-1 Apr 09 21:06:21.178254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:21.178984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:21.180170 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8f1b5457-aaee-4304-b7d8-a15003880615 req-8522243f-bee5-4960-ac57-f7f3483858b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045813 Apr 09 21:06:21.181371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1651/3333] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:21.188110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:21.188910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:21.204769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.205312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.205761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.206009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.207990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.208626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.214436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.214891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.613842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:21.624706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:21.627466 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9e5ebec-0c27-4322-8bda-c6307f415350 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.443604 Apr 09 21:06:21.628078 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1652/3334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:21 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:21.634305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:21.634995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:21.636320 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed8c62cf-e8cc-46d6-a435-62250aa40fc1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.466321 Apr 09 21:06:21.636923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1683/3335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:21.652741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.653089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.655231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:21.657535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:21.678952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.680680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.681171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.681629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:21.683257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:21.683804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.178290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:22.185346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:22.186312 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea3bbe18-f8d4-4c16-822c-f8d59b5a76fc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1467 microversion: 2.1 time: 0.556976 Apr 09 21:06:22.186907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1653/3336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:21 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1467 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.192288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.193630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:22.193910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c839423-bf25-4404-b489-b6bda61cc4b8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.555553 Apr 09 21:06:22.200901 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1684/3337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:21 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.201736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.202460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:22.207363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.207826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.208638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.208766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.209090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.209476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.210377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.210869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.584759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:22.607056 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-419dc5ff-d8ec-4f27-85e7-ee0422473096 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1519 microversion: 2.1 time: 0.418597 Apr 09 21:06:22.607730 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1654/3338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1519 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.615175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.616085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:22.623330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.623917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.624798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.625312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.631884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:22.646371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3719b424-7c93-4dd6-b513-0a3b74275aa9 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.448991 Apr 09 21:06:22.648319 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1685/3339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.655322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f3e2ae3-5063-4b47-be5b-83801c19f7b1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1e3550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.763050 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f3e2ae3-5063-4b47-be5b-83801c19f7b1 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-04-09T21%3A04%3A11Z" status: 200 len: 1902 microversion: 2.1 time: 0.112457 Apr 09 21:06:22.770941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1686/3340] 10.222.0.30 () {58 vars in 1198 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/images?changes-since=2022-04-09T21%3A04%3A11Z => generated 1902 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.775763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65bd15c9-6492-4273-a5fc-12f183befa1c", "name": "network-vif-plugged", "status": "completed", "tag": "71880d13-76a1-445e-a3c8-e6054d854829"}, {"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-unplugged", "status": "completed", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:22.780529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:22.788648 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-584c8603-afcd-414b-bd79-4ac8ca62f240 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.179312 Apr 09 21:06:22.789278 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1655/3341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:22.789773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.790290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.794478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.795260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:22.801590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.802054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.802848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.803292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.805078 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] Creating event network-vif-plugged:71880d13-76a1-445e-a3c8-e6054d854829 for instance 65bd15c9-6492-4273-a5fc-12f183befa1c on nch2-master-1 Apr 09 21:06:22.805580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] Creating event network-vif-unplugged:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:06:22.813638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5ba7b08d-435e-43a1-9816-c9355aee970d req-c234497b-566f-438f-af36-040b12e7312c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.041214 Apr 09 21:06:22.814331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1687/3342] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:22.819437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:22.820124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:22.826527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.826981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:22.828045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:22.828517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.003706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:23.008050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:23.012870 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf1838d3-d792-4839-8be0-72b6c4daa977 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.222112 Apr 09 21:06:23.022367 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1656/3343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:23.022367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca4f89ba-b64a-4429-aee2-a00cf5e15a33 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ecf43a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.026457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c289ba4-91a2-4f3e-9b73-aca2d966d808 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.210782 Apr 09 21:06:23.027430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1688/3344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:23.094551 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca4f89ba-b64a-4429-aee2-a00cf5e15a33 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-359325356" status: 200 len: 484 microversion: 2.1 time: 0.079540 Apr 09 21:06:23.095352 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1657/3345] 10.222.0.30 () {58 vars in 1228 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-359325356 => generated 484 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:23.106792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb7a3c4c-f90d-45d8-9966-3c4d8122eea4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1df430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.195117 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb7a3c4c-f90d-45d8-9966-3c4d8122eea4 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?server=b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 956 microversion: 2.1 time: 0.092189 Apr 09 21:06:23.196029 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1689/3346] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?server=b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 956 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:23.207601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e5124a47-11a5-4165-ab81-64d7b6ec86ca tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee5cca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.212721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.213508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:23.221251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.221729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.222500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.222928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.264191 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e5124a47-11a5-4165-ab81-64d7b6ec86ca tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 485 microversion: 2.1 time: 0.060378 Apr 09 21:06:23.264795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1658/3347] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:23.275074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}, {"name": "network-changed", "server_uuid": "e90cb018-3a7a-43aa-81f0-c1063e3024fb", "tag": "a1661061-1748-4e9c-b1ed-3c1a2c5a14cf"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:23.284306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.284765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.299273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] Creating event network-changed:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch1-master-1 Apr 09 21:06:23.300044 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] Creating event network-changed:a1661061-1748-4e9c-b1ed-3c1a2c5a14cf for instance e90cb018-3a7a-43aa-81f0-c1063e3024fb on nch1-master-1 Apr 09 21:06:23.307397 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7467a532-c711-4cc2-9dc4-d75e96d87540 req-47491de2-5d74-48b3-9553-d0ecc40bcbb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036068 Apr 09 21:06:23.308330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1659/3348] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:23.316328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-787788aa-3c99-488f-9472-01b009748580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ef55af0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.376551 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-787788aa-3c99-488f-9472-01b009748580 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 485 microversion: 2.1 time: 0.066336 Apr 09 21:06:23.377378 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1660/3349] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e => generated 485 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:23.388974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b80f3fc-3dee-4569-a706-660b4972c4b6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed84280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.515510 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b80f3fc-3dee-4569-a706-660b4972c4b6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.130619 Apr 09 21:06:23.516247 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1661/3350] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:23.529774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69105033-0d89-418e-9577-a00281df5019 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee49dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.673381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69105033-0d89-418e-9577-a00281df5019 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.147816 Apr 09 21:06:23.674360 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1662/3351] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:23.683764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.684694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:23.692717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.693554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.694437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.694919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.941077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:23.949477 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd39728c-18e5-4004-9f71-89da60e232be tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1315 microversion: 2.1 time: 0.740707 Apr 09 21:06:23.950158 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1690/3352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:23.955034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:23.955677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:23.962147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.962604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:23.963416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:23.963858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:24.292456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:24.301524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4a2d1e8-6644-4dc0-8f49-7d4e48df37e5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1519 microversion: 2.1 time: 0.625802 Apr 09 21:06:24.302125 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1663/3353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1519 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:24.306812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4fb6570-abda-4966-9086-57cdaaa59173 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08eeb5160>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:24.356670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4fb6570-abda-4966-9086-57cdaaa59173 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.053484 Apr 09 21:06:24.357301 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1664/3354] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:06:24 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:24.362116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:24.363544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:24.369232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:24.369677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:24.370453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:24.370906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:24.545921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:24.554022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e7b5df0-22ab-4b4c-bf4d-1486070f1ec3 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.602670 Apr 09 21:06:24.554571 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1691/3355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:23 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:24.559327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:24.560096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:24.567080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:24.567530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:24.568542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:24.568977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.023664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:25.031784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e81a7364-92d7-447c-9dbf-02fa78fbece9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1291 microversion: 2.1 time: 0.673479 Apr 09 21:06:25.032538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1665/3356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:24 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1291 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.037478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.038720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:25.045282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.045889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.046752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.047494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.065838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:25.075853 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a85bd27a-2867-4d54-ba2f-1487185cdfd5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.519656 Apr 09 21:06:25.077169 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1692/3357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:24 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.098728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d23237f1-5d43-4e5f-bb71-e218ff880b64 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e29ed30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.185315 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d23237f1-5d43-4e5f-bb71-e218ff880b64 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-04-09T21%3A04%3A05Z" status: 200 len: 6333 microversion: 2.1 time: 0.106882 Apr 09 21:06:25.186130 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1693/3358] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/images/detail?changes-since=2022-04-09T21%3A04%3A05Z => generated 6333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.191950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.192573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:25.208111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.208776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.210266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.212399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.449422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:25.462714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-29e2d12b-219b-4120-b289-9650b8310268 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.428966 Apr 09 21:06:25.463810 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1666/3359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.480283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-543f3803-6e7e-4983-bbb8-a5fea172e7e5 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ee49430>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.517180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:25.532476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18b0634a-6331-4706-8b03-62c519ddfee3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1501 microversion: 2.1 time: 0.345286 Apr 09 21:06:25.544612 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-543f3803-6e7e-4983-bbb8-a5fea172e7e5 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-359325356" status: 200 len: 664 microversion: 2.1 time: 0.063570 Apr 09 21:06:25.544612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1667/3360] 10.222.0.30 () {58 vars in 1249 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-359325356 => generated 664 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:25.546009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1694/3361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1501 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.551967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.552416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:25.552875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:25.553314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:25.560585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.560774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.561300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.561618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.562290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.562697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.562938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.563423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.602826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lazy-loading 'flavor' on Instance uuid 276af9a8-cb98-49e4-b5f7-b53121790a25 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:06:25.752519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:25.763573 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e437e43c-bc24-4652-86cf-befebaf937c9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1519 microversion: 2.1 time: 0.219362 Apr 09 21:06:25.764406 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1668/3362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.773438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b898367-06c3-403a-a97a-4e00e55f2b8a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08ed845e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.834242 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b898367-06c3-403a-a97a-4e00e55f2b8a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1467 microversion: 2.1 time: 0.065989 Apr 09 21:06:25.835445 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1669/3363] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1467 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:25.846931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:25.847697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:25.855075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.855751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.857115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:25.858019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:25.946407 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da571f43-d5a8-4065-be18-7039a918d7f9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25/action" status: 202 len: 0 microversion: 2.1 time: 0.398162 Apr 09 21:06:25.952052 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1695/3364] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:06:25 2022] POST /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:25.958719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e934969-e8b5-4ac1-ae9c-678749c6e8c6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e4b65e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.051615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:26.060937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb2202e3-a483-4c0b-afa9-fda410f80254 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.224214 Apr 09 21:06:26.061876 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1670/3365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.067673 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e934969-e8b5-4ac1-ae9c-678749c6e8c6 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1467 microversion: 2.1 time: 0.114281 Apr 09 21:06:26.076570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.077707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.078734 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1696/3366] 10.222.0.30 () {58 vars in 1323 bytes} [Sat Apr 9 21:06:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fbc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1467 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.083860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.084594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.086361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.087347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.090089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.091396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.092678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.093184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.094105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.094542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.327678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:26.336403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:26.336714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a7a70527-146e-4c2e-b009-1f1647401f97 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.273582 Apr 09 21:06:26.337679 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1671/3367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.343672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b6bfb86-2ea4-4610-83e7-ee404e3c7159 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08f0171f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.348236 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7139c919-3424-409c-bc65-630af9cfd311 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1481 microversion: 2.1 time: 0.268350 Apr 09 21:06:26.349293 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1697/3368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1481 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.366933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.368012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.378967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.379868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.380688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.381549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.473024 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b6bfb86-2ea4-4610-83e7-ee404e3c7159 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.134097 Apr 09 21:06:26.484213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1672/3369] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.484213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.484213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.492254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.492795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.493725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.494250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.603405 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93b0cac3-d39b-466e-9e6d-4ae3883b2ea4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127880 Apr 09 21:06:26.604614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1673/3370] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:26.612528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.613452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.626916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.627484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.629107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.629984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.703449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:26.715000 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4c2665c-ee9b-4717-97ba-3603cdc971d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.352437 Apr 09 21:06:26.715822 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1698/3371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.729541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c99eb2ca-9645-40a3-9abe-9374b390e9d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1df040>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.801967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c99eb2ca-9645-40a3-9abe-9374b390e9d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.078206 Apr 09 21:06:26.811180 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1699/3372] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:26.816313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:26.817299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:26.824216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.825066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:26.826087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:26.826721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:27.042307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:27.055707 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a471d448-9871-46a7-8c81-d718fdb20d0b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.444859 Apr 09 21:06:27.056776 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1674/3373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:27.070705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9036348c-ae0b-428d-bf03-d6dc0b75b024 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08f0fae50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:27.122027 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9036348c-ae0b-428d-bf03-d6dc0b75b024 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36" status: 200 len: 784 microversion: 2.1 time: 0.055100 Apr 09 21:06:27.123320 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1675/3374] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Apr 9 21:06:27 2022] GET /compute/v2.1/images/b539c48b-3400-4aa4-9226-8be5a3d07b36 => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:27.128563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:27.129757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:27.136828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:27.138379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:27.143735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:27.144288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:27.703483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:27.719778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b127bcb5-c668-4199-914c-158ec961b0d6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1519 microversion: 2.1 time: 0.907165 Apr 09 21:06:27.720378 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1700/3375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:26 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1519 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:27.724901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c7003a4-5735-4c33-a9d2-0e5a90eed55a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1e6ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:27.816786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c7003a4-5735-4c33-a9d2-0e5a90eed55a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.095315 Apr 09 21:06:27.821359 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1701/3376] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 21:06:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:27.827569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:27.828184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:27.844745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:27.845488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:27.846469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:27.853218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:28.295120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:28.307568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0aec666-7ab3-4dc4-b9f6-0653665463e1 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 1.182827 Apr 09 21:06:28.308439 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1676/3377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:27 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:28.322479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f67af4f0-ae6b-485a-aa85-ae3e3fdcf61f req-9bcf4368-be67-4a61-964d-24349707446c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b84c86-30cb-41cd-9654-0f3a7569149f", "name": "network-vif-plugged", "status": "completed", "tag": "048d8001-0bf8-4fc1-81cf-7a1f07ec5f03"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:28.337729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f67af4f0-ae6b-485a-aa85-ae3e3fdcf61f req-9bcf4368-be67-4a61-964d-24349707446c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:28.338605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f67af4f0-ae6b-485a-aa85-ae3e3fdcf61f req-9bcf4368-be67-4a61-964d-24349707446c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:28.353105 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f67af4f0-ae6b-485a-aa85-ae3e3fdcf61f req-9bcf4368-be67-4a61-964d-24349707446c service nova] Creating event network-vif-plugged:048d8001-0bf8-4fc1-81cf-7a1f07ec5f03 for instance 95b84c86-30cb-41cd-9654-0f3a7569149f on nch1-master-1 Apr 09 21:06:28.360205 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f67af4f0-ae6b-485a-aa85-ae3e3fdcf61f req-9bcf4368-be67-4a61-964d-24349707446c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049985 Apr 09 21:06:28.361433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1677/3378] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:28.368043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:28.369251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:28.377898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:28.378764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:28.380579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:28.381417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:28.714893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:28.723257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2366ee8c-b4a6-4bd8-84ad-3b290a07e8a3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.900585 Apr 09 21:06:28.730153 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1702/3379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:27 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:28.735451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eaeaa82d-ea2d-4e1c-a9d4-bdd3427a8035 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1f44c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:28.976532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:28.990550 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5051ebdb-2be3-454a-92b2-6f871a12d2b2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.623986 Apr 09 21:06:28.993355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1678/3380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:28 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:29.003997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:29.004622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:29.022881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.023348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:29.024163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.024610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:29.580177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:29.594693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eccff15f-618f-4e66-bede-c230e9806f3d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.597119 Apr 09 21:06:29.596130 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1679/3381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:28 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:29.602737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:29.603644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:29.626360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.627294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:29.628356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.629438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:29.674096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eaeaa82d-ea2d-4e1c-a9d4-bdd3427a8035 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166" status: 204 len: 0 microversion: 2.1 time: 0.942514 Apr 09 21:06:29.678389 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1703/3382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:28 2022] DELETE /compute/v2.1/images/f4eba6bf-d407-4ee9-b421-1e05540e0166 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:29.686103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:29.686922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:29.705319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.708252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:29.710775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:29.712525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.220905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:30.237826 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b0b787f-d94f-4eb4-b748-90e3f2d7ff77 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.558087 Apr 09 21:06:30.238857 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1704/3383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:29 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:30.243544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4bb8cd0-8c0f-4d4e-a1f3-029ab0cf62b2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1e6310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:30.277812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:30.287556 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1256975f-f955-4c53-99ff-bcb415ca5b94 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1519 microversion: 2.1 time: 0.689455 Apr 09 21:06:30.288179 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1680/3384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:29 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1519 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:30.306519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:30.307445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:30.324492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.325352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.326319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.326905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.743010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:30.753183 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9f7b494b-7b59-46fa-b8a4-386e4e450d38 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.455415 Apr 09 21:06:30.753806 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1681/3385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:30 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:30.764937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:30.768563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:30.780715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.781199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.781996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.782432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.940981 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4bb8cd0-8c0f-4d4e-a1f3-029ab0cf62b2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1" status: 204 len: 0 microversion: 2.1 time: 0.700915 Apr 09 21:06:30.942438 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1705/3386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:30 2022] DELETE /compute/v2.1/images/b1e9052b-10ab-4de3-8af9-12f0cb4eb4c1 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:30.947371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:30.948312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:30.957655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.959156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:30.960267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:30.960970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.067252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:31.075102 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7743b369-ba1d-401a-b01e-f750931cbb98 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.319437 Apr 09 21:06:31.084642 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1682/3387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:30 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:31.090361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1fff1d6a-acb3-4171-befd-2f3bf5e358e0 req-59cfca06-ee9a-45e1-94d1-bbd653091eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65bd15c9-6492-4273-a5fc-12f183befa1c", "tag": "71880d13-76a1-445e-a3c8-e6054d854829"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:31.098447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1fff1d6a-acb3-4171-befd-2f3bf5e358e0 req-59cfca06-ee9a-45e1-94d1-bbd653091eb0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.099253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1fff1d6a-acb3-4171-befd-2f3bf5e358e0 req-59cfca06-ee9a-45e1-94d1-bbd653091eb0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.118939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1fff1d6a-acb3-4171-befd-2f3bf5e358e0 req-59cfca06-ee9a-45e1-94d1-bbd653091eb0 service nova] Creating event network-changed:71880d13-76a1-445e-a3c8-e6054d854829 for instance 65bd15c9-6492-4273-a5fc-12f183befa1c on nch2-master-1 Apr 09 21:06:31.125132 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1fff1d6a-acb3-4171-befd-2f3bf5e358e0 req-59cfca06-ee9a-45e1-94d1-bbd653091eb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038745 Apr 09 21:06:31.126017 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1683/3388] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:31.204879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:31.216081 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f677291-b516-4406-af72-7e26fea96086 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1481 microversion: 2.1 time: 0.272081 Apr 09 21:06:31.216676 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1706/3389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:30 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1481 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:31.248655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:31.250008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:31.256413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.259090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.259896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.260335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.272034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Action: 'create', calling method: .version_select at 0x7fb08f032430>, body: {"keypair": {"name": "tempest-keypair-115501374"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:31.287420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:31.293920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for user 8844e9ec7bb34861aa23f38af40da479 and project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:31.598809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:31.605179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for user 8844e9ec7bb34861aa23f38af40da479 and project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:31.606229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:31.621362 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a9e47b0-b9d2-4f63-b966-697402456f0e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.490391 Apr 09 21:06:31.622100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1684/3390] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:06:31 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:31.632225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-434880a6-1a57-4db8-a135-1bfb149c27f8 req-ee20ae1a-64ff-479e-a878-b9f1bac48dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0f03ed-0631-4764-ad2b-f9982421cce5", "name": "network-vif-plugged", "status": "completed", "tag": "9ad8016c-e56d-42b1-a21b-8f530a861360"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:31.633080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-693a9fbb-444d-42a3-8070-0c9003fd25d6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.386328 Apr 09 21:06:31.634658 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1707/3391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:31 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:31.642200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bc37c019-41d3-4e52-a1e5-1bf77602084a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08f720280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:31.665235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-434880a6-1a57-4db8-a135-1bfb149c27f8 req-ee20ae1a-64ff-479e-a878-b9f1bac48dd9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.674870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-434880a6-1a57-4db8-a135-1bfb149c27f8 req-ee20ae1a-64ff-479e-a878-b9f1bac48dd9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.702901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-434880a6-1a57-4db8-a135-1bfb149c27f8 req-ee20ae1a-64ff-479e-a878-b9f1bac48dd9 service nova] Creating event network-vif-plugged:9ad8016c-e56d-42b1-a21b-8f530a861360 for instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 on nch2-master-1 Apr 09 21:06:31.715280 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-434880a6-1a57-4db8-a135-1bfb149c27f8 req-ee20ae1a-64ff-479e-a878-b9f1bac48dd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086259 Apr 09 21:06:31.718101 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1685/3392] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:31.731054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:31.732534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:31.744073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.744553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:31.745276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:31.746109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.030501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:32.039728 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ea2fea8-28d7-4143-b67a-210a215a8401 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.319440 Apr 09 21:06:32.040325 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1686/3393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:31 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:32.057548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.059046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.072010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.072639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.073672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.074623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.349539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:32.359581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-160f066f-0782-425a-b442-254129587183 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1504 microversion: 2.1 time: 0.315495 Apr 09 21:06:32.364157 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1687/3394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:32.373382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.377670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.389117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.389738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.390683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.391608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.401021 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bc37c019-41d3-4e52-a1e5-1bf77602084a tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02" status: 204 len: 0 microversion: 2.1 time: 0.764997 Apr 09 21:06:32.402402 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1708/3395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:31 2022] DELETE /compute/v2.1/images/5a9116e0-992e-4230-849e-4dd6ba6d4e02 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:32.408112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.408902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.418419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.419084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.421067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.421685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.636696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:32.644363 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-94ff72a3-1601-40f0-bddb-893b25cba9e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.240593 Apr 09 21:06:32.644954 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1709/3396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:32.666017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.666920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.675461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:32.677498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.678917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.679845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.680775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.685013 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c54e48af-2833-43d5-862b-fc7eb1ad04d2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.319390 Apr 09 21:06:32.686105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1688/3397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:32.694390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.695340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.702958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.703774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.705512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.706367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.734504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:32.861019 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5d5343f-a6d9-4dd6-92fd-b2b3542cdc0e tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 204 len: 0 microversion: 2.1 time: 0.170622 Apr 09 21:06:32.862448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1689/3398] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:32 2022] DELETE /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:32.865603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:32.871503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.872353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.877176 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8ca8732-a7d4-4d6e-aa48-323e2f0dfc17 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 200 len: 1504 microversion: 2.1 time: 0.226556 Apr 09 21:06:32.878608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1710/3399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:32.883641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.883641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.883641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.883641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.894944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:32.895574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:32.902480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.902985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:32.903855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:32.904302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.560836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:33.575039 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f25e8081-b67a-4a7f-a142-3f57f18a9203 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.708224 Apr 09 21:06:33.577884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1690/3400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:33.609244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:33.619039 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22bf52b4-36eb-464e-92d7-1da7b90558bc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1473 microversion: 2.1 time: 0.733310 Apr 09 21:06:33.621364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:33.622380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1711/3401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:32 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1473 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:33.630857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:33.632460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:33.633442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:33.641236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.643126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.643423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.645195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.645920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.652213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.653397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.655952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.693588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:33.821572 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-58543025-ab28-4356-96a8-d3ab20cdba2c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 204 len: 0 microversion: 2.1 time: 0.231287 Apr 09 21:06:33.822707 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1691/3402] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:33 2022] DELETE /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:33.831441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:33.832559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:33.843936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.844619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.845602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:33.846187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:33.855051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:33.863162 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4bac7a8e-65ab-4ee9-9075-c312bae4669f tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1316 microversion: 2.1 time: 0.239408 Apr 09 21:06:33.875122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1712/3403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:33 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:33.881384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-314306079", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e88960d2-bd5c-46d3-9b62-3ba00bb82e86"}], "security_groups": [{"name": "tempest-securitygroup--985808552"}], "key_name": "tempest-keypair-115501374", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:34.046348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] validate_networks() for [('e88960d2-bd5c-46d3-9b62-3ba00bb82e86', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:34.049158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:34.058686 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84aa320e-2c66-4c1d-8d6b-ba614772e85f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.234785 Apr 09 21:06:34.060394 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1692/3404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:33 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:34.068202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:34.070042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:34.088619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.089165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.090500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.091560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.374314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:34.391041 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-111ee2bc-935a-4877-9bf4-6a197cd3a9d0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.328479 Apr 09 21:06:34.393526 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1693/3405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:34 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:34.404876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ec61bbcf-c8d9-4936-bfee-507cdcd7d31b req-5e0a5536-c140-4cad-8d03-5fb53c441c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90cb018-3a7a-43aa-81f0-c1063e3024fb", "name": "network-vif-plugged", "status": "completed", "tag": "a1661061-1748-4e9c-b1ed-3c1a2c5a14cf"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:34.431408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ec61bbcf-c8d9-4936-bfee-507cdcd7d31b req-5e0a5536-c140-4cad-8d03-5fb53c441c51 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.432321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ec61bbcf-c8d9-4936-bfee-507cdcd7d31b req-5e0a5536-c140-4cad-8d03-5fb53c441c51 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.447689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ec61bbcf-c8d9-4936-bfee-507cdcd7d31b req-5e0a5536-c140-4cad-8d03-5fb53c441c51 service nova] Creating event network-vif-plugged:a1661061-1748-4e9c-b1ed-3c1a2c5a14cf for instance e90cb018-3a7a-43aa-81f0-c1063e3024fb on nch1-master-1 Apr 09 21:06:34.454198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ec61bbcf-c8d9-4936-bfee-507cdcd7d31b req-5e0a5536-c140-4cad-8d03-5fb53c441c51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055966 Apr 09 21:06:34.454568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1694/3406] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:34.472640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1360828198", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "aca23e59-7431-4b5d-8caa-e391d337ad7c"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:34.549437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] validate_networks() for [('aca23e59-7431-4b5d-8caa-e391d337ad7c', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:34.704658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for project be8cef49b0454f9bb34f7d52b7918a6c. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:34.711317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for user 8844e9ec7bb34861aa23f38af40da479 and project be8cef49b0454f9bb34f7d52b7918a6c. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:34.726455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:34.726978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:34.727514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:34.727981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:34.728450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:34.737760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.738293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.739221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.739724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.757782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:34.765097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Getting quotas for user 8844e9ec7bb34861aa23f38af40da479 and project be8cef49b0454f9bb34f7d52b7918a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:34.782045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:34.785244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:34.855701 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0feeeafe-58db-4d44-986f-884b4b56e2eb tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.979144 Apr 09 21:06:34.857017 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1713/3407] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:34.862034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:34.862837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:34.869626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.870352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:34.871298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:34.871913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.261670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:35.275628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7a40a958-80e9-4ef6-9216-a9e47603a301 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.417326 Apr 09 21:06:35.276589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1714/3408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:34 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:35.281380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:35.281987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:35.299104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.299547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.301247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.303995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.443252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:35.444427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:35.445081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:35.445446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:35.445830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:35.459358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:35.466989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.472316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-523183b1-1a9c-4207-afea-bf05afc62ddc tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 200 len: 1431 microversion: 2.1 time: 0.194383 Apr 09 21:06:35.473419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.474166 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1715/3409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:35 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 1431 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:35.474744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.475599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.480393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c526deb5-a8e5-4a4e-94d9-00834b22731b tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:35.481266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c526deb5-a8e5-4a4e-94d9-00834b22731b tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:35.549485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:35.557740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for user 4719eac69a2f4f25bbb1abfb3ef7c980 and project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:35.582272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:35.588988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:35.627354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c526deb5-a8e5-4a4e-94d9-00834b22731b tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:35.638442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c526deb5-a8e5-4a4e-94d9-00834b22731b tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1276 microversion: 2.1 time: 0.162793 Apr 09 21:06:35.651249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1716/3410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:35 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:35.658516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:35.661912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:35.672375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.673661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.674666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.675508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.716061 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68c08754-ad9c-4ebb-b8cd-61161c198acb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247866 Apr 09 21:06:35.716796 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1695/3411] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:35.735142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:35.735866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:35.751775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.752381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:35.753453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:35.753911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.222286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:36.231265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6648d248-7905-47bf-b9de-223d094dc0d5 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1466 microversion: 2.1 time: 0.578451 Apr 09 21:06:36.232345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1717/3412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:35 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1466 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:36.239310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f1f45591-4722-4f3a-87fe-b020720baaeb req-0bb3b6a0-1df5-4e89-a958-bad282d662c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3a8c29-e199-4d97-8cde-57b42551b09e", "name": "network-vif-deleted", "tag": "7871b15f-ec75-4638-8efa-02a7ceefbe68"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:36.251166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f1f45591-4722-4f3a-87fe-b020720baaeb req-0bb3b6a0-1df5-4e89-a958-bad282d662c8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.252818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f1f45591-4722-4f3a-87fe-b020720baaeb req-0bb3b6a0-1df5-4e89-a958-bad282d662c8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.266083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:36.267619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f1f45591-4722-4f3a-87fe-b020720baaeb req-0bb3b6a0-1df5-4e89-a958-bad282d662c8 service nova] Creating event network-vif-deleted:7871b15f-ec75-4638-8efa-02a7ceefbe68 for instance bc3a8c29-e199-4d97-8cde-57b42551b09e on nch2-master-1 Apr 09 21:06:36.282740 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-289d88ce-3697-483f-927f-80afc2e326dd tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1309 microversion: 2.1 time: 0.563796 Apr 09 21:06:36.283692 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1696/3413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:35 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:36.287498 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f1f45591-4722-4f3a-87fe-b020720baaeb req-0bb3b6a0-1df5-4e89-a958-bad282d662c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045960 Apr 09 21:06:36.292970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1718/3414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:36.305638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.305882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.306511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.306897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.317905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.323089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.323924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.324086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.324397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.324566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.330731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.336014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.503210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:36.521921 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6763219d-c364-4057-914c-a67216074f57 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1222 microversion: 2.1 time: 0.223022 Apr 09 21:06:36.522637 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1719/3415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:36.528300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.529284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.537270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.538000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.538983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.539418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.586286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:36.616563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:36.627684 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4889239-ea96-4cd8-baac-af994a8daeed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.328243 Apr 09 21:06:36.629588 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1697/3416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:36.642838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.643977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.654315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.655351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.656982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.657763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.734301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb3fcdf7-5b21-4c8b-bce8-636492c6b256 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 204 len: 0 microversion: 2.1 time: 0.209647 Apr 09 21:06:36.736212 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1720/3417] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:36 2022] DELETE /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:36.743378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-140b621d-365c-4ed4-9706-63f9942ddabf req-6d5dec5d-6d57-460c-9ba4-9a11f6f309dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "name": "network-vif-plugged", "status": "completed", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:36.754559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-140b621d-365c-4ed4-9706-63f9942ddabf req-6d5dec5d-6d57-460c-9ba4-9a11f6f309dc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.755569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-140b621d-365c-4ed4-9706-63f9942ddabf req-6d5dec5d-6d57-460c-9ba4-9a11f6f309dc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.771522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-140b621d-365c-4ed4-9706-63f9942ddabf req-6d5dec5d-6d57-460c-9ba4-9a11f6f309dc service nova] Creating event network-vif-plugged:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch1-master-1 Apr 09 21:06:36.777533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-140b621d-365c-4ed4-9706-63f9942ddabf req-6d5dec5d-6d57-460c-9ba4-9a11f6f309dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040124 Apr 09 21:06:36.779121 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1721/3418] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:36.784821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.785175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: bc3a8c29-e199-4d97-8cde-57b42551b09e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.793097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.793700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.794627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.795489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.820166 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] HTTP exception thrown: Instance bc3a8c29-e199-4d97-8cde-57b42551b09e could not be found. Apr 09 21:06:36.820985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Returning 404 to user: Instance bc3a8c29-e199-4d97-8cde-57b42551b09e could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:36.822291 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ee89175-f7ec-457b-a985-6d409524b6fd tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e" status: 404 len: 111 microversion: 2.1 time: 0.042374 Apr 09 21:06:36.827204 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1722/3419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/bc3a8c29-e199-4d97-8cde-57b42551b09e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:36.834615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-db121499-393b-4f48-b8c1-6cc26e258835 req-c0dc5d25-0289-4050-b167-8c81e759c78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b84c86-30cb-41cd-9654-0f3a7569149f", "name": "network-vif-deleted", "tag": "048d8001-0bf8-4fc1-81cf-7a1f07ec5f03"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:36.845788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-db121499-393b-4f48-b8c1-6cc26e258835 req-c0dc5d25-0289-4050-b167-8c81e759c78b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.849122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-db121499-393b-4f48-b8c1-6cc26e258835 req-c0dc5d25-0289-4050-b167-8c81e759c78b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.852108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:36.866637 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-db121499-393b-4f48-b8c1-6cc26e258835 req-c0dc5d25-0289-4050-b167-8c81e759c78b service nova] Creating event network-vif-deleted:048d8001-0bf8-4fc1-81cf-7a1f07ec5f03 for instance 95b84c86-30cb-41cd-9654-0f3a7569149f on nch1-master-1 Apr 09 21:06:36.867877 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-785fc423-aa9a-4995-bae5-ae48044090d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.236088 Apr 09 21:06:36.868675 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1698/3420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:36.876078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.877013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.881666 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-db121499-393b-4f48-b8c1-6cc26e258835 req-c0dc5d25-0289-4050-b167-8c81e759c78b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052707 Apr 09 21:06:36.882205 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1723/3421] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:36.887278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:36.888013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:36.888854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.889373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.890355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.890802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.894297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.894755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.895527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:36.895958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:36.994575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.003740 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16298f8f-a9ab-4f9d-b094-fc8690c4334c tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1334 microversion: 2.1 time: 0.131936 Apr 09 21:06:37.004855 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1699/3422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:37.010632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.011219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.022049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.023082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.023459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.024126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.052644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:37.100957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.110235 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dcc8739f-0dd2-4ab5-88a8-8b672e1e332d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1472 microversion: 2.1 time: 0.226705 Apr 09 21:06:37.110910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1724/3423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:36 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:37.136941 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ee19057-6651-4d3c-a75a-f29fe35cd68c tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 204 len: 0 microversion: 2.1 time: 0.130508 Apr 09 21:06:37.137626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1700/3424] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:37 2022] DELETE /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:37.146396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.147003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.153815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.154294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.155096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.155624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.303517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.305901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.318171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.319383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.320519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.321265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.357819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.372097 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66ea3838-c722-4851-9c03-5e508f2cfbe7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1473 microversion: 2.1 time: 0.229733 Apr 09 21:06:37.381489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1725/3425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:37.467180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.476632 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-079d6942-18c7-4bc0-8f90-b21999f038c3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1489 microversion: 2.1 time: 0.177965 Apr 09 21:06:37.484519 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1701/3426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1489 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:37.493667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1519295655"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:37.494828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.501220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.501715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.502535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.502965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.542044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.542676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.549626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.550084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.550879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.551320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.583335 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37f144ea-1059-4048-a936-d7cf527ae4a7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "PUT /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1074 microversion: 2.1 time: 0.093817 Apr 09 21:06:37.584031 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1726/3427] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:06:37 2022] PUT /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1074 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:37.603766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.604418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.612183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.614369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.615582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.616125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.641599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.649485 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d56b3a09-7b12-4152-8287-683e442fefc4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1270 microversion: 2.1 time: 0.112037 Apr 09 21:06:37.650081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1702/3428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:37.658349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.659182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.666654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.667309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.668103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.668551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.863076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.869919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:37.871212 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a173cca-9baf-427a-a6eb-9a3ece67b7fa tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1500 microversion: 2.1 time: 0.272507 Apr 09 21:06:37.871787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1727/3429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1500 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:37.878077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ace6c177-7caf-4e69-8530-24545a71453a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.223912 Apr 09 21:06:37.878662 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1703/3430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:37.887672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.888290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.890862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:37.891474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:37.894823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.895217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.895998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.896441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.897420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.897876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:37.898642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:37.899077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.179562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.181904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.188551 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7be24930-b33c-4361-813b-47a7d0b33449 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1500 microversion: 2.1 time: 0.304504 Apr 09 21:06:38.189164 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1704/3431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1500 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.190109 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6a879be-41b6-49a4-94d5-791e6b43728f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1316 microversion: 2.1 time: 0.306502 Apr 09 21:06:38.190859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1728/3432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:37 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.205428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.206044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.212093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.212543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.213342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.213780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.215052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.215712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.223632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.224083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.224867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.225339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.287201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.299751 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-774ed6c5-2074-415f-9290-10c7d6d840e7 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1334 microversion: 2.1 time: 0.098063 Apr 09 21:06:38.300705 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1705/3433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.307739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e51834bd-153d-434e-a037-a75c4c0bed33 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:38.318534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e51834bd-153d-434e-a037-a75c4c0bed33 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.319010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e51834bd-153d-434e-a037-a75c4c0bed33 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.408553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e51834bd-153d-434e-a037-a75c4c0bed33 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:06:38.427709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.449847 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d322230b-d853-4aed-bc3a-2139827f0b52 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1472 microversion: 2.1 time: 0.243551 Apr 09 21:06:38.460499 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1729/3434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.466253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.466998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.473634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.474081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.474735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e51834bd-153d-434e-a037-a75c4c0bed33 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "POST /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb/action" status: 202 len: 0 microversion: 2.1 time: 0.172489 Apr 09 21:06:38.474944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.475380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.479168 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1706/3435] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:06:38 2022] POST /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:38.484663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.485592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.492142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.492692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.493628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.498511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.672866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.681393 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-996535d7-fcec-4466-9778-bd4b8753ebb2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1473 microversion: 2.1 time: 0.219436 Apr 09 21:06:38.692229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.694109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1730/3436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.698947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c64ca19b-872f-4009-b67f-b7d4a2fa66d6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.216081 Apr 09 21:06:38.699506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1707/3437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.703674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.704290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.710445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.710893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.711657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.712085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.787657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:38.796858 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-777d8f61-441c-4b55-9851-aa81b342260f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1270 microversion: 2.1 time: 0.099581 Apr 09 21:06:38.797369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1731/3438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:38.894473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:38.895202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:38.901481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.901936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:38.902750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:38.903250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.036568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:39.044900 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-604d33be-71e9-4dcb-a3a4-77b24bc1bae4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.154438 Apr 09 21:06:39.048534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1708/3439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:38 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:39.211179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:39.212060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:39.220427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.220879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.221677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.222140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.318221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:39.318847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:39.325310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.325810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.326621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.327056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.360727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:39.368748 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a30696f-8ab2-4df9-8876-e9063faba590 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.164311 Apr 09 21:06:39.370166 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1732/3440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:39 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:39.465343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:39.468261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:39.468895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:39.473642 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-27204d8c-6c1d-4d15-8ee3-1150fc640343 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.160120 Apr 09 21:06:39.474782 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1709/3441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:39 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:39.475018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.475852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.476642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.477227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.480435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1000118397", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:39.530965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] validate_networks() for [('ad62b125-1df7-49ad-953e-ad87b77a57c1', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:06:39.692328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:39.704243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61555d72-f840-4882-8e7e-6884f6d55283 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1472 microversion: 2.1 time: 0.240308 Apr 09 21:06:39.714650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1733/3442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:39 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:39.720348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:39.721770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:39.727166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.727588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.728547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.729019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.935156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:39.943003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c75bbe7c-9195-4263-8d5e-6bdd61ada7d2 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1473 microversion: 2.1 time: 0.226404 Apr 09 21:06:39.953539 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1734/3443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:39 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:39.958720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:39.959613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:39.966519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.967353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:39.968335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:39.969073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.075380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:40.076297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:40.077076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:40.077646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:40.078217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:40.095623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.110259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.111470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.112106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.135010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Getting quotas for project 3e27519c6c114724bf36126f0362a7c0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:40.141508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Getting quotas for user cdab30a578b947068144a0509c85eb0c and project 3e27519c6c114724bf36126f0362a7c0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:40.164620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:06:40.169606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:06:40.243943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:40.264068 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd71b80c-8bed-4bf1-9e7a-93ce0f365010 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782829 Apr 09 21:06:40.264849 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1710/3444] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:06:40.271017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:40.272003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:40.279197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.279994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.280154 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ec160de-cce8-41c7-a108-9c47f9889ba8 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.323951 Apr 09 21:06:40.281318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.284193 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1735/3445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:39 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:40.289319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:40.291608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.294964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:40.302637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.303220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.304372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.305514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.672845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:40.688672 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef33541d-c0d6-4e2f-a7b8-c748c9ba5556 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1288 microversion: 2.1 time: 0.422300 Apr 09 21:06:40.690581 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1711/3446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:40 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1288 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:40.699475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-faf2a66e-4f61-4552-948b-04a8bd16bb01 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:40.704451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-faf2a66e-4f61-4552-948b-04a8bd16bb01 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:40.796847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-faf2a66e-4f61-4552-948b-04a8bd16bb01 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:40.811906 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-faf2a66e-4f61-4552-948b-04a8bd16bb01 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1217 microversion: 2.1 time: 0.115851 Apr 09 21:06:40.822786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:40.838523 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1712/3447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:40 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:40.842211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:40.842938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:40.845440 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cdcd5ec6-b36b-4184-a1dd-04858e065658 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.559734 Apr 09 21:06:40.846920 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1736/3448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:40 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:40.850773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.851297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.852218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.852981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0eb4b275-904a-4b4e-8465-82f8ef53b418 req-f5999b98-fb0e-4603-b4d0-4cf980375c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcefe5-59b3-4919-b321-cbcb7a47e014", "tag": "0e43d1e5-8511-4e37-ac37-577627349f47"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:40.853555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.862640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0eb4b275-904a-4b4e-8465-82f8ef53b418 req-f5999b98-fb0e-4603-b4d0-4cf980375c71 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.863368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0eb4b275-904a-4b4e-8465-82f8ef53b418 req-f5999b98-fb0e-4603-b4d0-4cf980375c71 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.878208 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0eb4b275-904a-4b4e-8465-82f8ef53b418 req-f5999b98-fb0e-4603-b4d0-4cf980375c71 service nova] Creating event network-changed:0e43d1e5-8511-4e37-ac37-577627349f47 for instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 on nch2-master-1 Apr 09 21:06:40.904348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0eb4b275-904a-4b4e-8465-82f8ef53b418 req-f5999b98-fb0e-4603-b4d0-4cf980375c71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056020 Apr 09 21:06:40.906419 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1737/3449] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:40.914154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:40.916341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:40.927134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.927814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:40.928765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:40.929416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.172165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:41.181188 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7068acac-db66-41c0-91f4-4c925dc108b5 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.350049 Apr 09 21:06:41.182448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1713/3450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:40 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:41.187672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:41.188559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:41.195775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.196329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.197386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.197613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:41.198014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.206460 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-414c07c5-546b-41f7-aba9-291c5821c540 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1472 microversion: 2.1 time: 0.298682 Apr 09 21:06:41.207260 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1738/3451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:40 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:41.271036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:41.280468 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89cdf336-cb4e-4f72-aa32-827dbb7f4270 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1431 microversion: 2.1 time: 0.096732 Apr 09 21:06:41.281318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1714/3452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:41 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1431 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:41.298215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:41.299133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:41.305747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.306204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.307007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.307453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.707284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:41.707970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:41.717938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.718436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.719392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.720291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.880178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:41.890608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bcac5713-8269-4a93-a739-7df30e1dc858 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1276 microversion: 2.1 time: 0.187224 Apr 09 21:06:41.891863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1715/3453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:41 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:41.896270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:41.896884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:41.909827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.910313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:41.911138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:41.911599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.019685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.031743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e2f8f4aa-a904-4449-a9df-e6b7e897c501 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1275 microversion: 2.1 time: 0.139053 Apr 09 21:06:42.033998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1716/3454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:41 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:42.040375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:42.042068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:42.054400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.055492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.056708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.058073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.078416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.091854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e73aaecf-cbc9-4e44-a719-c5375521971f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.797393 Apr 09 21:06:42.093611 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1739/3455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:41 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:42.198870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:42.199481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:42.205729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.206192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.206963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.207383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.441849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.450645 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd65bfe6-adbd-4293-acd2-c68237356c0f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.414984 Apr 09 21:06:42.451694 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1717/3456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:42 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:42.457057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:42.457770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:42.464157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.464616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.465798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.466228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.497759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.498289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.498815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lazy-loading 'fault' on Instance uuid 9b0f03ed-0631-4764-ad2b-f9982421cce5 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:06:42.543544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.551955 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bba774d-a08e-48b0-9698-c35faa80542d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.357090 Apr 09 21:06:42.552634 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1740/3457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:42 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:42.559752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:42.560693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:42.567606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.568146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.569332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.569850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.580201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.589555 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d27139fe-d3ad-4c2d-9a30-20b907529e8e tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1306 microversion: 2.1 time: 0.136610 Apr 09 21:06:42.591315 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1718/3458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:42 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:42.603408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.603861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.604317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lazy-loading 'fault' on Instance uuid b41376b6-fec0-40d4-add3-7058e3ec6c24 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:06:42.656594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:42.664704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e6c08c2-a52b-4437-9cbc-d0ae54e598b9 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1307 microversion: 2.1 time: 0.108507 Apr 09 21:06:42.665331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1741/3459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:42 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:42.908046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:42.908556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:42.916227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.921716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.923350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.924423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.927751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41376b6-fec0-40d4-add3-7058e3ec6c24", "name": "network-vif-deleted", "tag": "40d3d034-bc3b-4d5c-b33e-e60acf160036"}, {"server_uuid": "9b0f03ed-0631-4764-ad2b-f9982421cce5", "name": "network-vif-deleted", "tag": "9ad8016c-e56d-42b1-a21b-8f530a861360"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:42.941137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:42.942124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:42.956171 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] Creating event network-vif-deleted:40d3d034-bc3b-4d5c-b33e-e60acf160036 for instance b41376b6-fec0-40d4-add3-7058e3ec6c24 on nch2-master-1 Apr 09 21:06:42.957077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] Creating event network-vif-deleted:9ad8016c-e56d-42b1-a21b-8f530a861360 for instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 on nch2-master-1 Apr 09 21:06:42.965459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-073126e2-271d-4dcf-b09b-1ab02e0ed988 req-ac213f78-30f1-43c7-9a57-c18f57d40403 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041861 Apr 09 21:06:42.967023 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1742/3460] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:43.049027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.049754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.056108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.056568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.057915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.058358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.164070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.172264 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36f12709-5208-4608-bf90-d5ee2689ef5c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.268280 Apr 09 21:06:43.172899 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1719/3461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:42 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:43.177415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.178200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.187103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.187715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.188506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.188944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.358962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.367160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-19e35cd2-8775-4e6b-b0d5-d4839ce1bb88 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.322281 Apr 09 21:06:43.367781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1743/3462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:43.456138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.464211 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dac4fde6-fc48-41fd-b9f9-772e8a071167 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.290271 Apr 09 21:06:43.465599 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1720/3463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:43.468482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.469379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.475589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.476107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.476946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.477466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.569234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.569996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.576974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.577473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.578234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.578708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.738168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.746471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69b33358-b96b-4233-8642-3cd4ced122c7 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.282222 Apr 09 21:06:43.747210 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1744/3464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:43.752068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.752669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.765419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.768058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.768891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.769364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.800220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.800672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.801134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lazy-loading 'fault' on Instance uuid 9b0f03ed-0631-4764-ad2b-f9982421cce5 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:06:43.839730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.847745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ed9864b-de5f-4d7d-b3e3-765f80473fb8 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.282498 Apr 09 21:06:43.848317 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1721/3465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:43.861100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc27b3989d24806b90e581b5f605288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8db9d188edc4c1fb6fb85e81e8dba79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:43.862271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:43.862593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:43.870304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.870837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.871473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e44f00d-969c-48b7-9fb6-8ddabd537536 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 200 len: 1306 microversion: 2.1 time: 0.123161 Apr 09 21:06:43.871755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.872252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.872684 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1745/3466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:43.907509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:43.908007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:43.908458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lazy-loading 'fault' on Instance uuid b41376b6-fec0-40d4-add3-7058e3ec6c24 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:06:44.003195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe69df11b2846f99843c4883a067021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2f7aa3f0c94253b265693d30844fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:44.013278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a768fd5-5056-4df0-badb-bb5e8feddb81 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 200 len: 1307 microversion: 2.1 time: 0.155225 Apr 09 21:06:44.013968 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1722/3467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:43 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:44.117935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f7c76ae7-5d38-4320-8017-baf9607bd6c8 req-00351cfa-e5b5-4215-8c5c-fabf8ab82e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe417324-1de0-45c0-876b-2032e5ce27da", "tag": "79b55d78-e389-4ada-a99b-e6ba587d7c29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:44.130933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f7c76ae7-5d38-4320-8017-baf9607bd6c8 req-00351cfa-e5b5-4215-8c5c-fabf8ab82e71 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.131384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f7c76ae7-5d38-4320-8017-baf9607bd6c8 req-00351cfa-e5b5-4215-8c5c-fabf8ab82e71 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.145696 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f7c76ae7-5d38-4320-8017-baf9607bd6c8 req-00351cfa-e5b5-4215-8c5c-fabf8ab82e71 service nova] Creating event network-changed:79b55d78-e389-4ada-a99b-e6ba587d7c29 for instance fe417324-1de0-45c0-876b-2032e5ce27da on nch1-master-1 Apr 09 21:06:44.150670 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f7c76ae7-5d38-4320-8017-baf9607bd6c8 req-00351cfa-e5b5-4215-8c5c-fabf8ab82e71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Apr 09 21:06:44.151450 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1746/3468] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:44.189390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:44.193873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:44.203177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.209162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.210237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.210799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.386777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:44.388874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:44.400749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.404608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.406986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.407694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.638995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:44.647113 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6f59a014-29e8-4fed-bf8d-debc73f8d48c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.462273 Apr 09 21:06:44.647833 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1723/3469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:44 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:44.652899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:44.653874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:44.660408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.661100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.661890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.662494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.813684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:44.821583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65730ef7-897a-4b7c-97d6-fdd7a3c7b60f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.441029 Apr 09 21:06:44.822174 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1747/3470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:44 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:44.826773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:44.827581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:44.833429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.833878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:44.834668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:44.835097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.053085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:45.063276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b4dd8a3-90d2-4f74-afc4-7bea3eea77e3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.413700 Apr 09 21:06:45.063365 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1724/3471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:44 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:45.076925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.077582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.084020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.084484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.085316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.085766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.196945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:45.205176 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e19189a2-1ec9-40a6-8c2e-7c836317c7b4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.381933 Apr 09 21:06:45.205773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1748/3472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:44 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:45.210238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.210823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.220203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.220635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.221512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.221939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.235985 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. Apr 09 21:06:45.236570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.237435 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bcb502a-cc97-45d6-b538-cea36ba0f9c0 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 404 len: 111 microversion: 2.1 time: 0.030735 Apr 09 21:06:45.238183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1749/3473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.242848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.243457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] [instance: b41376b6-fec0-40d4-add3-7058e3ec6c24] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.249297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.249752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.250515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.250956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.266483 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] HTTP exception thrown: Instance b41376b6-fec0-40d4-add3-7058e3ec6c24 could not be found. Apr 09 21:06:45.267081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Returning 404 to user: Instance b41376b6-fec0-40d4-add3-7058e3ec6c24 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.267927 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d891fa15-026a-4877-8172-e0999441b191 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24" status: 404 len: 111 microversion: 2.1 time: 0.028693 Apr 09 21:06:45.268484 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1750/3474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] GET /compute/v2.1/servers/b41376b6-fec0-40d4-add3-7058e3ec6c24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.273236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-233309997", "metadata": {"image_type": "test"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:45.274328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.280200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.280648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.281442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.281876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.287173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:45.295637 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93c0d26b-4dbf-4a69-970b-fc5c3b082cb2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.222521 Apr 09 21:06:45.295820 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. Apr 09 21:06:45.305018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.305203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1725/3475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:45.305301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e07faa4-58d6-4811-9698-bd243f99631b tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "POST /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5/action" status: 404 len: 111 microversion: 2.1 time: 0.027945 Apr 09 21:06:45.305301 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1751/3476] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Apr 9 21:06:45 2022] POST /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.307015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed88d089-5404-44e9-96b6-571e60d3fd12 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08edcc5e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.308218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7a15c1a-6504-4968-931e-843b4040f290 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-668731018", "metadata": {"image_type": "test"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:45.309326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7a15c1a-6504-4968-931e-843b4040f290 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Failed to fetch instance by id tempest-invalid-288244219 {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:06:45.309856 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d7a15c1a-6504-4968-931e-843b4040f290 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance tempest-invalid-288244219 could not be found. Apr 09 21:06:45.310401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7a15c1a-6504-4968-931e-843b4040f290 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance tempest-invalid-288244219 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.311192 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7a15c1a-6504-4968-931e-843b4040f290 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-288244219/action" status: 404 len: 100 microversion: 2.1 time: 0.006858 Apr 09 21:06:45.311923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1752/3477] 10.222.0.30 () {60 vars in 1245 bytes} [Sat Apr 9 21:06:45 2022] POST /compute/v2.1/servers/tempest-invalid-288244219/action => generated 100 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.321207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7b64432-776a-4a01-af2f-861d4eb0fb9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1511455185"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:45.322239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c7b64432-776a-4a01-af2f-861d4eb0fb9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:06:45.322730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c7b64432-776a-4a01-af2f-861d4eb0fb9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 09 21:06:45.323284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c7b64432-776a-4a01-af2f-861d4eb0fb9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.324077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c7b64432-776a-4a01-af2f-861d4eb0fb9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.007067 Apr 09 21:06:45.324785 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1753/3478] 10.222.0.30 () {60 vars in 1274 bytes} [Sat Apr 9 21:06:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.334491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bcbc6a3-d7a2-47bb-bc33-f51785cd0b9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1998892032"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:45.335466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bcbc6a3-d7a2-47bb-bc33-f51785cd0b9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:06:45.335960 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-6bcbc6a3-d7a2-47bb-bc33-f51785cd0b9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 09 21:06:45.336501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bcbc6a3-d7a2-47bb-bc33-f51785cd0b9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.337493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bcbc6a3-d7a2-47bb-bc33-f51785cd0b9c tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.007739 Apr 09 21:06:45.338007 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1754/3479] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Apr 9 21:06:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:06:45.349069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.349817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.358063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.358519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.359552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.359993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.375136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. Apr 09 21:06:45.385129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.386100 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d110e4b-d941-403c-afcd-3b1da77071b2 tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 404 len: 111 microversion: 2.1 time: 0.042321 Apr 09 21:06:45.386850 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1755/3480] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:45 2022] DELETE /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:45.394862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.395475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] [instance: 9b0f03ed-0631-4764-ad2b-f9982421cce5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.402557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.403006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.403822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.404259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.426305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] HTTP exception thrown: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. Apr 09 21:06:45.426988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] Returning 404 to user: Instance 9b0f03ed-0631-4764-ad2b-f9982421cce5 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:45.427977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-884d9000-8a5a-4166-90bb-0538fd5b701d tempest-ImagesNegativeTestJSON-1492159603 tempest-ImagesNegativeTestJSON-1492159603-project] 10.222.0.30 "GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5" status: 404 len: 111 microversion: 2.1 time: 0.036865 Apr 09 21:06:45.431967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1756/3481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] GET /compute/v2.1/servers/9b0f03ed-0631-4764-ad2b-f9982421cce5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:06:45.566197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed88d089-5404-44e9-96b6-571e60d3fd12 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d" status: 204 len: 0 microversion: 2.1 time: 0.268612 Apr 09 21:06:45.566824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1726/3482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] DELETE /compute/v2.1/images/93ae3b50-25ad-4c42-8033-446091ac2c7d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:45.576123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c315af18-0e23-4a3a-a703-a5615396585d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08e1a3670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.666237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:45.668244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:45.679263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.679679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:45.680672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:45.684109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.035408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:46.046180 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a95ce07-58ea-4b36-b121-6f1ad56325e9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.383803 Apr 09 21:06:46.053641 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1727/3483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:46.058952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:46.059791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:46.068401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.068863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.070024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.070385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.111642 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c315af18-0e23-4a3a-a703-a5615396585d tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac" status: 204 len: 0 microversion: 2.1 time: 0.539719 Apr 09 21:06:46.112219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1757/3484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:45 2022] DELETE /compute/v2.1/images/6d7d3fed-10b4-480d-bcd8-03ca16d007ac => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:46.116672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:46.117317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:46.123456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.123897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.124827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.125462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.329548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:46.345999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ec90e88-d7e4-4762-8d93-2e35093e4f2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.291189 Apr 09 21:06:46.347105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1728/3485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:46 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:46.357894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d04f137e-2a51-424c-983c-31060fc795d7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] Calling method '.version_select at 0x7fb08efc2700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:46.418973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:46.427900 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b90fd8e1-1b06-42b1-8d6d-9513e4fcba34 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.314608 Apr 09 21:06:46.428582 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1758/3486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:46 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:46.433570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e600f499-c527-489c-943b-12a5067a5532 req-f6a6c289-8149-4c18-86f2-88f209bbfd93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e103c226-e4d1-42eb-a8c0-4a9f4d34daf3", "tag": "61bb000c-8420-4fc7-8f3f-a1f3d9041c97"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:46.448833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e600f499-c527-489c-943b-12a5067a5532 req-f6a6c289-8149-4c18-86f2-88f209bbfd93 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.449848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e600f499-c527-489c-943b-12a5067a5532 req-f6a6c289-8149-4c18-86f2-88f209bbfd93 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.463823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e600f499-c527-489c-943b-12a5067a5532 req-f6a6c289-8149-4c18-86f2-88f209bbfd93 service nova] Creating event network-changed:61bb000c-8420-4fc7-8f3f-a1f3d9041c97 for instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 on nch2-master-1 Apr 09 21:06:46.470317 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e600f499-c527-489c-943b-12a5067a5532 req-f6a6c289-8149-4c18-86f2-88f209bbfd93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040344 Apr 09 21:06:46.471173 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1759/3487] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:46.476235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:46.476933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:46.483723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.484180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.485161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.485752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.934542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d04f137e-2a51-424c-983c-31060fc795d7 tempest-ListImageFiltersTestJSON-1803565159 tempest-ListImageFiltersTestJSON-1803565159-project] 10.222.0.30 "DELETE /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64" status: 204 len: 0 microversion: 2.1 time: 0.586051 Apr 09 21:06:46.936287 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1729/3488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:46 2022] DELETE /compute/v2.1/images/602bbf8d-2d2d-49ce-a3f4-2b8fc064ae64 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:46.941654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:46.943040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:46.950497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.951107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:46.951910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:46.952350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.054381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:47.063302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc97e237-0682-4f1c-a3f4-f0ab75acbecd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.590940 Apr 09 21:06:47.063964 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1760/3489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:46 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:47.187098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:47.198175 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a377e09-3918-4956-9062-fb86fb4ee3e4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.260389 Apr 09 21:06:47.198791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1730/3490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:46 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:47.214182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:47.215884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:47.224131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.225112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.226398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.226914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.351646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e1983a0>, body: {"keypair": {"name": "tempest-keypair-208478852"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:47.373251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:47.379112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:47.433260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:47.455716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2849db66-6d31-44e8-8dcd-68fcb4f77a0f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.246249 Apr 09 21:06:47.456340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1731/3491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:47 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:47.469341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:47.469894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:47.478526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.479204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.480174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.480617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.616851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:47.625491 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7123afb0-3408-4d4a-92b6-2c18592ec3eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.167920 Apr 09 21:06:47.629053 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1732/3492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:47 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:47.641519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:47.642130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:47.649358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.650194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.651023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.651600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.663607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:47.672110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:47.689892 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a976c8b-0015-456e-98e6-0b44c99fde29 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.624648 Apr 09 21:06:47.690926 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1761/3493] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 626 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:47.707933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65fa2de4-a4bf-4892-9326-7b5bc88195c1 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e1b9d30>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:47.717455 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65fa2de4-a4bf-4892-9326-7b5bc88195c1 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-208478852" status: 200 len: 706 microversion: 2.2 time: 0.015006 Apr 09 21:06:47.718643 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1762/3494] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Apr 9 21:06:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-208478852 => generated 706 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:47.733617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f1cbecb-dbb8-4ec1-8198-1743db41c516 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e198ca0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:47.762408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f1cbecb-dbb8-4ec1-8198-1743db41c516 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208478852" status: 204 len: 0 microversion: 2.2 time: 0.036926 Apr 09 21:06:47.763634 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1763/3495] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Apr 9 21:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208478852 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:06:47.780841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e154790>, body: {"keypair": {"name": "tempest-keypair-915517794"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:47.802545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:47.810092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:47.828095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:47.841904 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48276219-19d4-4dad-b689-84a1d38b0f93 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.208599 Apr 09 21:06:47.843259 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1733/3496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:47 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:47.910456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7d660e5e-8cf5-49b4-9ac8-0891c0723f62 req-cf394a66-39fc-4c30-bb56-336855a6f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbcefe5-59b3-4919-b321-cbcb7a47e014", "name": "network-vif-plugged", "status": "completed", "tag": "0e43d1e5-8511-4e37-ac37-577627349f47"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:47.922488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7d660e5e-8cf5-49b4-9ac8-0891c0723f62 req-cf394a66-39fc-4c30-bb56-336855a6f8e8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:47.923010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7d660e5e-8cf5-49b4-9ac8-0891c0723f62 req-cf394a66-39fc-4c30-bb56-336855a6f8e8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:47.939891 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7d660e5e-8cf5-49b4-9ac8-0891c0723f62 req-cf394a66-39fc-4c30-bb56-336855a6f8e8 service nova] Creating event network-vif-plugged:0e43d1e5-8511-4e37-ac37-577627349f47 for instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 on nch2-master-1 Apr 09 21:06:47.946010 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7d660e5e-8cf5-49b4-9ac8-0891c0723f62 req-cf394a66-39fc-4c30-bb56-336855a6f8e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040417 Apr 09 21:06:47.947516 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1734/3497] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:48.055832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.060965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.075872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2b62477b-0789-4930-8f3e-5664c08f21cc tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.304836 Apr 09 21:06:48.081129 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1764/3498] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:47 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 306 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:06:48.081467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.082282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:48.086468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8106ba77-a3cb-4dd6-8d51-229fd0227ccd tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e1543a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.090480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.091678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.092782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.093445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.108647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8106ba77-a3cb-4dd6-8d51-229fd0227ccd tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915517794" status: 204 len: 0 microversion: 2.2 time: 0.026124 Apr 09 21:06:48.109285 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1765/3499] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Apr 9 21:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915517794 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:48.118501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-504a3fd9-36c3-4e26-9c39-d8f6ddf08140 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e198d30>, body: {"keypair": {"name": "tempest-keypair-1161880961", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:48.132992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-504a3fd9-36c3-4e26-9c39-d8f6ddf08140 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.138260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-504a3fd9-36c3-4e26-9c39-d8f6ddf08140 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.164962 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-504a3fd9-36c3-4e26-9c39-d8f6ddf08140 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.050219 Apr 09 21:06:48.165808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1766/3500] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 21:06:48 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Apr 09 21:06:48.176999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a43c25ee-e694-4a46-82b1-a5291222b56d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e1bc160>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.197927 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a43c25ee-e694-4a46-82b1-a5291222b56d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161880961" status: 204 len: 0 microversion: 2.2 time: 0.024463 Apr 09 21:06:48.201255 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1767/3501] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Apr 9 21:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161880961 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:06:48.212229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e1bcee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-241988281"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:48.230272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.241248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.256815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:48.266773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c035fbce-297c-41fb-a54a-2f3788ef7baf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.189853 Apr 09 21:06:48.268089 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1735/3502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:48 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:48.272954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.273876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:48.280211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.280939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.282122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.282795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.482816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.489719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.507020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a55d27e3-42e0-400b-8931-4dfdc94986f2 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.300558 Apr 09 21:06:48.508038 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1768/3503] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:48 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 303 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:48.517296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.518322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:48.526344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.526912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.527817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.528602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.529962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:48.546698 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac0c196e-0c9e-4b9a-a5ce-97319295f423 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.277188 Apr 09 21:06:48.547538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1736/3504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:48 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:48.552392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08ec02700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1826057530"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:48.569490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.578577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.712996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:48.719378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:48.741883 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-edc9703a-c0ee-46f3-a36f-086333f3ec1d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.193084 Apr 09 21:06:48.743363 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1737/3505] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:48 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:48.750369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:48.751736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:48.759539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.760630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:48.763024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:48.763844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.054917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:49.063275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc2720ab-cd13-493c-b627-16616397adce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.318382 Apr 09 21:06:49.072826 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1738/3506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:48 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:49.072826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb095458ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-563112766"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:49.074096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:49.085326 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9bd8125b-1648-45dc-b476-65c5bebb4748 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.575702 Apr 09 21:06:49.095868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1769/3507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:48 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:49.100043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:49.100564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.101222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:49.107718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.107921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:49.108342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.109230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.109672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.219149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:49.225234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:49.243237 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c7aabc3-50e5-42ee-8803-74b6b1d07a8d tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.177205 Apr 09 21:06:49.243892 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1739/3508] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:49 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:49.253455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d89def1-ecc9-4554-9f23-c38a85305838 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08f0e3820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.256006 ncdv-master-1 devstack@n-api.service[141819]: WARNING oslo_db.sqlalchemy.utils [None req-8d89def1-ecc9-4554-9f23-c38a85305838 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 21:06:49.261681 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d89def1-ecc9-4554-9f23-c38a85305838 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.012050 Apr 09 21:06:49.263998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1740/3509] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:49.274010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6fee32e4-7de7-4ff6-8dc8-369b1931043e tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08efc2b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.295641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6fee32e4-7de7-4ff6-8dc8-369b1931043e tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-563112766" status: 204 len: 0 microversion: 2.2 time: 0.025550 Apr 09 21:06:49.296355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1741/3510] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Apr 9 21:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-563112766 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:06:49.301887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.302667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:49.309314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.310522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.311354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.311865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.344882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:49.355716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-afa761cd-a671-471f-a59e-4a6530b52465 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.259099 Apr 09 21:06:49.366485 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1770/3511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:49.371406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64546370-7afb-4d28-a301-0e3be83bc165 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e2550d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.400752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64546370-7afb-4d28-a301-0e3be83bc165 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1826057530" status: 204 len: 0 microversion: 2.2 time: 0.033141 Apr 09 21:06:49.401411 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1771/3512] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Apr 9 21:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1826057530 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:49.410591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-749702df-e733-4ae4-8e2f-f313cc33f2f7 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e1544c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.444943 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-749702df-e733-4ae4-8e2f-f313cc33f2f7 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-241988281" status: 204 len: 0 microversion: 2.2 time: 0.038224 Apr 09 21:06:49.445663 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1772/3513] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Apr 9 21:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-241988281 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:06:49.460195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e24f280>, body: {"keypair": {"name": "tempest-keypair-1373958689"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:49.475590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:49.480897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:49.662295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:49.684089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48c428cc-be73-4937-9031-151fba46389a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.385957 Apr 09 21:06:49.685654 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1742/3514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:49.693465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.694685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:49.709402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.712059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.713362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:49.714209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:49.818321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:49.825885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:49.855091 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-931a690e-bc41-48df-93bb-a708e1ee3407 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.400918 Apr 09 21:06:49.856081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1773/3515] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:49 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 403 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:49.870619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3dd0f25-059f-4320-a387-8a0cc82a2fec tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e23f4c0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.881706 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3dd0f25-059f-4320-a387-8a0cc82a2fec tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1373958689" status: 200 len: 707 microversion: 2.2 time: 0.019581 Apr 09 21:06:49.889928 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1774/3516] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1373958689 => generated 707 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:49.898149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e86ab02-905e-4cc4-9c5f-4b6af1195465 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e255430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.901613 ncdv-master-1 devstack@n-api.service[141818]: WARNING oslo_db.sqlalchemy.utils [None req-6e86ab02-905e-4cc4-9c5f-4b6af1195465 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 21:06:49.912267 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e86ab02-905e-4cc4-9c5f-4b6af1195465 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.020981 Apr 09 21:06:49.918610 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1775/3517] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:49.932568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ca7840fa-66cc-48aa-ae1c-e66e10002405 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e1bca60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:49.966910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ca7840fa-66cc-48aa-ae1c-e66e10002405 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373958689" status: 204 len: 0 microversion: 2.2 time: 0.045591 Apr 09 21:06:49.969071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1776/3518] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Apr 9 21:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373958689 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:49.979290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Action: 'create', calling method: .version_select at 0x7fb08e1bc160>, body: {"keypair": {"name": "tempest-keypair-1956391263", "type": "x509"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:50.000892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:50.009548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:50.035855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.processutils [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcs9e36oo/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcs9e36oo/temp.key -subj /CN=e8f139c65a434c5c815998553b0dddc8 -extensions v3_req_client {{(pid=141818) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:06:50.109114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:50.122624 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-acf186bc-72dc-42e3-82d3-abfae7683703 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1401 microversion: 2.1 time: 0.434754 Apr 09 21:06:50.123347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1743/3519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:49 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1401 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:50.262497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-328113a7-ca97-4c36-ab7f-7dc7b227faa3 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08f1614c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1536563408", "description": "tempest-description-820949107"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:50.405753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.processutils [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcs9e36oo/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcs9e36oo/temp.key -subj /CN=e8f139c65a434c5c815998553b0dddc8 -extensions v3_req_client" returned: 0 in 0.369s {{(pid=141818) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:06:50.407232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.processutils [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcs9e36oo/temp.key -password pass: {{(pid=141818) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:06:50.432957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.processutils [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcs9e36oo/temp.key -password pass:" returned: 0 in 0.025s {{(pid=141818) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:06:50.454036 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-328113a7-ca97-4c36-ab7f-7dc7b227faa3 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.322016 Apr 09 21:06:50.455181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1744/3520] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:50.460192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:50.461221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:50.469262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.469844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.470853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.471288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.494796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:06:50.500916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Getting quotas for user e8f139c65a434c5c815998553b0dddc8 and project ec920d3f032a48b4b57ca7e343c18e3f. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:06:50.518408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4229a697-54a9-4710-865b-025dbef55b0b tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.545422 Apr 09 21:06:50.519782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1777/3521] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Apr 9 21:06:49 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 547 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:50.525912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:50.527477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:50.535135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.535701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.536577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.537008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.654997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:50.665773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eede2c95-9380-4398-8d52-8d8a45ec45b0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.208501 Apr 09 21:06:50.676844 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1745/3522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:50 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:50.682288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:50.683095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:50.690750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.691422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.692389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.693142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.705243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:50.718054 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ecf01fd6-ac0e-4004-9167-e44009708dad tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.196697 Apr 09 21:06:50.719134 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1778/3523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:50 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:50.724023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-855f0f7b-6d1c-422e-91c1-5f4e8b986c4c tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e154790>, body: {"security_group_rule": {"parent_group_id": "b55318dc-155f-44d3-b12d-03f1b33560f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:50.877738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:50.886452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f0bbcf0-03b6-45a5-9b3a-157779dac09f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.208153 Apr 09 21:06:50.887170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1746/3524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:50 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:50.892296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c6833f7-0194-400a-ba4b-26ba6f3890ec tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08efa2160>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:50.900789 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c6833f7-0194-400a-ba4b-26ba6f3890ec tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1956391263" status: 200 len: 1534 microversion: 2.2 time: 0.012611 Apr 09 21:06:50.901910 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1747/3525] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Apr 9 21:06:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1956391263 => generated 1534 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:50.906311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:50.907294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:50.913787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.914247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:50.915090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:50.915829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.063629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-855f0f7b-6d1c-422e-91c1-5f4e8b986c4c tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.343196 Apr 09 21:06:51.064308 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1779/3526] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:51.071188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-760a4fb7-7426-4132-8216-62c5cc7a6f01 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08e154280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:51.074232 ncdv-master-1 devstack@n-api.service[141818]: WARNING oslo_db.sqlalchemy.utils [None req-760a4fb7-7426-4132-8216-62c5cc7a6f01 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 09 21:06:51.079790 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-760a4fb7-7426-4132-8216-62c5cc7a6f01 tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014467 Apr 09 21:06:51.080587 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1780/3527] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Apr 9 21:06:51 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:51.085165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9fe15940-4c04-4237-9edf-8e5dccff8b0c tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e2bc790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1433768086", "description": "tempest-description-657566578"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:51.097369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:51.107494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69d40414-f9d4-4f0d-ab9e-6783afa05ce3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.204378 Apr 09 21:06:51.108582 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1748/3528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:50 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:51.115639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9edbbd25-3753-4d29-a7c6-47b05d9188ee tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] Calling method '.version_select at 0x7fb08eccca60>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:51.135728 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9edbbd25-3753-4d29-a7c6-47b05d9188ee tempest-KeyPairsV22TestJSON-1189428446 tempest-KeyPairsV22TestJSON-1189428446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956391263" status: 204 len: 0 microversion: 2.2 time: 0.025677 Apr 09 21:06:51.136701 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1749/3529] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Apr 9 21:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956391263 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:51.146272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:51.146895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:51.153167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.153709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.154633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.154929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.278189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9fe15940-4c04-4237-9edf-8e5dccff8b0c tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.196233 Apr 09 21:06:51.284557 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1781/3530] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:51.298189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b108ee66-1d1b-4cfd-a52d-6f40f5afc10f tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e1bcca0>, body: {"security_group_rule": {"parent_group_id": "cc0a278c-9dab-4c9f-86ca-b717211cdf45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:51.388011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:51.399919 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9a730c85-9db4-4403-9315-abb5c6826ec3 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1589 microversion: 2.1 time: 0.257339 Apr 09 21:06:51.411473 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1750/3531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:51 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1589 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:51.418088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:51.418917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:51.431976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.432436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.436595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.436595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.563217 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-763ba619-43e9-41c7-9002-858e970eaf49 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150000 Apr 09 21:06:51.564346 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1751/3532] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:06:51 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:51.571357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-720884e9-3fff-4a42-b0b0-3dea82a3093b req-b3e98c7f-4b1f-4af2-b82d-b5a5c115a59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe417324-1de0-45c0-876b-2032e5ce27da", "name": "network-vif-plugged", "status": "completed", "tag": "79b55d78-e389-4ada-a99b-e6ba587d7c29"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:51.586470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-720884e9-3fff-4a42-b0b0-3dea82a3093b req-b3e98c7f-4b1f-4af2-b82d-b5a5c115a59c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.587030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-720884e9-3fff-4a42-b0b0-3dea82a3093b req-b3e98c7f-4b1f-4af2-b82d-b5a5c115a59c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.610026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-720884e9-3fff-4a42-b0b0-3dea82a3093b req-b3e98c7f-4b1f-4af2-b82d-b5a5c115a59c service nova] Creating event network-vif-plugged:79b55d78-e389-4ada-a99b-e6ba587d7c29 for instance fe417324-1de0-45c0-876b-2032e5ce27da on nch1-master-1 Apr 09 21:06:51.614955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-720884e9-3fff-4a42-b0b0-3dea82a3093b req-b3e98c7f-4b1f-4af2-b82d-b5a5c115a59c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048167 Apr 09 21:06:51.616001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1752/3533] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:51.626802 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b108ee66-1d1b-4cfd-a52d-6f40f5afc10f tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.339425 Apr 09 21:06:51.627539 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1782/3534] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:51 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:51.642465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d55cb4c-ebe9-4c7b-b336-f3de19231743 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08ec02dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-122186254", "description": "tempest-description-585874626"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:51.685882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:51.687309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:51.702242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.703059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:51.704321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:51.705056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.026076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:52.035479 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad64a276-877d-4d9e-ae49-169e3056f0a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.355335 Apr 09 21:06:52.045758 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1783/3535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:51 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:52.049478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:52.050324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:52.057913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.058279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.059138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.060052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.068195 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d55cb4c-ebe9-4c7b-b336-f3de19231743 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.431207 Apr 09 21:06:52.069188 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1753/3536] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:52.086889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:52.088059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:52.106896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.107495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.108297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.109131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.305649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:52.318141 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86266158-6d6f-4573-9907-6d3b2dd95376 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.280527 Apr 09 21:06:52.318695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1784/3537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:52 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:52.328453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b5d9fb2-1e07-41dd-8725-dc993ade5db2 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e49ff70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1069893754", "description": "tempest-description-617105054"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:52.378188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:52.389917 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d7d3eac-4de2-4d2f-87a8-aee18f186ad1 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.317766 Apr 09 21:06:52.397184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1754/3538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:52 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:52.406524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:52.408629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:52.416337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.417135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.418538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:52.419160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:52.619648 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b5d9fb2-1e07-41dd-8725-dc993ade5db2 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.299448 Apr 09 21:06:52.620597 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1785/3539] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:52.644733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75a232af-fc8a-497e-bf96-9c07a39b590b tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e2bca60>, body: {"security_group_rule": {"parent_group_id": "3931e5be-5ecb-4001-bc05-7fe2aaa05e33", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ae18b0ca-7067-4910-9005-55e0b1c76197"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:52.652184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:52.661799 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f62c37be-8b22-427a-a909-6cc18eb32449 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.262693 Apr 09 21:06:52.663277 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1755/3540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:52 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:52.955614 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75a232af-fc8a-497e-bf96-9c07a39b590b tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.327230 Apr 09 21:06:52.957277 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1786/3541] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:52 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:52.973619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9983295c-7a72-4846-916d-097d1cb1b44e tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08f1c2a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-551796184", "description": "tempest-description-522725965"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:53.055737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:53.056479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:53.071890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.075460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.076615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.078837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.271549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9983295c-7a72-4846-916d-097d1cb1b44e tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.305888 Apr 09 21:06:53.273075 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1756/3542] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:53.284775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e4f7d75-c7a0-45b4-a9a7-ad46e3d2001d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08eccc550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1626822398", "description": "tempest-description-1665110090"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:53.359767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:53.367398 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3731e3f6-36ad-46b3-853f-43db32a8477e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1317 microversion: 2.1 time: 0.318701 Apr 09 21:06:53.368399 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1787/3543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:53 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:06:53.374593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:53.376614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:53.399398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.400595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.402264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.403805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.619019 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e4f7d75-c7a0-45b4-a9a7-ad46e3d2001d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.338617 Apr 09 21:06:53.619631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1757/3544] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:53 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:53.624866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-99c1b5a9-c999-4172-b3d2-6715604e2792 req-18191d50-6db7-4e61-ad98-e901a557e309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcefe5-59b3-4919-b321-cbcb7a47e014", "tag": "0e43d1e5-8511-4e37-ac37-577627349f47"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:53.642748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:53.644980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-99c1b5a9-c999-4172-b3d2-6715604e2792 req-18191d50-6db7-4e61-ad98-e901a557e309 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.645468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-99c1b5a9-c999-4172-b3d2-6715604e2792 req-18191d50-6db7-4e61-ad98-e901a557e309 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.656076 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a03ee02-3ca3-4ed4-9398-db413aea6b84 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1589 microversion: 2.1 time: 0.285932 Apr 09 21:06:53.658337 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1788/3545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:53 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1589 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:53.678292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:53.679168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:53.682680 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-99c1b5a9-c999-4172-b3d2-6715604e2792 req-18191d50-6db7-4e61-ad98-e901a557e309 service nova] Creating event network-changed:0e43d1e5-8511-4e37-ac37-577627349f47 for instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 on nch2-master-1 Apr 09 21:06:53.688851 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-99c1b5a9-c999-4172-b3d2-6715604e2792 req-18191d50-6db7-4e61-ad98-e901a557e309 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067260 Apr 09 21:06:53.690338 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1758/3546] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:53.694444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.694914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.696675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.698987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.699326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:53.700152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:53.710719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.711622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:53.712568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:53.713217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.084405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:54.093542 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-945f6da2-53e1-4786-a093-59f34cb02088 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.432683 Apr 09 21:06:54.103143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1789/3547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:53 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:54.112752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a57e04c-4d12-4ffa-8c6f-1acb4272e9f7 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e2bc310>, body: {"security_group_rule": {"parent_group_id": "f6d20cd3-79ef-4c50-b582-d674a506907e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bb39b994-bbc3-499f-8473-332e1b283e93"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:54.211821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:54.221976 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-690b5241-0ac4-476c-bc04-b711a6ba83af tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.529763 Apr 09 21:06:54.233326 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1759/3548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:53 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:54.239572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6dca63f4-ebd0-4f41-b51e-5cdb2964182f req-3d712079-1142-4217-b4df-c76e333930e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103c226-e4d1-42eb-a8c0-4a9f4d34daf3", "name": "network-vif-plugged", "status": "completed", "tag": "61bb000c-8420-4fc7-8f3f-a1f3d9041c97"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:54.248955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6dca63f4-ebd0-4f41-b51e-5cdb2964182f req-3d712079-1142-4217-b4df-c76e333930e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:54.249429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6dca63f4-ebd0-4f41-b51e-5cdb2964182f req-3d712079-1142-4217-b4df-c76e333930e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.264583 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6dca63f4-ebd0-4f41-b51e-5cdb2964182f req-3d712079-1142-4217-b4df-c76e333930e9 service nova] Creating event network-vif-plugged:61bb000c-8420-4fc7-8f3f-a1f3d9041c97 for instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 on nch2-master-1 Apr 09 21:06:54.271350 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6dca63f4-ebd0-4f41-b51e-5cdb2964182f req-3d712079-1142-4217-b4df-c76e333930e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 Apr 09 21:06:54.272614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1760/3549] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:54.278199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:54.280396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:54.287665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:54.288357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.289343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:54.290273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.653178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:54.662606 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-09348d55-357f-4551-9b51-cc972aba8351 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.388560 Apr 09 21:06:54.663466 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1761/3550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:54 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:54.668403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:54.669015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:54.675198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:54.675657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.676605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:54.677093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:54.905898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a57e04c-4d12-4ffa-8c6f-1acb4272e9f7 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.801524 Apr 09 21:06:54.906547 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1790/3551] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:54.917394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a95430e-a3a7-4360-9bcd-1d2d0382050b tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e24fdc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:54.982309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:54.993154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a7314b0a-0ff0-4210-bd62-32500540e3a0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1506 microversion: 2.1 time: 0.328161 Apr 09 21:06:54.994192 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1762/3552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:54 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:55.014158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:55.014708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:55.026157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.027092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.030351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.031321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.062959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:06:55.203322 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b103100d-31b8-41df-a460-c8da7118ac50 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 204 len: 0 microversion: 2.1 time: 0.194002 Apr 09 21:06:55.203957 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1763/3553] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:06:55 2022] DELETE /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:06:55.209678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:55.210391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:55.223897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.225609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.226986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.229111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.244831 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a95430e-a3a7-4360-9bcd-1d2d0382050b tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bb39b994-bbc3-499f-8473-332e1b283e93" status: 202 len: 0 microversion: 2.1 time: 0.331706 Apr 09 21:06:55.246091 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1791/3554] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:06:54 2022] DELETE /compute/v2.1/os-security-groups/bb39b994-bbc3-499f-8473-332e1b283e93 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:55.251541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:55.252649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:55.267208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.272504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.273659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:55.274604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:55.961350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:55.970931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4e15e9fb-07b6-4c98-94d9-3351794afa88 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1318 microversion: 2.1 time: 0.765489 Apr 09 21:06:55.982380 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1764/3555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:55 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:55.986365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:55.987195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:56.001462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:56.002141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:56.003091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:56.003679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:56.016871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:56.034992 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb4b72f3-974c-4174-8537-5bc3a0ae990a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1512 microversion: 2.1 time: 0.787594 Apr 09 21:06:56.045071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1792/3556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:55 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1512 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:56.045640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ebf9712-bbe6-4c19-b7be-8f18492421c5 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e255430>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:56.176965 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ebf9712-bbe6-4c19-b7be-8f18492421c5 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/f6d20cd3-79ef-4c50-b582-d674a506907e" status: 200 len: 246 microversion: 2.1 time: 0.137930 Apr 09 21:06:56.178052 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1793/3557] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:06:56 2022] GET /compute/v2.1/os-security-groups/f6d20cd3-79ef-4c50-b582-d674a506907e => generated 246 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:56.186813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:56.187492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:56.195742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:56.196365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:56.198199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:56.198780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:56.225280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:56.234310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-064d0bed-7941-4c2f-ae7c-1dedce6c8a26 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.258237 Apr 09 21:06:56.235090 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1765/3558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:55 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:56.240073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-08d8bd84-f989-434d-9883-6972960ceebd tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08edeba60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-471853542", "description": "tempest-description-10404443"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:56.414994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:56.429756 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b88637b-9c13-45a6-bd18-a934c6b17161 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1507 microversion: 2.1 time: 0.249661 Apr 09 21:06:56.430753 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1794/3559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:56 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:56.533270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-08d8bd84-f989-434d-9883-6972960ceebd tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.296812 Apr 09 21:06:56.534236 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1766/3560] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Apr 9 21:06:56 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:56.548440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d88a56b-b7a4-4060-b66d-1f3a47e38a37 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08e49fd30>, body: {"security_group_rule": {"parent_group_id": "7bf7fdd2-d608-4b70-b6ff-a503c999b766", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:56.806418 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2d88a56b-b7a4-4060-b66d-1f3a47e38a37 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.264147 Apr 09 21:06:56.812535 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1795/3561] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:56.818212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d9c918f-4696-474a-83c8-a0f960911334 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Action: 'create', calling method: .version_select at 0x7fb08eccc310>, body: {"security_group_rule": {"parent_group_id": "7bf7fdd2-d608-4b70-b6ff-a503c999b766", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:56.990906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:56.991594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:57.008312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.008769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.009604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.010052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.346197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:57.357497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c188db7-da25-4337-9b2c-e3d9fd623404 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1507 microversion: 2.1 time: 0.371150 Apr 09 21:06:57.372715 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1796/3562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:56 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:57.383722 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d9c918f-4696-474a-83c8-a0f960911334 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.569935 Apr 09 21:06:57.384670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1767/3563] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Apr 9 21:06:56 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:06:57.389778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:57.390615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:57.396079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:57.396669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:57.405759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.406293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.407011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.407454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.423713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.427979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.429455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.436748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.766318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:57.777145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53781713-70bc-46b6-b07d-7406b18bad2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 200 len: 1512 microversion: 2.1 time: 0.402579 Apr 09 21:06:57.780141 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1797/3564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:57 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:57.792650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:57.797101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:57.809424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.810740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:57.813198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:57.814748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.001666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:58.021616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f2454ef-0163-4a42-92f2-afed33d17a5c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.635155 Apr 09 21:06:58.024024 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1768/3565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:57 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:58.058174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-76db67d5-d865-489a-b7c9-747fd39afabb tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08ecccee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:58.223836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-76db67d5-d865-489a-b7c9-747fd39afabb tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/7bf7fdd2-d608-4b70-b6ff-a503c999b766" status: 200 len: 662 microversion: 2.1 time: 0.195355 Apr 09 21:06:58.224598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1769/3566] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:06:58 2022] GET /compute/v2.1/os-security-groups/7bf7fdd2-d608-4b70-b6ff-a503c999b766 => generated 662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:58.236197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:58.242565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:58.248574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:58.256678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73d58534-2bd3-42a0-9278-f7c8057776fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1507 microversion: 2.1 time: 0.474812 Apr 09 21:06:58.257307 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1798/3567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:57 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:58.274238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.276058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-11107578-1df0-482b-bc88-fc2ef6711cdb req-1487902c-f5dd-4c9a-b8e3-d4ff6289c0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe417324-1de0-45c0-876b-2032e5ce27da", "name": "network-vif-deleted", "tag": "79b55d78-e389-4ada-a99b-e6ba587d7c29"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:58.277013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.278653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.279452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.294098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-11107578-1df0-482b-bc88-fc2ef6711cdb req-1487902c-f5dd-4c9a-b8e3-d4ff6289c0da service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.294929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-11107578-1df0-482b-bc88-fc2ef6711cdb req-1487902c-f5dd-4c9a-b8e3-d4ff6289c0da service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.324600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-11107578-1df0-482b-bc88-fc2ef6711cdb req-1487902c-f5dd-4c9a-b8e3-d4ff6289c0da service nova] Creating event network-vif-deleted:79b55d78-e389-4ada-a99b-e6ba587d7c29 for instance fe417324-1de0-45c0-876b-2032e5ce27da on nch1-master-1 Apr 09 21:06:58.336971 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-11107578-1df0-482b-bc88-fc2ef6711cdb req-1487902c-f5dd-4c9a-b8e3-d4ff6289c0da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078396 Apr 09 21:06:58.344272 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1799/3568] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:06:58.365215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7308705e-88c7-47c1-b9a6-4c4c4f37ce28 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e4803a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:58.595013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:58.615039 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b95dcd73-4e96-4842-8529-07ff59938f50 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1528 microversion: 2.1 time: 0.382436 Apr 09 21:06:58.617603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1770/3569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:58 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1528 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:58.637471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:58.641823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:58.652652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.653135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.658204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.659131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.699727 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7308705e-88c7-47c1-b9a6-4c4c4f37ce28 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/99989877-897f-4f55-ae22-87c41b46efdb" status: 202 len: 0 microversion: 2.1 time: 0.353706 Apr 09 21:06:58.700625 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1800/3570] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Apr 9 21:06:58 2022] DELETE /compute/v2.1/os-security-group-rules/99989877-897f-4f55-ae22-87c41b46efdb => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:58.710058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc962b0f-4af1-47a0-8f07-cea3b363f5ac tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08ec36940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:58.766416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9fbf4e1c-c2c1-477a-adce-dccf4784bc1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "PUT /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1079 microversion: 2.1 time: 0.141968 Apr 09 21:06:58.767563 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1771/3571] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:06:58 2022] PUT /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1079 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:58.785796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:58.786956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:58.797736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.800773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:58.801805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:58.802264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.033511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:59.045714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28cfbe84-ce66-41f7-8c12-4b20d7877f99 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1505 microversion: 2.1 time: 0.267318 Apr 09 21:06:59.058137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc962b0f-4af1-47a0-8f07-cea3b363f5ac tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7bf7fdd2-d608-4b70-b6ff-a503c999b766" status: 202 len: 0 microversion: 2.1 time: 0.351937 Apr 09 21:06:59.062480 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1801/3572] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:06:58 2022] DELETE /compute/v2.1/os-security-groups/7bf7fdd2-d608-4b70-b6ff-a503c999b766 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:06:59.067448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1772/3573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:58 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:59.070030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.071032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.092168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.092926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.094082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.095138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.107435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.110784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.123080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.123779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.124717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.125403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.129588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. Apr 09 21:06:59.130422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:59.131447 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5b4ad37-f490-458f-a98a-0e81fa146d69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 404 len: 111 microversion: 2.1 time: 0.067578 Apr 09 21:06:59.132163 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1802/3574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:59 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:59.143373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.144340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.156598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.164973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.166762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.173901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.400998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:59.410001 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b1a41b44-a9cd-45f8-8c0b-42145819863a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.341148 Apr 09 21:06:59.410612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1773/3575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:59 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:59.433141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:59.440546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb095458dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.448731 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d0d8ef3f-c7f4-459a-9799-5dbdcc0f53aa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1505 microversion: 2.1 time: 0.310855 Apr 09 21:06:59.449636 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1803/3576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:59 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:59.469785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.470788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.484486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.484942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.487144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.488561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.511446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG neutronclient.v2_0.client [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb39b994-bbc3-499f-8473-332e1b283e93 does not exist", "detail": ""}} {{(pid=141819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 09 21:06:59.512125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.security_group_api [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Neutron security group bb39b994-bbc3-499f-8473-332e1b283e93 not found {{(pid=141819) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 09 21:06:59.512721 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] HTTP exception thrown: Security group bb39b994-bbc3-499f-8473-332e1b283e93 does not exist Apr 09 21:06:59.512721 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-a6b58c54-e235-4d1c-8e7c-13162c6defe0'] Apr 09 21:06:59.513588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Returning 404 to user: Security group bb39b994-bbc3-499f-8473-332e1b283e93 does not exist Apr 09 21:06:59.513588 ncdv-master-1 devstack@n-api.service[141819]: Neutron server returns request_ids: ['req-a6b58c54-e235-4d1c-8e7c-13162c6defe0'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:06:59.514530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0c1d4b54-9d6a-4043-80f1-7e072066b41d tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bb39b994-bbc3-499f-8473-332e1b283e93" status: 404 len: 194 microversion: 2.1 time: 0.102996 Apr 09 21:06:59.515184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1774/3577] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:06:59 2022] DELETE /compute/v2.1/os-security-groups/bb39b994-bbc3-499f-8473-332e1b283e93 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:06:59.524065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:06:59.525702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.551615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.552283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.553302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.554045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.701244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:06:59.716555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:06:59.717606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:06:59.718174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:06:59.720723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:06:59.776531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:06:59.789099 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14e647ad-26df-477a-8364-5185439963f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.333403 Apr 09 21:06:59.790238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1804/3578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:06:59 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:06:59.807646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c760ec6-dc6d-4294-a8ab-1a49ab9abfcb tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08ec36670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:06:59.897687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:06:59.915979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.917529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:06:59.918682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:06:59.919333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.007867 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4cfde81-bff4-471c-97a5-fcb0973265b6 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "POST /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3/action" status: 202 len: 1111 microversion: 2.1 time: 0.488286 Apr 09 21:07:00.009435 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1775/3579] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:06:59 2022] POST /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3/action => generated 1111 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 09 21:07:00.014530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:00.015447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:00.034447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.035299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.036319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.036969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.424854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c760ec6-dc6d-4294-a8ab-1a49ab9abfcb tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/f6d20cd3-79ef-4c50-b582-d674a506907e" status: 202 len: 0 microversion: 2.1 time: 0.633306 Apr 09 21:07:00.425494 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1805/3580] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:06:59 2022] DELETE /compute/v2.1/os-security-groups/f6d20cd3-79ef-4c50-b582-d674a506907e => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:00.431593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:00.433113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:00.446160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.448232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.449539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.451842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.471506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:00.502457 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48f50d60-4595-44e7-bc99-d265761256f5 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.491521 Apr 09 21:07:00.502999 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1776/3581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:00 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:00.509348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0098a641-831b-4eec-8ddc-1e81a01f6c7f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:00.512605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0098a641-831b-4eec-8ddc-1e81a01f6c7f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:00.513882 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0098a641-831b-4eec-8ddc-1e81a01f6c7f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009778 Apr 09 21:07:00.514442 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1777/3582] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:00 2022] POST /compute/v2.1/servers => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:00.637456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:00.650577 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b08db9dd-3617-4f0c-ba9e-566008c90462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.223810 Apr 09 21:07:00.651364 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1806/3583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:00 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:00.658024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:00.658862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:00.666241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.667042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.667906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.668870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.685711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Action: 'create', calling method: .version_select at 0x7fb08efc2ee0>, body: {"keypair": {"name": "tempest-keypair-145365121"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:00.700901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:00.706319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for user 918209191d2a40e5a996bb469bc26b4f and project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:00.819530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:00.837405 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9dc9208b-8a1e-4fb3-a35f-c52818e78cb3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.184399 Apr 09 21:07:00.838652 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1807/3584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:00 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:00.844165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b024443c-a51a-4c3d-8bec-fd1607f59686 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e154e50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:00.882751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:00.891036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for user 918209191d2a40e5a996bb469bc26b4f and project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:00.908226 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea076e24-89b8-4359-9043-b556d9a7ace4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.388523 Apr 09 21:07:00.914849 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1778/3585] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:07:00 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:00.923378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:00.924189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:00.931223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.931898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:00.932880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:00.933534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:01.174049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:01.186813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-573f7c3f-e741-448a-ab9e-106280a2e7f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.269942 Apr 09 21:07:01.188057 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1779/3586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:00 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:01.204999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:01.205873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:01.216988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:01.217712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:01.218665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:01.219106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:01.355870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b024443c-a51a-4c3d-8bec-fd1607f59686 tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ae18b0ca-7067-4910-9005-55e0b1c76197" status: 202 len: 0 microversion: 2.1 time: 0.515843 Apr 09 21:07:01.356898 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1808/3587] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:07:00 2022] DELETE /compute/v2.1/os-security-groups/ae18b0ca-7067-4910-9005-55e0b1c76197 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:01.365586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6b5689b-ba45-48ba-a9e8-28b1ce4682bc tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e480550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:01.532546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:01.543183 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b6c45c3-f259-4574-ab56-48845e1d493f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.340085 Apr 09 21:07:01.549115 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1780/3588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:01 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:01.568869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:01.571908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:01.595382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:01.596004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:01.597202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:01.602094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.094993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:02.102661 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6b5689b-ba45-48ba-a9e8-28b1ce4682bc tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3931e5be-5ecb-4001-bc05-7fe2aaa05e33" status: 202 len: 0 microversion: 2.1 time: 0.740901 Apr 09 21:07:02.103275 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1809/3589] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:07:01 2022] DELETE /compute/v2.1/os-security-groups/3931e5be-5ecb-4001-bc05-7fe2aaa05e33 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:07:02.110686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:02.111317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:02.113078 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5b6e623-19e9-4b1b-8ef6-eeddd6ce503f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.561149 Apr 09 21:07:02.124520 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1781/3590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:01 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:02.132390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:02.133284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:02.141311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:02.141773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.146994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:02.147593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.149808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:02.150438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.152189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:02.152706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.553776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:02.575156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-659f639c-6326-47ba-8fca-a9c718e460f3 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.448958 Apr 09 21:07:02.589754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1782/3591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:02 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:02.591924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f66924d9-a4cc-42bb-bbfa-b8a5d99452c6 req-797ffcfe-f45c-41ea-a5f2-b4a5a92ded6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af9a8-cb98-49e4-b5f7-b53121790a25", "name": "network-vif-plugged", "status": "completed", "tag": "d3221b95-beb4-4b92-b232-c7521907646e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:02.593986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:02.605473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f66924d9-a4cc-42bb-bbfa-b8a5d99452c6 req-797ffcfe-f45c-41ea-a5f2-b4a5a92ded6b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:02.606140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f66924d9-a4cc-42bb-bbfa-b8a5d99452c6 req-797ffcfe-f45c-41ea-a5f2-b4a5a92ded6b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:02.623514 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-368cc642-8e21-410e-b688-e00d571d9786 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.515338 Apr 09 21:07:02.625025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1810/3592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:02 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:02.626131 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f66924d9-a4cc-42bb-bbfa-b8a5d99452c6 req-797ffcfe-f45c-41ea-a5f2-b4a5a92ded6b service nova] Creating event network-vif-plugged:d3221b95-beb4-4b92-b232-c7521907646e for instance 276af9a8-cb98-49e4-b5f7-b53121790a25 on nch1-master-1 Apr 09 21:07:02.633417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f66924d9-a4cc-42bb-bbfa-b8a5d99452c6 req-797ffcfe-f45c-41ea-a5f2-b4a5a92ded6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050424 Apr 09 21:07:02.633826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4045b9ef-f652-4939-8ed2-87d60b5cf48a tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08e480b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:02.634819 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1783/3593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:02.970768 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4045b9ef-f652-4939-8ed2-87d60b5cf48a tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cc0a278c-9dab-4c9f-86ca-b717211cdf45" status: 202 len: 0 microversion: 2.1 time: 0.343261 Apr 09 21:07:02.972752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1811/3594] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:07:02 2022] DELETE /compute/v2.1/os-security-groups/cc0a278c-9dab-4c9f-86ca-b717211cdf45 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:02.985211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00901f76-22ff-4d39-819b-8067b066a86e tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] Calling method '.version_select at 0x7fb08ec02a60>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:03.130159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:03.131451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:03.142379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.144565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:03.147217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.149909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:03.514039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:03.529122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99ca521e-acc0-4b36-bf51-521db64dd2cb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.403095 Apr 09 21:07:03.538609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1812/3595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:03 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:03.548405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97b87d1c-beb0-4b37-9639-27e3de0d3ccf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1749201249", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9612699b-0256-46d7-9683-7562f3c0f614", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:03.574241 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00901f76-22ff-4d39-819b-8067b066a86e tempest-SecurityGroupRulesTestJSON-1997741036 tempest-SecurityGroupRulesTestJSON-1997741036-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/b55318dc-155f-44d3-b12d-03f1b33560f4" status: 202 len: 0 microversion: 2.1 time: 0.596750 Apr 09 21:07:03.576571 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1784/3596] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:07:02 2022] DELETE /compute/v2.1/os-security-groups/b55318dc-155f-44d3-b12d-03f1b33560f4 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:03.599387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:03.600470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:03.619030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.619940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:03.621137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.623968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:03.687940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-97b87d1c-beb0-4b37-9639-27e3de0d3ccf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Block Device 9612699b-0256-46d7-9683-7562f3c0f614 is not bootable. Apr 09 21:07:03.688817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97b87d1c-beb0-4b37-9639-27e3de0d3ccf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Block Device 9612699b-0256-46d7-9683-7562f3c0f614 is not bootable. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:03.689869 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97b87d1c-beb0-4b37-9639-27e3de0d3ccf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.147629 Apr 09 21:07:03.694217 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1813/3597] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:03.703609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:03.704472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:03.711822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.712534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:03.713533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:03.714128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.052609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:04.053659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:04.061274 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-815522ca-5aa4-45d2-9ec9-777823cc285c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.365659 Apr 09 21:07:04.070470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5351f51a-7e5f-47a6-a19a-f00809530f3e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.471246 Apr 09 21:07:04.070470 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1785/3598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:03 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:04.081676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:04.083005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:04.088663 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1814/3599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:03 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:04.101994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.103651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.105894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.107458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.151106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "dfcd25d5-b119-476b-a6d5-dba89dc5a299"}], "security_groups": [{"name": "tempest-securitygroup--204313461"}], "key_name": "tempest-keypair-145365121", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:04.397933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] validate_networks() for [('dfcd25d5-b119-476b-a6d5-dba89dc5a299', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:04.427915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:04.439209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3702a1b5-86cb-475a-a853-65fa9b1f41f5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.368735 Apr 09 21:07:04.445010 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1786/3600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:04 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:04.463009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:04.463940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:04.484123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.484603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.487577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.488066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.711927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:04.738093 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3459ee37-d024-4606-8b0d-a84c948d2a08 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.271365 Apr 09 21:07:04.752765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1787/3601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:04 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:04.764325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:04.766517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:04.780303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.783947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:04.788233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:04.789577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.386205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:05.408781 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b90741f1-ae2e-46c7-9966-ebf3f732c4d9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.654571 Apr 09 21:07:05.412409 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1788/3602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:04 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:05.429564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:05.430085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:05.449383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.449852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.450692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.451302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.766795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:05.768073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:05.768705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:05.769580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:05.770942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:05.795361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:05.807491 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65c0698c-0a63-43bd-8eed-c597d5baccb6 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.392657 Apr 09 21:07:05.809141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.810078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.812227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.812619 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1789/3603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:05 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:05.814157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.820907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:05.838861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:05.855449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.860447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.861853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:05.862903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:05.890440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:05.904373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Getting quotas for user 918209191d2a40e5a996bb469bc26b4f and project c950fe626e0b4d1a88be8c0943fe3965. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:05.943783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:07:05.946278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:07:06.066940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af3f8174-86a8-4e38-a2b6-ad2582de43df tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.918821 Apr 09 21:07:06.068391 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1815/3604] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:07:06.083452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cee729db-c44a-4d73-817d-102c9f5dc7a0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:06.084190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cee729db-c44a-4d73-817d-102c9f5dc7a0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:06.168910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cee729db-c44a-4d73-817d-102c9f5dc7a0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:06.189810 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cee729db-c44a-4d73-817d-102c9f5dc7a0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1225 microversion: 2.1 time: 0.114832 Apr 09 21:07:06.192280 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1816/3605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:06 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:06.209352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:06.219788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca37693b-8e44-4d64-ba6c-ca473b74e326 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.403456 Apr 09 21:07:06.230903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1790/3606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:05 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:06.436670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:06.440688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:06.456315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.457337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:06.458600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.459250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:06.662723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7be40b1-2dcb-48ba-8075-610dc6acd62b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-407883798", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "destination_type": "local"}, {"source_type": "volume", "uuid": "79325784-0b89-4f9d-b167-92b7b7ce911a", "destination_type": "invalid"}], "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:06.690211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7be40b1-2dcb-48ba-8075-610dc6acd62b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:06.692523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7be40b1-2dcb-48ba-8075-610dc6acd62b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.042027 Apr 09 21:07:06.694733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1791/3607] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:06 2022] POST /compute/v2.1/servers => generated 155 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:06.717100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:06.719361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:06.743113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.744573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:06.746535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.749818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:06.905284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:06.920418 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22f54149-8be0-4bb7-9402-4da0b9341a9e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.492470 Apr 09 21:07:06.923864 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1817/3608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:06 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:06.929944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:06.930873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:06.949136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.949949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:06.957001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:06.957518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.163800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:07.184599 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f22fdab2-7020-42fa-b8e4-ca9c0f0fa1b6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.485548 Apr 09 21:07:07.187087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1792/3609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:06 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:07.210196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:07.215686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:07.234488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.235918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.238173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.241117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.280553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:07.298596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b6d7f398-739e-4a36-ba91-355ff703fcff tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.373052 Apr 09 21:07:07.305323 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1818/3610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:06 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:07.305323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:07.305916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:07.315218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.315841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.317277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.319000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.440421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:07.462746 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a4bc8d0-d737-402c-aaa9-02534ca97fbf tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1221 microversion: 2.1 time: 0.159062 Apr 09 21:07:07.466509 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1819/3611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:07 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:07.479372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:07.481182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:07.486665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:07.496882 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-212e5c5c-dea3-4f1a-bde5-7ebd0bdb8640 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.292913 Apr 09 21:07:07.505257 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1793/3612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:07 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:07.505448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.505448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.505448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.505448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.680618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5af9a68-0db0-4633-9e3d-e72ead3e79a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-73531515", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:07.682577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5af9a68-0db0-4633-9e3d-e72ead3e79a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:07.683939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5af9a68-0db0-4633-9e3d-e72ead3e79a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008818 Apr 09 21:07:07.685208 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1794/3613] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:07 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:07.694621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:07.695618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:07.710822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.711670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.712821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.713564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.779450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:07.800143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d511aa3-d381-404c-8447-8615a7656554 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.331201 Apr 09 21:07:07.806592 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1820/3614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:07 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:07.945829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:07.947356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:07.960494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.963799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:07.965423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:07.966415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.118559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:08.139951 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef1d0d32-86f3-4ac9-ac1f-f20cf7ecb686 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.444802 Apr 09 21:07:08.141726 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1795/3615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:07 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:08.161015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:08.162148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:08.170381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.171490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.172603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.173362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.316282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:08.335890 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-47563185-8821-489f-9a28-86ca46c6b7bc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.390524 Apr 09 21:07:08.337612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1821/3616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:07 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:08.352108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:08.352880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:08.372539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.372933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.374102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.374582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.465163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:08.479289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d1bea51-b910-4fa9-b3f8-0986c6c745f6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.322206 Apr 09 21:07:08.481396 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1796/3617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:08 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:08.491396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:08.494222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:08.518917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.529318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.530181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.530619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.706376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:08.719257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57d1f770-9967-4e41-a8be-c032ef9e566d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1283 microversion: 2.1 time: 0.236145 Apr 09 21:07:08.736346 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1797/3618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:08 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1283 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:08.750570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0ff0482-6418-4cfa-b54c-6b2e8ff4375a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:08.752310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0ff0482-6418-4cfa-b54c-6b2e8ff4375a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:08.754258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0ff0482-6418-4cfa-b54c-6b2e8ff4375a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016442 Apr 09 21:07:08.759033 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1798/3619] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:08 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:08.782288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:08.783434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:08.797215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.798022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.798869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:08.799489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:08.808317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:08.822157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-974b97cb-5e3c-49f0-8838-c23e79b5fa65 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1510 microversion: 2.1 time: 0.480707 Apr 09 21:07:08.853830 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1822/3620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:08 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:09.037687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:09.038056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1701137521", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "1f49d9ff-2e36-4c07-94e9-e572b9c73515"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:09.047249 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aca33f41-ffb7-4ca6-bea2-188a47b54363 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.286628 Apr 09 21:07:09.048269 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1799/3621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:08 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:09.071539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:09.073010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:09.083235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.084765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:09.088399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.088995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:09.113135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] validate_networks() for [('1f49d9ff-2e36-4c07-94e9-e572b9c73515', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:09.486803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:09.495765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6028d7fa-5ed9-48c7-9a6d-5edc11adb9e2 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.446230 Apr 09 21:07:09.501162 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1800/3622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:09 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:09.501550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:09.502264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:09.513706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.514235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:09.515158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.515666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:09.926535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:09.935189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b342e5bd-0c7b-43b7-b341-91b7229e97a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.437185 Apr 09 21:07:09.938424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1801/3623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:09 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:09.975079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:09.975873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:09.985752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.986528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:09.988172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:09.988864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.525295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:10.526440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:10.527269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:10.528062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:10.528917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:10.543488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.544283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.545580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.546232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.576481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Getting quotas for project 959fb92f2def47deb85d73cc0493c295. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:10.584347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Getting quotas for user 8437faedd74046fc81e05d2dadc1dd3d and project 959fb92f2def47deb85d73cc0493c295. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:10.598410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:07:10.600661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:07:10.614117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:10.622780 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fae1242d-f50b-48e7-80fa-92408902536a tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.668424 Apr 09 21:07:10.624166 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1802/3624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:09 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:10.629459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:10.630598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:10.637325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.638006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.639026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.639998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.676020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e298876e-5c2c-4407-acd3-7364883b7d3a tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.820707 Apr 09 21:07:10.676609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1823/3625] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:07:10.681834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:10.682829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:10.689652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.690417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:10.691399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:10.691841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.071747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.082878 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-559cd2d9-3900-402d-a6fb-f2d4ca0bb67a tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.457347 Apr 09 21:07:11.094406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.099484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1803/3626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:10 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:11.103889 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7138b837-c7d5-41c7-8041-d2e89a5cf4d7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1487 microversion: 2.1 time: 0.425896 Apr 09 21:07:11.104466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-baf01123-0995-4215-9ebc-c1c3f3509713 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-762557774", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": -1, "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:11.119106 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1824/3627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:10 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1487 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:11.124179 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-baf01123-0995-4215-9ebc-c1c3f3509713 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Flavor -1 could not be found. Apr 09 21:07:11.125644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-baf01123-0995-4215-9ebc-c1c3f3509713 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:11.127283 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-baf01123-0995-4215-9ebc-c1c3f3509713 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.026742 Apr 09 21:07:11.128143 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1804/3628] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:11 2022] POST /compute/v2.1/servers => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:11.132388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:11.133026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.137867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:11.138853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.149902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.150356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.151157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.151596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.236553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.248660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.255932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.259115 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a5e479f-aa77-491a-997b-d5ec584021ff tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1259 microversion: 2.21 time: 0.124705 Apr 09 21:07:11.259764 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1805/3629] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:11 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1259 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:11.267891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-709038832"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:11.270066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.277982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.278587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.279943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.280857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.430445 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6076a11-82ad-492c-b774-02831a6730ca tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "PUT /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1059 microversion: 2.1 time: 0.168000 Apr 09 21:07:11.459612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1806/3630] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:07:11 2022] PUT /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1059 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:11.465282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:11.474980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.483301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.484022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.484662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.485077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.635104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.645411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bcb5f933-3801-4234-ac26-148e49448cec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.524821 Apr 09 21:07:11.646768 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1825/3631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:11 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:11.651596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:11.652495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.660640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.661673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.663582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.663582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.951439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:11.962651 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2189902-0d14-404b-aa19-c8d44092c254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.501260 Apr 09 21:07:11.964080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1807/3632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:11 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:11.971469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:11.972461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:11.985688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.986970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:11.988126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:11.988884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.079464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:12.092151 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17a00b84-6ce5-4247-962f-dbf5336f0555 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1486 microversion: 2.1 time: 0.444032 Apr 09 21:07:12.102568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1826/3633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:11 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:12.107853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:12.108701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:12.123521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.124325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.125370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.125994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.614475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:12.622743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2dab6e7d-200e-4a96-be62-b7dadbb381d4 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.657040 Apr 09 21:07:12.623340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1808/3634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:11 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:12.628983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:12.629629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:12.637013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.637013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.639663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.640118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.684204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:12.698053 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8128d4bb-125e-4cc5-a1c4-618702999bdc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.594021 Apr 09 21:07:12.698719 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1827/3635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:12 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:12.713282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:12.713282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:12.722682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.723124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:12.725106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:12.725746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.215853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.226617 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-43579774-1b01-4db9-b861-ade970fadf1d tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.602219 Apr 09 21:07:13.239504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1809/3636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:12 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:13.246024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:13.247163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:13.257921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.258645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.259352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.260549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.261504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.284855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9a7f242-8de5-4adf-affd-bfc576b4aef7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1486 microversion: 2.1 time: 0.584927 Apr 09 21:07:13.285647 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1828/3637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:12 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1486 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:13.292169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-56b1dc31-65c2-40ee-a8c2-849f990e522f req-2541facb-3ae3-4ae7-b198-4c713c8491e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfc1f6b-c179-437c-a528-6b7d93c8091b", "tag": "44e52bdb-7117-4379-a4df-ef7116499a41"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:13.304356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-56b1dc31-65c2-40ee-a8c2-849f990e522f req-2541facb-3ae3-4ae7-b198-4c713c8491e1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.305197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-56b1dc31-65c2-40ee-a8c2-849f990e522f req-2541facb-3ae3-4ae7-b198-4c713c8491e1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.323561 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-56b1dc31-65c2-40ee-a8c2-849f990e522f req-2541facb-3ae3-4ae7-b198-4c713c8491e1 service nova] Creating event network-changed:44e52bdb-7117-4379-a4df-ef7116499a41 for instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b on nch1-master-1 Apr 09 21:07:13.330427 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-56b1dc31-65c2-40ee-a8c2-849f990e522f req-2541facb-3ae3-4ae7-b198-4c713c8491e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042001 Apr 09 21:07:13.332889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1829/3638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:13.345316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:13.348014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:13.361982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.362225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.363036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.363552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.404361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.421705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.423616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.425016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3f32fd5-752e-40f4-bc34-e8858583dbe7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1317 microversion: 2.21 time: 0.184280 Apr 09 21:07:13.425942 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1810/3639] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:13 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:13.432548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3982a95a-52e4-40be-ac2f-f1ad3da58d56 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1130977879", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:13.434450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3982a95a-52e4-40be-ac2f-f1ad3da58d56 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:13.435668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3982a95a-52e4-40be-ac2f-f1ad3da58d56 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008454 Apr 09 21:07:13.439775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1811/3640] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:13 2022] POST /compute/v2.1/servers => generated 145 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:13.448829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:13.449635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:13.461122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.461976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.463175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.464040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.530416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:13.678220 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24744b39-3f22-465c-9c74-68bc404b3a13 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 204 len: 0 microversion: 2.1 time: 0.236576 Apr 09 21:07:13.683458 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1812/3641] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:13 2022] DELETE /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:13.691271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:13.692325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:13.701447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.701650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.702376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.702857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.789295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:13.802108 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd444459-8193-4eb8-bb3e-a2360454f834 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.466859 Apr 09 21:07:13.802916 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1830/3642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:13 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:13.810970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:13.812599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:13.823076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.824888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:13.830214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:13.831298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.046961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.055987 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d98dc55f-5544-42a1-84c8-52555740fd3e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.371074 Apr 09 21:07:14.069294 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1813/3643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:13 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:14.069294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.069294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.094294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.096398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.100461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.101183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.144343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.158915 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e9ad8cb-4e86-4b34-a513-ae83683d1c6d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.353652 Apr 09 21:07:14.161841 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1831/3644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:13 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:14.169249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.172331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.182457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.183030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.183928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.184727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.511804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.529091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd987cfe-724d-400f-8bc5-d7cadcd93928 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1492 microversion: 2.1 time: 0.470557 Apr 09 21:07:14.540305 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1814/3645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1492 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:14.546222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.547116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.558394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.564114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.564550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.569233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.569796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.576144 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-331603ca-9826-4524-98c6-7991d146f505 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.408452 Apr 09 21:07:14.576969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1832/3646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:14.582895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.585180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.601678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.602189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.603347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.603788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.920404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.932260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.942704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.945877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:14.947359 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-333fcf8f-75c2-45c6-9a3a-6265a62939e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.369898 Apr 09 21:07:14.947768 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f820b7c5-e4c5-472a-b5d4-bdfb2ee64bb4 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.403597 Apr 09 21:07:14.958049 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1833/3647] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:14.958981 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1815/3648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:14.961863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0dd0532f-d8d6-45d3-9d28-53606bd1ee1f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2076267280", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:14.965373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0dd0532f-d8d6-45d3-9d28-53606bd1ee1f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Apr 09 21:07:14.965759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.965958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0dd0532f-d8d6-45d3-9d28-53606bd1ee1f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:14.966766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.967165 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0dd0532f-d8d6-45d3-9d28-53606bd1ee1f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017960 Apr 09 21:07:14.971155 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1834/3649] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:14 2022] POST /compute/v2.1/servers => generated 123 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:14.975864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.976021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:14.976365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.976625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:14.977450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.978298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.984084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.984761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:14.986380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:14.987261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.343670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:15.360392 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3de31474-e269-4a37-94f8-9e68269d938e tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.399629 Apr 09 21:07:15.361834 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1816/3650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:15.369115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:15.370441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:15.382709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:15.388489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.390094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.391512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.392309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.395732 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fdcfb10e-9ed6-4f07-9fad-22f6070c3a2a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.423381 Apr 09 21:07:15.397062 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1835/3651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:14 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:15.420381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:15.421280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:15.439356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.441353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.442676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.443325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.736490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:15.745385 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c7dc77d-347d-4b45-bd8c-fbb80db6c53e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.330158 Apr 09 21:07:15.761067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:15.762732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1836/3652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:15 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:15.767222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1759a0ef-3acb-4a9f-94bf-2e9854212247 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1523 microversion: 2.1 time: 0.401071 Apr 09 21:07:15.774902 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1817/3653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:15 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:15.779951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:15.785388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:15.798158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.798617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.799440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:15.799832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:15.825370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0810012-9242-4564-8f22-2e500e193540 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1324036810", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "key_name": "tempest-key-1650685187", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:15.926873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-e0810012-9242-4564-8f22-2e500e193540 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] validate_networks() for [('ad62b125-1df7-49ad-953e-ad87b77a57c1', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:16.535923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:16.546674 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d47c3631-0b1b-4a5d-8cb6-a2cd5991b65b tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1492 microversion: 2.1 time: 0.782573 Apr 09 21:07:16.547525 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1837/3654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:15 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1492 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:16.552675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:16.553537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:16.560066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:16.560617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:16.561371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:16.561862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:16.929409 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e0810012-9242-4564-8f22-2e500e193540 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Invalid key_name provided. Apr 09 21:07:16.930691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0810012-9242-4564-8f22-2e500e193540 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid key_name provided. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:16.931922 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0810012-9242-4564-8f22-2e500e193540 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.113957 Apr 09 21:07:16.933506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1818/3655] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:15 2022] POST /compute/v2.1/servers => generated 70 bytes in 1117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:16.940457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:16.941392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:16.948130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:16.948901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:16.950010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:16.950628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.123206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.131988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e4071f8-5bee-4bf9-9214-4863da8d2478 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.582922 Apr 09 21:07:17.133143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1838/3656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:16 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:17.138743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:17.139746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:17.149962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.150439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.151433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.151879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.476467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.487080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.488830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.490185 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d09ac041-abcf-4a04-9b33-1fc188462a13 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.555446 Apr 09 21:07:17.490811 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1819/3657] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:16 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:17.496596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:17.497265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:17.504661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.505201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.506008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.506441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.517716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.526499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf3abac5-7b2c-4e58-b8da-9bdc89dc0a21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.391984 Apr 09 21:07:17.527355 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1839/3658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:17 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:17.532397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:17.533248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:17.540613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.541880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.542974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.543527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.826552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.837560 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53ca0ab8-a5c5-4da0-bca5-ffb9f469ae1c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1505 microversion: 2.1 time: 0.345584 Apr 09 21:07:17.838432 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1820/3659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:17 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:17.840668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.848577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8f606186-535d-4564-af60-55e9c945688e req-130c0790-22a7-4de9-9569-faa8925e2459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781b9c38-eca0-4b07-b552-8eb4db9ba45a", "tag": "91c7570f-e651-4ba1-83c0-b9824d7d38bc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:17.849329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc65f321-bb9b-4382-9e15-0c48f95f04d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.320587 Apr 09 21:07:17.853075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1840/3660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:17 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:17.858471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:17.861932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:17.863301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8f606186-535d-4564-af60-55e9c945688e req-130c0790-22a7-4de9-9569-faa8925e2459 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.863301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8f606186-535d-4564-af60-55e9c945688e req-130c0790-22a7-4de9-9569-faa8925e2459 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.867796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.868371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.870117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.870117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.878325 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8f606186-535d-4564-af60-55e9c945688e req-130c0790-22a7-4de9-9569-faa8925e2459 service nova] Creating event network-changed:91c7570f-e651-4ba1-83c0-b9824d7d38bc for instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a on nch1-master-1 Apr 09 21:07:17.883756 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8f606186-535d-4564-af60-55e9c945688e req-130c0790-22a7-4de9-9569-faa8925e2459 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044031 Apr 09 21:07:17.884411 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1821/3661] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:17.890296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:17.891003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:17.897780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.898332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.899079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:17.899525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:17.937787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:17.947007 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a24e1324-b3d4-48bf-ba43-ae543e7780a9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 200 len: 1450 microversion: 2.1 time: 0.095292 Apr 09 21:07:17.947668 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1841/3662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:17 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 1450 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:18.041892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.050216 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fa21c11-8fc7-4cec-bc73-1b2e0b7a120c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.164570 Apr 09 21:07:18.051265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1822/3663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:17 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:18.112718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ffd9b43f-3bda-4828-9f25-ee00b5bbe07e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1082102550", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:18.151200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.151781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.162082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.162713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.163655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.164223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.235827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.security_group_api [None req-ffd9b43f-3bda-4828-9f25-ee00b5bbe07e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Neutron security group does_not_exist not found {{(pid=141818) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Apr 09 21:07:18.236515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ffd9b43f-3bda-4828-9f25-ee00b5bbe07e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Apr 09 21:07:18.237490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ffd9b43f-3bda-4828-9f25-ee00b5bbe07e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:18.238692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ffd9b43f-3bda-4828-9f25-ee00b5bbe07e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.130511 Apr 09 21:07:18.239344 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1842/3664] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:18 2022] POST /compute/v2.1/servers => generated 106 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:07:18.252202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.253169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.259980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.260525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.261367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.261788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.325659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.333766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c59daa5-312a-4e2f-bb6c-c47791d6ab85 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.187035 Apr 09 21:07:18.334384 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1823/3665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:18.420575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.429733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2440e86d-920b-4a07-bc77-2f3d87b5ed79 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.182377 Apr 09 21:07:18.430445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1843/3666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:18.449332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.449981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.464207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.464669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.465495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.465939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.508915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.509814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.520341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.520834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.521649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.522137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.885966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.901487 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-37522b67-c924-4b5d-923a-e1eaa36d16e2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.456320 Apr 09 21:07:18.906102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.913698 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1824/3667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:18.920794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.923654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:18.928124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.928617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35b60984-23e8-4ec7-af15-5a9302baa384 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.423532 Apr 09 21:07:18.929557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.937225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1844/3668] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:18.941364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.942115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.943653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.944306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.948525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:18.948805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:18.960514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.961060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:18.963153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:18.963642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.275188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:19.283248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1cf4b91b-d128-4d1f-a9f2-c7543460464b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 200 len: 1508 microversion: 2.1 time: 0.343822 Apr 09 21:07:19.284080 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1845/3669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:19.289379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-650d591e-0aae-41c1-88e7-d9e649b154ed tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.290291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-650d591e-0aae-41c1-88e7-d9e649b154ed tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: da83cf33-e770-4c7a-85a3-127d9982233d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.296526 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-650d591e-0aae-41c1-88e7-d9e649b154ed tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance da83cf33-e770-4c7a-85a3-127d9982233d could not be found. Apr 09 21:07:19.297147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-650d591e-0aae-41c1-88e7-d9e649b154ed tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance da83cf33-e770-4c7a-85a3-127d9982233d could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:19.298118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-650d591e-0aae-41c1-88e7-d9e649b154ed tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da83cf33-e770-4c7a-85a3-127d9982233d" status: 404 len: 111 microversion: 2.1 time: 0.012727 Apr 09 21:07:19.298807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:19.299648 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1846/3670] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:19 2022] DELETE /compute/v2.1/servers/da83cf33-e770-4c7a-85a3-127d9982233d => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:19.307567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.310386 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b9f6088-5d66-430a-80fe-9b75c5dec778 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.395273 Apr 09 21:07:19.322159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1825/3671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:18 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:19.325999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.329395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.329947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.335628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.337642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.338647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.339309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.341090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.342031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.342819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.344452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.357944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. Apr 09 21:07:19.358528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:19.359377 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01c002b1-0748-47ad-af06-689a67772b32 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 404 len: 111 microversion: 2.1 time: 0.055577 Apr 09 21:07:19.359939 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1847/3672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:19 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:19.365145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.365782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.372661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.373168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.374240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.374722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.381920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:19.390116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Working on deleting snapshot 39e4a575-3d58-4177-a8f8-99fc0bc1deb0 from shelved instance... Apr 09 21:07:19.643671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:19.651309 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9dffb582-f72c-4691-b9a8-fc3edf17ffec tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.290177 Apr 09 21:07:19.664412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1848/3673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:19 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:19.670839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.671711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.679061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.680272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.681313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.681944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.892273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:19.899944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73147088-cdf5-489c-a5e4-88e2af5dd89e tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.234183 Apr 09 21:07:19.901095 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1849/3674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:19 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:19.905471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.905929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.911894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.912613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.913108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.913551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.927813 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. Apr 09 21:07:19.928414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:19.929273 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a0e4c6b-e7af-495e-8b67-8a19a33ecdb9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 404 len: 111 microversion: 2.1 time: 0.027538 Apr 09 21:07:19.929820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1850/3675] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:19 2022] DELETE /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:19.934714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:19.935393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:19.941880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.942566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:19.943313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:19.943750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.086866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.095025 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df37bf80-2ba0-42af-9135-8e631b073527 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.164084 Apr 09 21:07:20.095627 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1851/3676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:19 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:20.100996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7cf5b5d3-49d5-47e8-9bfa-b49f4fa7b801 req-bf92fb99-e114-478b-b2fc-c84393fe39c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90cb018-3a7a-43aa-81f0-c1063e3024fb", "name": "network-vif-deleted", "tag": "a1661061-1748-4e9c-b1ed-3c1a2c5a14cf"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:20.109357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7cf5b5d3-49d5-47e8-9bfa-b49f4fa7b801 req-bf92fb99-e114-478b-b2fc-c84393fe39c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.109799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7cf5b5d3-49d5-47e8-9bfa-b49f4fa7b801 req-bf92fb99-e114-478b-b2fc-c84393fe39c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.127225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7cf5b5d3-49d5-47e8-9bfa-b49f4fa7b801 req-bf92fb99-e114-478b-b2fc-c84393fe39c1 service nova] Creating event network-vif-deleted:a1661061-1748-4e9c-b1ed-3c1a2c5a14cf for instance e90cb018-3a7a-43aa-81f0-c1063e3024fb on nch1-master-1 Apr 09 21:07:20.132124 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7cf5b5d3-49d5-47e8-9bfa-b49f4fa7b801 req-bf92fb99-e114-478b-b2fc-c84393fe39c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 Apr 09 21:07:20.132742 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1852/3677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:20.137719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.138476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: e90cb018-3a7a-43aa-81f0-c1063e3024fb] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.144486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.144938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.146076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.146197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.159712 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. Apr 09 21:07:20.160358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance e90cb018-3a7a-43aa-81f0-c1063e3024fb could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:20.161225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ad3b124-7252-496f-9d9c-966d886ee5a5 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb" status: 404 len: 111 microversion: 2.1 time: 0.027362 Apr 09 21:07:20.161506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Doing local delete in cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141819) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 09 21:07:20.161775 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1853/3678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/e90cb018-3a7a-43aa-81f0-c1063e3024fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:20.164842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.164842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.164842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 09 21:07:20.166263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.166871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.167567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] deallocate_for_instance() {{(pid=141819) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 09 21:07:20.172956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.173381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.174159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.174597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.391763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.399833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.401373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.402502 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db8a3575-3665-47e7-8f94-b8b2948ef776 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.239810 Apr 09 21:07:20.403265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1854/3679] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:20.407518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff08fcb0-735e-42c6-9025-72929882c15d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.407996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff08fcb0-735e-42c6-9025-72929882c15d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Failed to fetch instance by id 9223372036854775808 {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:07:20.408500 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ff08fcb0-735e-42c6-9025-72929882c15d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Apr 09 21:07:20.409079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff08fcb0-735e-42c6-9025-72929882c15d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:20.409846 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff08fcb0-735e-42c6-9025-72929882c15d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.005888 Apr 09 21:07:20.413611 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1855/3680] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Apr 9 21:07:20 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:07:20.416697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.417177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.423587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.423970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.424780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.425256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.439887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. Apr 09 21:07:20.440470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:20.441334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e7c75ab-d59d-4c90-b5aa-9fd6b0d8e2d2 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 404 len: 111 microversion: 2.1 time: 0.030104 Apr 09 21:07:20.442661 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1856/3681] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:20 2022] DELETE /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:20.450312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.450979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.457022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.457495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.458267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.458698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.664186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.672545 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d349325-a830-4ec7-a8f8-9fae33d2638d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.225954 Apr 09 21:07:20.673334 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1857/3682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:20.677834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.678391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.684904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.685400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.686180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.686878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.871761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Updating instance_info_cache with network_info: [] {{(pid=141819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:07:20.899532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:20.908225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e04e430-60ac-4271-8938-faecfc1f9109 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.233966 Apr 09 21:07:20.908940 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1858/3683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:20.913427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.914028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 4064abe2-3845-4a26-b84f-225c78721845] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.921933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.922389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.923274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.923736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.939442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. Apr 09 21:07:20.939945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 4064abe2-3845-4a26-b84f-225c78721845 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:20.940787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0cecd84-9a80-436c-b9fb-76ce8744e120 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845" status: 404 len: 111 microversion: 2.1 time: 0.030986 Apr 09 21:07:20.941397 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1859/3684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/4064abe2-3845-4a26-b84f-225c78721845 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:20.945960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:20.946572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:20.953509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.953963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:20.954740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:20.955183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.050562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df897d7b-be4a-44a9-8e1a-5521a928468b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 204 len: 0 microversion: 2.1 time: 1.725802 Apr 09 21:07:21.051324 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1826/3685] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:19 2022] DELETE /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 0 bytes in 1729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:21.057371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.058278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.065776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.066376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.067407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.067896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.100363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:21.108889 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14fbb624-e033-46da-bdbc-0c26dbc4fd86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.166363 Apr 09 21:07:21.109791 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1860/3686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:20 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:21.114699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.115468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.122025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.122614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.123642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.124079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.139511 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. Apr 09 21:07:21.140386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.141435 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9928da20-d4a8-4501-abb6-8fdebd7f360a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 404 len: 111 microversion: 2.1 time: 0.030699 Apr 09 21:07:21.142142 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1861/3687] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:21 2022] DELETE /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.146841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.147624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.155012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.155467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.156260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.156882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.171926 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. Apr 09 21:07:21.172519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.173568 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a7f2ba0-fc19-4c1f-81b4-818913752cae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 404 len: 111 microversion: 2.1 time: 0.030381 Apr 09 21:07:21.174458 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1862/3688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.179105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.180280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 3fcbc59c-ecf4-4120-9eba-e9c1900708f2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.192934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.193993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.195214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.195664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.212639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. Apr 09 21:07:21.213736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 3fcbc59c-ecf4-4120-9eba-e9c1900708f2 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.214913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88f80ee6-f5f1-433e-b771-5dbd62cd614c tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2" status: 404 len: 111 microversion: 2.1 time: 0.039541 Apr 09 21:07:21.217600 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1863/3689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/3fcbc59c-ecf4-4120-9eba-e9c1900708f2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.217863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:21.226434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.226926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.227326 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99a10990-1501-4d71-9d33-661d9597e470 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.174429 Apr 09 21:07:21.229309 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1827/3690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:21.234368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.234867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.235703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.236132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.246727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-150c3f1f-1111-4dd0-8a64-8cd72d21183d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.247470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-150c3f1f-1111-4dd0-8a64-8cd72d21183d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Failed to fetch instance by id -1 {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 09 21:07:21.248209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-150c3f1f-1111-4dd0-8a64-8cd72d21183d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance -1 could not be found. Apr 09 21:07:21.248770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-150c3f1f-1111-4dd0-8a64-8cd72d21183d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance -1 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.249605 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-150c3f1f-1111-4dd0-8a64-8cd72d21183d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008678 Apr 09 21:07:21.250377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1828/3691] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:07:21 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:07:21.258510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.258822 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. Apr 09 21:07:21.259174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.259564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.260479 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79a73f5b-d3ff-46aa-bfa9-3ee274c809f9 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 404 len: 111 microversion: 2.1 time: 0.039640 Apr 09 21:07:21.261229 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1864/3692] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:21 2022] DELETE /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.267459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.268017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.269549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.269899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.270460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.270586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: d65d7765-2bd1-40ba-adc2-3d6fb923297b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.278791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.279568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.280663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.281146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.297011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. Apr 09 21:07:21.297673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance d65d7765-2bd1-40ba-adc2-3d6fb923297b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.298648 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d016d500-c273-4ea6-9248-6ecedb53a36d tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b" status: 404 len: 111 microversion: 2.1 time: 0.032651 Apr 09 21:07:21.299274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1865/3693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/d65d7765-2bd1-40ba-adc2-3d6fb923297b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.308111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.308883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.316445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.316992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.317948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.318407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.333850 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. Apr 09 21:07:21.334448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.335301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c27db473-75b7-4707-80f6-b6eefdb95fc4 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 404 len: 111 microversion: 2.1 time: 0.031400 Apr 09 21:07:21.335886 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1866/3694] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:21 2022] DELETE /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:07:21.340625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1431935851", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:21.397727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:21.445953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:21.465783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-439e2ea1-9a0d-491b-8443-89c5f5aaceb3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.210984 Apr 09 21:07:21.466843 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1829/3695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:21.472367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.473131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.490647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.491701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.493654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.494413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.512287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. Apr 09 21:07:21.512916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:21.514252 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e8297130-4533-4044-a955-172e10d0b5ab tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4" status: 404 len: 111 microversion: 2.1 time: 0.046107 Apr 09 21:07:21.514872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1830/3696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/bb7e33c8-777e-4ce3-a0dd-2c4b3657e2e4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:21.520101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:21.520696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:21.527605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.528186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:21.529437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:21.530204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.094881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.103321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.104835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.105989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c883f0d-9a1f-42d2-9b46-c8256a2241d5 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.590122 Apr 09 21:07:22.106539 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1831/3697] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:21 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:22.110994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.111605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.117778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.118266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.119205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.119642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.211547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:22.212077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:22.212423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:22.212858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:22.213292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:22.224884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.225368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.226174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.226633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.243967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:22.249613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:22.262702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:07:22.265221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:07:22.270578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.278538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5d5dd78a-2199-43b2-be53-098ed558c1c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.171049 Apr 09 21:07:22.279147 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1832/3698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:22.283777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.284257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.292027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.292465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.293279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.293697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.307963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. Apr 09 21:07:22.308555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:22.309408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9065288b-c158-49f7-994b-e49a41c3a868 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 404 len: 111 microversion: 2.1 time: 0.029161 Apr 09 21:07:22.309954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1833/3699] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:22 2022] DELETE /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:22.315579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7e8112f0-67e1-4517-bbf2-2c7464753946 req-74f0ad1e-6cd9-4975-9b49-1f0dfa588bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfc1f6b-c179-437c-a528-6b7d93c8091b", "name": "network-vif-plugged", "status": "completed", "tag": "44e52bdb-7117-4379-a4df-ef7116499a41"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:22.317045 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53d31c05-b799-4435-9c24-f1cc88fc565e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980089 Apr 09 21:07:22.317721 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1867/3700] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:07:22.322240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.322856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.330173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.330623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7e8112f0-67e1-4517-bbf2-2c7464753946 req-74f0ad1e-6cd9-4975-9b49-1f0dfa588bba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.330757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.331070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7e8112f0-67e1-4517-bbf2-2c7464753946 req-74f0ad1e-6cd9-4975-9b49-1f0dfa588bba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.331445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.331883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.346281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7e8112f0-67e1-4517-bbf2-2c7464753946 req-74f0ad1e-6cd9-4975-9b49-1f0dfa588bba service nova] Creating event network-vif-plugged:44e52bdb-7117-4379-a4df-ef7116499a41 for instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b on nch1-master-1 Apr 09 21:07:22.351628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7e8112f0-67e1-4517-bbf2-2c7464753946 req-74f0ad1e-6cd9-4975-9b49-1f0dfa588bba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040306 Apr 09 21:07:22.352235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1834/3701] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:22.358087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.358956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.366381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.367372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.368155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.368591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.612326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.620421 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43ed9498-8457-4067-b84c-b85a4612b4b9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.301695 Apr 09 21:07:22.624270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.631330 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1868/3702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:22.636378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ad332e4e-5694-4c93-9729-3a363b0df278 req-45fddc0d-86a9-41b7-923d-96838b808857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af9a8-cb98-49e4-b5f7-b53121790a25", "name": "network-vif-deleted", "tag": "d3221b95-beb4-4b92-b232-c7521907646e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:22.636550 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de2d02b2-5e26-4adf-a409-c3c487459c86 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.282541 Apr 09 21:07:22.637249 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1835/3703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:22.642143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b285d91-3968-4ed2-bbc5-11f0d526c1a3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:22.642882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5b285d91-3968-4ed2-bbc5-11f0d526c1a3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: de903ffd-893b-4042-86ea-aaa2924d34d6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.645428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ad332e4e-5694-4c93-9729-3a363b0df278 req-45fddc0d-86a9-41b7-923d-96838b808857 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.645913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ad332e4e-5694-4c93-9729-3a363b0df278 req-45fddc0d-86a9-41b7-923d-96838b808857 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.648745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-5b285d91-3968-4ed2-bbc5-11f0d526c1a3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance de903ffd-893b-4042-86ea-aaa2924d34d6 could not be found. Apr 09 21:07:22.649634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b285d91-3968-4ed2-bbc5-11f0d526c1a3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance de903ffd-893b-4042-86ea-aaa2924d34d6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:22.650472 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5b285d91-3968-4ed2-bbc5-11f0d526c1a3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/de903ffd-893b-4042-86ea-aaa2924d34d6/action" status: 404 len: 111 microversion: 2.1 time: 0.012158 Apr 09 21:07:22.651106 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1836/3704] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:22 2022] POST /compute/v2.1/servers/de903ffd-893b-4042-86ea-aaa2924d34d6/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:22.656044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.656739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: 490c11f8-8cc8-452d-8186-9b860d1e926d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.658092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_external_events [req-ad332e4e-5694-4c93-9729-3a363b0df278 req-45fddc0d-86a9-41b7-923d-96838b808857 service nova] Unable to find a host for instance 276af9a8-cb98-49e4-b5f7-b53121790a25. Dropping event network-vif-deleted {{(pid=141818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 09 21:07:22.658967 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ad332e4e-5694-4c93-9729-3a363b0df278 req-45fddc0d-86a9-41b7-923d-96838b808857 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026555 Apr 09 21:07:22.659776 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1869/3705] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 21:07:22.664173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.664702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.664914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-673a91e1-4254-4588-a28b-497282deee42 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.665554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-673a91e1-4254-4588-a28b-497282deee42 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.665667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.666146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.680842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. Apr 09 21:07:22.681638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance 490c11f8-8cc8-452d-8186-9b860d1e926d could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:22.682758 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa65b3ad-3b21-413f-9a69-84c1ef506a39 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d" status: 404 len: 111 microversion: 2.1 time: 0.030543 Apr 09 21:07:22.683694 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1837/3706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/490c11f8-8cc8-452d-8186-9b860d1e926d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:22.688820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.689902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.697688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.698498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.699302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.699837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.726864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-673a91e1-4254-4588-a28b-497282deee42 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.734970 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-673a91e1-4254-4588-a28b-497282deee42 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1215 microversion: 2.1 time: 0.074149 Apr 09 21:07:22.735663 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1870/3707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:22.740237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.740876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.746929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.747388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.748245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.748690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.762356 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. Apr 09 21:07:22.762988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:22.763964 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79bed108-77e8-4e4d-ad37-cb0d38a29839 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 404 len: 111 microversion: 2.1 time: 0.027375 Apr 09 21:07:22.764521 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1871/3708] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:22 2022] DELETE /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:22.772388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.773004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: b831c6c7-428c-43b1-9716-8e06bc138d41] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.779064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.779524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.780311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.780751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.794308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. Apr 09 21:07:22.794992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance b831c6c7-428c-43b1-9716-8e06bc138d41 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:22.795958 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a09a20d2-7a10-4b39-a15a-0f39bdfbd277 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41" status: 404 len: 111 microversion: 2.1 time: 0.027352 Apr 09 21:07:22.796715 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1872/3709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/b831c6c7-428c-43b1-9716-8e06bc138d41 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:22.804455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.804954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.811244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.811726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.812522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.812944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.837327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:22.849392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:22.858812 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f7173f0-321c-4dac-8f21-7e83aadb8bce tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.173806 Apr 09 21:07:22.859478 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1838/3710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:22.877907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.878824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.885398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.886089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.886881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.887318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.935985 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d0b4441-7d18-49ff-8b10-b8680f8c9100 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 204 len: 0 microversion: 2.1 time: 0.135094 Apr 09 21:07:22.936685 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1873/3711] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:22 2022] DELETE /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:22.951281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:22.952219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:22.959830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.960426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:22.961369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:22.961946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.070585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.078897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a034db0-102e-4ef7-b35a-1ed65cfe5fc4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.204730 Apr 09 21:07:23.079491 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1839/3712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:23.095842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-995a1ae9-1550-491e-b26e-a73ae28a84eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:23.096895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-995a1ae9-1550-491e-b26e-a73ae28a84eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 0c136118-e12c-4a39-a5bf-a272829129ab] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.102526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-995a1ae9-1550-491e-b26e-a73ae28a84eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 0c136118-e12c-4a39-a5bf-a272829129ab could not be found. Apr 09 21:07:23.103113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-995a1ae9-1550-491e-b26e-a73ae28a84eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 0c136118-e12c-4a39-a5bf-a272829129ab could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:23.103924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-995a1ae9-1550-491e-b26e-a73ae28a84eb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/0c136118-e12c-4a39-a5bf-a272829129ab/action" status: 404 len: 111 microversion: 2.1 time: 0.012388 Apr 09 21:07:23.104453 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1840/3713] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:23 2022] POST /compute/v2.1/servers/0c136118-e12c-4a39-a5bf-a272829129ab/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:23.112381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.113000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.119631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.120079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.120372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.120852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.121317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.128812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c54096ca-9a06-4863-b953-565ccc54140f tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1479 microversion: 2.1 time: 0.187860 Apr 09 21:07:23.129505 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1874/3714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:22 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1479 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:23.134068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.134868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.141667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.142218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.143069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.143564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.296364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.304746 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8452a5c4-a7f9-49c2-a395-8da082173da3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.195876 Apr 09 21:07:23.305926 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1841/3715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:23.323588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.324122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.330877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.331326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.332104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.332532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.334739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.344134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.346005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.347031 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb28098a-ffa5-4f55-99e8-a33bd38c5879 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.216580 Apr 09 21:07:23.357956 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1875/3716] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:23.474931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.482620 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-60ed460e-2dfb-40fb-87b2-0dccfdb0a33e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.163212 Apr 09 21:07:23.483209 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1842/3717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:23.499075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bce08174-cf7f-4aeb-8b7d-bef706a3d2c0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.499707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bce08174-cf7f-4aeb-8b7d-bef706a3d2c0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: ff9c89dd-6fec-49f6-823e-f7a556f1412a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.505077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-bce08174-cf7f-4aeb-8b7d-bef706a3d2c0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance ff9c89dd-6fec-49f6-823e-f7a556f1412a could not be found. Apr 09 21:07:23.505642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bce08174-cf7f-4aeb-8b7d-bef706a3d2c0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance ff9c89dd-6fec-49f6-823e-f7a556f1412a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:23.506464 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bce08174-cf7f-4aeb-8b7d-bef706a3d2c0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9c89dd-6fec-49f6-823e-f7a556f1412a" status: 404 len: 111 microversion: 2.1 time: 0.011465 Apr 09 21:07:23.506997 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1876/3718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/ff9c89dd-6fec-49f6-823e-f7a556f1412a => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:23.515361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.515984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.522043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.522463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.523241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.523682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.638512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.639131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.646960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.647450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.648216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.648720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.666986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.675363 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e415fd4b-00c2-4483-b935-c07e4ef0e1ba tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.164002 Apr 09 21:07:23.676203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1843/3719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:23.691349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:23.692259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:23.701287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.701672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.702820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:23.703378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:23.980092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:23.988521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d0d094f-e070-4e09-8853-fb8be08db77b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.354020 Apr 09 21:07:23.989088 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1877/3720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:24.001134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.011629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8cec34d6-ddf4-4ba9-90a7-16a5364a78d0 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1350 microversion: 2.1 time: 0.333711 Apr 09 21:07:24.011805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.011906 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1844/3721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1350 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:24.011994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.016322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.017479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.024165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.024860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.025900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.026442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.028414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.028866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.030132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.030754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.148090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.155691 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73f6dc1f-ae71-47ba-bb85-ff77de88cefb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1273 microversion: 2.1 time: 0.143246 Apr 09 21:07:24.156487 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1845/3722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:24 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:24.170599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.171212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.177618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.178019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.179282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.179282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.286181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.295059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b483319-6c0b-41b6-9fdd-7ceafb4397e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.288062 Apr 09 21:07:24.295635 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1878/3723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:24.354019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-052a9ec2-ea17-4ae9-be84-dc9d4f211a0f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187729285", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:24.355605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-052a9ec2-ea17-4ae9-be84-dc9d4f211a0f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:24.356459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-052a9ec2-ea17-4ae9-be84-dc9d4f211a0f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006748 Apr 09 21:07:24.356988 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1879/3724] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:24.364974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.365624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.372945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.373465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.374214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.374651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.404176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.412058 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4452d287-2ce4-49ed-8038-da2dd9f02ec7 tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1479 microversion: 2.1 time: 0.245519 Apr 09 21:07:24.412836 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1846/3725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:24 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1479 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:24.417525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.418287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.425982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.426439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.427228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.427662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.629181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.636726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4a60c5f-0a27-4551-a2b0-85cd0227fe76 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.275343 Apr 09 21:07:24.637403 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1880/3726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:24 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:24.655374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:24.656452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:24.664064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.665234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.666074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:24.666498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:24.717498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.725767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.727310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.728452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6c271f5-358a-459b-bef8-85443355e7ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.314393 Apr 09 21:07:24.729136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1847/3727] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:24 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:24.942581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:24.950737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e963fc2b-5128-4646-9e66-8ba03061498c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.299587 Apr 09 21:07:24.951638 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1881/3728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:24 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:25.005489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.006107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.013070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.013869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.014234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-355ee456-b0dc-43b7-af28-42d7c35bee8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1431371290", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:25.015028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.015564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.015770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-355ee456-b0dc-43b7-af28-42d7c35bee8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:25.016574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-355ee456-b0dc-43b7-af28-42d7c35bee8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006415 Apr 09 21:07:25.017404 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1882/3729] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:25.026145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.026760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.033780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.034479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.035264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.035688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.389980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:25.397918 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e44779f8-b5d6-4abe-a96c-238728e9629b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.396314 Apr 09 21:07:25.398508 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1848/3730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:25.402964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.403562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.409659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.410113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.410974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.411413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.426422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:25.435765 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7fdf6069-4b3e-47a9-8793-b8d75e06f786 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.414171 Apr 09 21:07:25.436873 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1883/3731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:25.441726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.442338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.450615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.451406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.452371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.452824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.826122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:25.833965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54ebfb84-08cc-402b-bc3d-469d72fd90ec tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1539 microversion: 2.1 time: 0.434463 Apr 09 21:07:25.834825 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1849/3732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1539 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:25.846014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.846653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.849505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:25.857314 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb777993-6f19-4721-92d8-8cf2a058b25e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.419095 Apr 09 21:07:25.858939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.859400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.860671 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1884/3733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:25.862364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.862824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.871161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:25.874938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:25.886401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.887109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.888306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.889011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:25.961236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121a5a2fcd9f4420885f2a78c1dfc339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87849ca88bb4519b329fab033911446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:25.970154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3b7e3fc8-7027-439b-bd6a-9463d24e2e8a tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 200 len: 1437 microversion: 2.1 time: 0.134067 Apr 09 21:07:25.970736 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1850/3734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:25.976260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d15032df-d9ac-4d1a-a998-6163b8e5fe9c req-e6ecae00-e98e-453b-8412-d5615b002c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781b9c38-eca0-4b07-b552-8eb4db9ba45a", "name": "network-vif-plugged", "status": "completed", "tag": "91c7570f-e651-4ba1-83c0-b9824d7d38bc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:25.987562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d15032df-d9ac-4d1a-a998-6163b8e5fe9c req-e6ecae00-e98e-453b-8412-d5615b002c64 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:25.988037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d15032df-d9ac-4d1a-a998-6163b8e5fe9c req-e6ecae00-e98e-453b-8412-d5615b002c64 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.001463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d15032df-d9ac-4d1a-a998-6163b8e5fe9c req-e6ecae00-e98e-453b-8412-d5615b002c64 service nova] Creating event network-vif-plugged:91c7570f-e651-4ba1-83c0-b9824d7d38bc for instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a on nch1-master-1 Apr 09 21:07:26.007476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d15032df-d9ac-4d1a-a998-6163b8e5fe9c req-e6ecae00-e98e-453b-8412-d5615b002c64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035324 Apr 09 21:07:26.008102 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1851/3735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:26.016418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.017177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.024391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.025131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.026241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.027284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.186057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.194268 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-429c11df-20e2-410a-821d-ff23e6b9a4da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.332799 Apr 09 21:07:26.194982 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1885/3736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:25 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:26.199753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.200261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.207412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.207859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.208648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.209122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.364028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1431e9e-e0b2-46d4-a76d-2b5b193b2053 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167888 Apr 09 21:07:26.364814 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1886/3737] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:26.378286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ae4a4941-02c5-4818-baf6-ad72b7903558 req-6d83f556-c8af-4304-9901-acfbee4d61a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce0e76e-bbf7-44e1-86c4-9d078813ff72", "name": "network-vif-deleted", "tag": "d9131337-3f4d-44a3-aa06-6245dff9187e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:26.388264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ae4a4941-02c5-4818-baf6-ad72b7903558 req-6d83f556-c8af-4304-9901-acfbee4d61a8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.388749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ae4a4941-02c5-4818-baf6-ad72b7903558 req-6d83f556-c8af-4304-9901-acfbee4d61a8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.390083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.401626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.404017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.405525 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-342e0be5-6d9d-414b-8d89-f44e41b998be tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.395549 Apr 09 21:07:26.405805 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ae4a4941-02c5-4818-baf6-ad72b7903558 req-6d83f556-c8af-4304-9901-acfbee4d61a8 service nova] Creating event network-vif-deleted:d9131337-3f4d-44a3-aa06-6245dff9187e for instance bce0e76e-bbf7-44e1-86c4-9d078813ff72 on nch2-master-1 Apr 09 21:07:26.406758 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1852/3738] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:26.421193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-797d853d-5ba7-4c7a-ab38-5d56e7dc3647 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:26.422029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-797d853d-5ba7-4c7a-ab38-5d56e7dc3647 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 75e830c9-acff-40de-94e4-ad69a5309055] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.422384 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ae4a4941-02c5-4818-baf6-ad72b7903558 req-6d83f556-c8af-4304-9901-acfbee4d61a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047921 Apr 09 21:07:26.422994 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1887/3739] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:26.432354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.436547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.444873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.445572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.445905 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-797d853d-5ba7-4c7a-ab38-5d56e7dc3647 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 75e830c9-acff-40de-94e4-ad69a5309055 could not be found. Apr 09 21:07:26.446684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.447420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.453833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-797d853d-5ba7-4c7a-ab38-5d56e7dc3647 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 75e830c9-acff-40de-94e4-ad69a5309055 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:26.455933 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-797d853d-5ba7-4c7a-ab38-5d56e7dc3647 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/75e830c9-acff-40de-94e4-ad69a5309055/action" status: 404 len: 111 microversion: 2.1 time: 0.047863 Apr 09 21:07:26.456693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1853/3740] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:26 2022] POST /compute/v2.1/servers/75e830c9-acff-40de-94e4-ad69a5309055/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:26.470984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.474532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.490533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.490986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.491795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.492232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.737609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.746607 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ca4cd2f0-f45d-4313-aaef-524d34894e85 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.322053 Apr 09 21:07:26.756496 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1888/3741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:26.771413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.779821 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5434136c-674a-4bf7-86fe-d2afbbe60638 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.318707 Apr 09 21:07:26.780643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1854/3742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:26.797362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.798059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.804083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.804532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.805781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.805896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.876942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:26.877728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:26.885120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.885591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.886407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:26.886849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:26.988174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:26.996732 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50f869e3-3a72-4f91-a5d0-1309eb03aef7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.203383 Apr 09 21:07:26.998052 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1889/3743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:27.003337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:27.004219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] [instance: bce0e76e-bbf7-44e1-86c4-9d078813ff72] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:27.023858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.029942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.031015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.031466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.051922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:27.060664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad35cd4f-0255-46f7-b61e-dc40d7e02be8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.187786 Apr 09 21:07:27.061684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] HTTP exception thrown: Instance bce0e76e-bbf7-44e1-86c4-9d078813ff72 could not be found. Apr 09 21:07:27.062349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] Returning 404 to user: Instance bce0e76e-bbf7-44e1-86c4-9d078813ff72 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:27.062852 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1855/3744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:27.068323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:27.068521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da071d76-181e-48be-9cc3-798a70e1bf4e tempest-ServersTestJSON-1338808182 tempest-ServersTestJSON-1338808182-project] 10.222.0.30 "GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72" status: 404 len: 111 microversion: 2.1 time: 0.069040 Apr 09 21:07:27.072212 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1890/3745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:26 2022] GET /compute/v2.1/servers/bce0e76e-bbf7-44e1-86c4-9d078813ff72 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:27.073337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:27.080121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.080996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.081990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.083107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.167103 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34ff2f5f-4e4b-486e-ad14-bd0270b572ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.102159 Apr 09 21:07:27.171170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1856/3746] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:27 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:27.178085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:27.178794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:27.186399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.187588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.189179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.190085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.426402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:27.427777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:27.453220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.453690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.454499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.454936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.960997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:27.971250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ba42e82-b737-4226-a88d-022b9e319628 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1511 microversion: 2.1 time: 0.798790 Apr 09 21:07:27.973408 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1891/3747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:27 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1511 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:27.978667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:27.979652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:27.987117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.987695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:27.988922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:27.989457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:28.056040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:28.066326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:28.068543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:28.069951 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d1ece999-d2b0-4ce8-b9fb-e4a96ff697ea tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1359 microversion: 2.21 time: 0.649628 Apr 09 21:07:28.070525 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1857/3748] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:27 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:07:28.077104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-af4c7212-f0d0-4936-a533-b64d69b00990 req-35bdc5ec-cca0-44a3-84ab-e51eabd545ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfc1f6b-c179-437c-a528-6b7d93c8091b", "tag": "44e52bdb-7117-4379-a4df-ef7116499a41"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:28.090579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-af4c7212-f0d0-4936-a533-b64d69b00990 req-35bdc5ec-cca0-44a3-84ab-e51eabd545ca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:28.091271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-af4c7212-f0d0-4936-a533-b64d69b00990 req-35bdc5ec-cca0-44a3-84ab-e51eabd545ca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:28.106432 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-af4c7212-f0d0-4936-a533-b64d69b00990 req-35bdc5ec-cca0-44a3-84ab-e51eabd545ca service nova] Creating event network-changed:44e52bdb-7117-4379-a4df-ef7116499a41 for instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b on nch1-master-1 Apr 09 21:07:28.111909 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-af4c7212-f0d0-4936-a533-b64d69b00990 req-35bdc5ec-cca0-44a3-84ab-e51eabd545ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038820 Apr 09 21:07:28.116749 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1858/3749] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:28.123311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:28.124064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:28.131829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:28.132528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:28.134165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:28.134774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:28.551441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:28.560528 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-33820632-a2d4-4782-977c-6ec8f4d38b10 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.585859 Apr 09 21:07:28.570644 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1892/3750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:27 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:28.575617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-28cd6b31-eea9-4a7b-a858-cef74213b53e req-c138bf68-957d-4337-82b3-de4727bd463b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f593a18-b8be-4120-a758-0d18a7adf933", "tag": "63629146-b55f-40f2-a6c3-24d1bb7fce83"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:28.584110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-28cd6b31-eea9-4a7b-a858-cef74213b53e req-c138bf68-957d-4337-82b3-de4727bd463b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:28.584861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-28cd6b31-eea9-4a7b-a858-cef74213b53e req-c138bf68-957d-4337-82b3-de4727bd463b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:28.597983 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-28cd6b31-eea9-4a7b-a858-cef74213b53e req-c138bf68-957d-4337-82b3-de4727bd463b service nova] Creating event network-changed:63629146-b55f-40f2-a6c3-24d1bb7fce83 for instance 2f593a18-b8be-4120-a758-0d18a7adf933 on nch1-master-1 Apr 09 21:07:28.603915 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-28cd6b31-eea9-4a7b-a858-cef74213b53e req-c138bf68-957d-4337-82b3-de4727bd463b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031773 Apr 09 21:07:28.605075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1893/3751] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:28.687382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:28.696671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c59c2e5-02a0-4440-9420-cd7a70029414 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.577789 Apr 09 21:07:28.706071 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1859/3752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:28 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:28.992893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:28.993746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.001301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.001888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.002622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.003304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.095322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.096102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.110968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.111792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.112917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.113769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.176410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.186033 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a2830a6-75e9-4b5c-bc7d-13e79073f719 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1491 microversion: 2.1 time: 0.198819 Apr 09 21:07:29.187700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1894/3753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:28 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1491 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:29.206000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:29.206559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.219274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.219957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.220925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.221404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.248715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'pause' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state paused Apr 09 21:07:29.250078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'pause' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state paused {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:29.251566 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7828b075-62e0-413b-b7c2-68d60c75f01a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 143 microversion: 2.1 time: 0.049683 Apr 09 21:07:29.255783 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1895/3754] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:29 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 143 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:07:29.262381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:29.263489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.273873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.274806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.275739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.275961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.276556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.285775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.287883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.289276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-288c723e-65e7-4b46-89fe-e68e6f23f94b tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1552 microversion: 2.21 time: 0.202723 Apr 09 21:07:29.290087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1860/3755] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:29 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:29.307703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.308238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.315280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.315884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.316835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.317438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.344466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:29.355368 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed763d85-a12d-446d-a977-4b21bdeab00c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.097953 Apr 09 21:07:29.356389 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1896/3756] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:29 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:29.364967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.365999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.373418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.373995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.375155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.375682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.434503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-61f3c86e-567d-4cb9-b1f3-b8e4c9ab30eb tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "DELETE /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 204 len: 0 microversion: 2.21 time: 0.131300 Apr 09 21:07:29.435704 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1861/3757] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:07:29 2022] DELETE /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:07:29.445532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.446311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.453523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.454062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.454928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.455443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.665547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.677025 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bbdd2478-b732-46ef-91ad-b75353ae4732 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1498 microversion: 2.1 time: 0.316036 Apr 09 21:07:29.678008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1897/3758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:29 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:29.687304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.687977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.695511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.695968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.696949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.697762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.741128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.751352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.752976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.754488 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a3037cf6-071f-44a8-ac0a-50fe1b6ba94c tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1558 microversion: 2.21 time: 0.314704 Apr 09 21:07:29.755434 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1862/3759] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:29 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1558 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:29.760216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:29.761022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:29.767558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.768249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.769238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:29.769730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:29.898860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.908135 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c51f5921-5d15-46c4-9da1-f1a2891a5df5 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.228576 Apr 09 21:07:29.909934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1898/3760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:29 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:29.949163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:29.958920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-239958e1-e1c1-41c0-840e-b16c79d76b00 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.202286 Apr 09 21:07:29.959553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1863/3761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:29 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:30.255865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-907890428", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:30.315103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:30.315646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:30.316264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:30.316820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:30.317379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:30.328232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.328752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:30.329709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.330200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:30.350204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for project 9c7578f9ead04b7384247947593935dd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:30.356049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for user 33ea3acc687d49a9868219b4c9fa34dc and project 9c7578f9ead04b7384247947593935dd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:30.369773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:07:30.372280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:07:30.422317 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3e92beb-37bc-4441-9f22-ba801fc2bc27 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.288119 Apr 09 21:07:30.423249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1899/3762] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 09 21:07:30.434677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:30.435422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:30.501859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:30.510630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:30.512231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:30.513703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36319399-c7c8-4875-8fb6-a3a87932b13f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1277 microversion: 2.54 time: 0.083327 Apr 09 21:07:30.514327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1864/3763] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:30 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:30.698286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:30.699098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:30.707535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.708488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:30.709279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.709995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:30.774963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:30.775825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:30.784957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.786704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:30.788311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:30.789117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.024266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.032919 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72ab725b-b347-4278-a644-ea7e70727361 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1498 microversion: 2.1 time: 0.341592 Apr 09 21:07:31.033554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1900/3764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:30 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:31.048966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:31.049604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:31.055046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.055821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.056359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.057236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.057667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.064341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.065909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.067152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24cafcf1-cbe4-4e0e-be30-6a506374f51e tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1558 microversion: 2.21 time: 0.296969 Apr 09 21:07:31.067733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1865/3765] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:30 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:31.072412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:31.073026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:31.079435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.079885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.080724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.081201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.572128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.581755 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c36fbe1d-505f-4fa4-8873-49a90aa9020b tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1516 microversion: 2.1 time: 0.536532 Apr 09 21:07:31.582426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1901/3766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:31 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1516 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:31.588362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:31.589071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:31.596890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.597934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.598705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:31.599335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:31.615086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.624358 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ee4b925-6bc4-4947-9713-f23f9f27bffd tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.555367 Apr 09 21:07:31.630556 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1866/3767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:31 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:31.796396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.808430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.810101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:31.811678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ba719a4-86cf-488e-b10b-c5e92e280340 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1281 microversion: 2.54 time: 0.227754 Apr 09 21:07:31.812024 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1902/3768] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:31 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:32.053725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.054492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.061464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.061909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.064414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.064800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.086285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.088448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.095905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.096797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.097755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.098445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.412070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.421520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.422704 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d10d8b7-04d4-4414-b029-152c64afcf5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.374410 Apr 09 21:07:32.423362 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1867/3769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:32.435391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.435391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8437faedd74046fc81e05d2dadc1dd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959fb92f2def47deb85d73cc0493c295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.436598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3118fd1b-b456-4500-a095-52166bc6d43d tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 200 len: 1558 microversion: 2.21 time: 0.354553 Apr 09 21:07:32.437491 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1903/3770] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 1558 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:32.445614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.447736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.455706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.456350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.457397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.457844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.501933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a4f65792-32c2-4326-8bb3-d8d3373de506 req-b34c1c06-e82a-4fce-88e0-f3d390f9d3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781b9c38-eca0-4b07-b552-8eb4db9ba45a", "name": "network-vif-deleted", "tag": "91c7570f-e651-4ba1-83c0-b9824d7d38bc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:32.513199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a4f65792-32c2-4326-8bb3-d8d3373de506 req-b34c1c06-e82a-4fce-88e0-f3d390f9d3d0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.513760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a4f65792-32c2-4326-8bb3-d8d3373de506 req-b34c1c06-e82a-4fce-88e0-f3d390f9d3d0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.530613 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a4f65792-32c2-4326-8bb3-d8d3373de506 req-b34c1c06-e82a-4fce-88e0-f3d390f9d3d0 service nova] Creating event network-vif-deleted:91c7570f-e651-4ba1-83c0-b9824d7d38bc for instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a on nch1-master-1 Apr 09 21:07:32.538060 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a4f65792-32c2-4326-8bb3-d8d3373de506 req-b34c1c06-e82a-4fce-88e0-f3d390f9d3d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040957 Apr 09 21:07:32.538961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1904/3771] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:07:32.599454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.600343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.606675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.607124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.607950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.608384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.652286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.661989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a3b5f4df-e6c9-4ce7-aee9-b52aa3254955 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.220215 Apr 09 21:07:32.662607 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1868/3772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:32.668035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.668823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.676351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.677270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.678133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.678577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.804436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.813218 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07402f1e-e9ed-4a35-ab77-bcc2fed075ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.217906 Apr 09 21:07:32.813922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1905/3773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:32.820555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:32.822793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.829761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.830289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.831090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.831550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.845272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.848254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. Apr 09 21:07:32.849576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:32.850505 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd29de4d-eba0-4adb-8851-b6ff60737ec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da/action" status: 404 len: 111 microversion: 2.1 time: 0.034841 Apr 09 21:07:32.854952 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1906/3774] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:32 2022] POST /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:32.855096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-50187f19-1d18-46ce-b3fe-a24e7594831d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.189210 Apr 09 21:07:32.855096 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1869/3775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:32.856394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.857026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.859986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:32.860601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:32.863405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.865207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.866947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.867067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.867391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.867533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.868191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:32.868617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:32.961688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.972278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.974145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:32.975553 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1066dac4-50d7-41a7-a52e-4e2c870d9b79 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.123455 Apr 09 21:07:32.976307 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1907/3776] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:33.040786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:33.048549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c4da7ad-ca01-46cc-8943-7151458d79cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.192363 Apr 09 21:07:33.049664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1870/3777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:32 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:33.067383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.067999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.074600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.075063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.076169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.076372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.215876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:33.224914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a397400-689d-4426-b2b7-ef128a9d854a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.161845 Apr 09 21:07:33.225907 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1908/3778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:33.243291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e699c41-08fb-4d92-98f6-3303bf038254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:33.244446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e699c41-08fb-4d92-98f6-3303bf038254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: a420f1fb-4457-4ca7-9165-dfda4b91fad9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.251075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6e699c41-08fb-4d92-98f6-3303bf038254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance a420f1fb-4457-4ca7-9165-dfda4b91fad9 could not be found. Apr 09 21:07:33.251690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e699c41-08fb-4d92-98f6-3303bf038254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance a420f1fb-4457-4ca7-9165-dfda4b91fad9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:33.252505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e699c41-08fb-4d92-98f6-3303bf038254 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/a420f1fb-4457-4ca7-9165-dfda4b91fad9/action" status: 404 len: 111 microversion: 2.1 time: 0.013428 Apr 09 21:07:33.253304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1871/3779] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:33 2022] POST /compute/v2.1/servers/a420f1fb-4457-4ca7-9165-dfda4b91fad9/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:33.261870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.262570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.269383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.269842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.270691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.271138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.408294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:33.416229 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-321f5c02-04b8-4240-b0ad-a5253e8e013a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.158250 Apr 09 21:07:33.416793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1909/3780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:33.433787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.434409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.442587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.442955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.443746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.444186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.458880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.459618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.467637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.468085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.469237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.469842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.487476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] HTTP exception thrown: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. Apr 09 21:07:33.488176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Returning 404 to user: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:33.489234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73848182-e00a-4c2d-bcbe-21806762e5e4 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 404 len: 111 microversion: 2.21 time: 0.037671 Apr 09 21:07:33.493084 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1910/3781] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:33.498620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '.version_select at 0x7fb08ea97dc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.499231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.507525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.507983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.508789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.509544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.594161 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-24bd7097-6bf9-4f8e-8e9f-d55cf6803ef7 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.099313 Apr 09 21:07:33.594817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1911/3782] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a/os-instance-actions => generated 611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:07:33.611747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.612421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.620491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.621400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.622514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.623229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.644719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] HTTP exception thrown: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. Apr 09 21:07:33.645713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Returning 404 to user: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:33.646933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5a0b29a-60a2-4a42-8c71-951bff0d6ae3 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "DELETE /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 404 len: 111 microversion: 2.21 time: 0.041052 Apr 09 21:07:33.651003 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1912/3783] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:07:33 2022] DELETE /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:33.657981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.659348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] [instance: 781b9c38-eca0-4b07-b552-8eb4db9ba45a] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.668889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.669488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.670853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.674665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.689005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] HTTP exception thrown: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. Apr 09 21:07:33.690150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] Returning 404 to user: Instance 781b9c38-eca0-4b07-b552-8eb4db9ba45a could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:33.690688 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1cf50cb9-2bc7-479e-a6c6-9511691ff844 tempest-InstanceActionsV221TestJSON-838799749 tempest-InstanceActionsV221TestJSON-838799749-project] 10.222.0.30 "GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a" status: 404 len: 111 microversion: 2.21 time: 0.038154 Apr 09 21:07:33.691331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1913/3784] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/781b9c38-eca0-4b07-b552-8eb4db9ba45a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:07:33.710843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7e5a6689-5ff2-4dbd-8cdd-40786f05f0df req-41ebb6d4-391b-4fb4-83e6-27d64bcfc5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f593a18-b8be-4120-a758-0d18a7adf933", "name": "network-vif-plugged", "status": "completed", "tag": "63629146-b55f-40f2-a6c3-24d1bb7fce83"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:33.720481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7e5a6689-5ff2-4dbd-8cdd-40786f05f0df req-41ebb6d4-391b-4fb4-83e6-27d64bcfc5ed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.720934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7e5a6689-5ff2-4dbd-8cdd-40786f05f0df req-41ebb6d4-391b-4fb4-83e6-27d64bcfc5ed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.737833 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7e5a6689-5ff2-4dbd-8cdd-40786f05f0df req-41ebb6d4-391b-4fb4-83e6-27d64bcfc5ed service nova] Creating event network-vif-plugged:63629146-b55f-40f2-a6c3-24d1bb7fce83 for instance 2f593a18-b8be-4120-a758-0d18a7adf933 on nch1-master-1 Apr 09 21:07:33.745314 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7e5a6689-5ff2-4dbd-8cdd-40786f05f0df req-41ebb6d4-391b-4fb4-83e6-27d64bcfc5ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036982 Apr 09 21:07:33.746172 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1914/3785] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:07:33.834344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.838344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:33.840684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Searching by: {'deleted': False, 'project_id': 'b4603cd745c848eba3a1645f624e590e'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:07:33.858569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.860896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.862875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.865067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.910599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:07:33.946538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f792bcb-6ca9-417c-8ebc-d3cf193eb300 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.117486 Apr 09 21:07:33.953439 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1915/3786] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:33.953439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:33.953439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:33.960770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.961270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:33.961849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:33.962702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.032695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.042356 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ca55cc5-221e-46b9-8a1f-23df1c750ef9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.612415 Apr 09 21:07:34.043410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1872/3787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:34.048394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.049008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.056214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.056690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.057493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.058100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.234685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.243201 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f2790dc-ea8b-4ca1-9173-6c88084bc3ca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.294230 Apr 09 21:07:34.252874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1916/3788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:33 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:34.252874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.252874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.253296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Searching by: {'deleted': False, 'project_id': 'b4603cd745c848eba3a1645f624e590e'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:07:34.258366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.259485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.259963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.260816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.261286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.267214 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa61cf87-002b-4b51-b002-f3c6b71ae6a6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1315 microversion: 2.1 time: 0.222524 Apr 09 21:07:34.267804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1873/3789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:34.272724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.273563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.280054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.280855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.281870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.282463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.298900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:07:34.336073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.343135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.343600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.351447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.370208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.371887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.374143 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99caf051-d5c6-4cdb-9d2a-b46018cb7c26 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.105337 Apr 09 21:07:34.385487 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1874/3790] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:34.387576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:34.389244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.395670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.396131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.397618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.398127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.414068 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. Apr 09 21:07:34.414684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:34.416382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-993611d8-384b-4216-a02a-ef0778b5dc15 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da/action" status: 404 len: 111 microversion: 2.1 time: 0.033085 Apr 09 21:07:34.417184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1875/3791] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:34 2022] POST /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:34.425611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.426475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.432940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.433608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.439472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.439472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.495903 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b730a3d2-5bfd-4cc7-a850-9a62aefd9ddf tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.251175 Apr 09 21:07:34.496981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1917/3792] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:34.514081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa83994e-3195-48d9-9bcc-03234c5ebe2c tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.523168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa83994e-3195-48d9-9bcc-03234c5ebe2c tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013219 Apr 09 21:07:34.523858 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1918/3793] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:07:34.584567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.592752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb58c4a6-69be-4b03-9e61-be5370c02cff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.170694 Apr 09 21:07:34.593350 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1876/3794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:34.609865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.610561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.616487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.617093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.617722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.618156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.797959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:34.805916 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c521a01-36c8-435e-b907-3e72686cbbb1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.200037 Apr 09 21:07:34.817237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1919/3795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:34.823096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ec32776-f607-4e31-9e23-072b8ef82a38 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:34.824548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ec32776-f607-4e31-9e23-072b8ef82a38 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 77ef9fd1-9c49-4608-847d-2100b12d7db6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.830485 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4ec32776-f607-4e31-9e23-072b8ef82a38 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 77ef9fd1-9c49-4608-847d-2100b12d7db6 could not be found. Apr 09 21:07:34.831143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ec32776-f607-4e31-9e23-072b8ef82a38 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 77ef9fd1-9c49-4608-847d-2100b12d7db6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:34.832003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ec32776-f607-4e31-9e23-072b8ef82a38 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/77ef9fd1-9c49-4608-847d-2100b12d7db6/action" status: 404 len: 111 microversion: 2.1 time: 0.013100 Apr 09 21:07:34.832550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1877/3796] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:34 2022] POST /compute/v2.1/servers/77ef9fd1-9c49-4608-847d-2100b12d7db6/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:34.841085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.841709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.848471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.848793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.849729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.850156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.878530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:34.878947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:34.887347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.887840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.888779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:34.889345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:34.917593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:35.003392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.004118 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 204 len: 0 microversion: 2.1 time: 0.129121 Apr 09 21:07:35.004992 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1878/3797] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:34 2022] DELETE /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:35.019741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.019741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.019924 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46fd5f7d-ddfd-4b2f-b378-7d135490011a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.177354 Apr 09 21:07:35.019924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1920/3798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:34 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:35.021086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.021539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.022316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.022735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.032040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.033329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.039383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.039899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.040587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.041017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.232899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.234953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.242690 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fbf30e1-13fc-4f7c-9e0c-3835ccf8bb38 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1606 microversion: 2.1 time: 0.233650 Apr 09 21:07:35.243900 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1879/3799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1606 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:35.255061 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f169c628-9d0b-4b7e-97e7-5ed527754ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.226928 Apr 09 21:07:35.255726 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1921/3800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:35.261946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.262570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.270666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.273736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.274563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.275002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.275251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4435f9a-4e85-4976-8cfb-b22b45d4645b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:35.276331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4435f9a-4e85-4976-8cfb-b22b45d4645b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: aeb5e01e-07ee-4019-9ecb-461f8c616ec9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.284971 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e4435f9a-4e85-4976-8cfb-b22b45d4645b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance aeb5e01e-07ee-4019-9ecb-461f8c616ec9 could not be found. Apr 09 21:07:35.285770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4435f9a-4e85-4976-8cfb-b22b45d4645b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance aeb5e01e-07ee-4019-9ecb-461f8c616ec9 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:35.286708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e4435f9a-4e85-4976-8cfb-b22b45d4645b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/aeb5e01e-07ee-4019-9ecb-461f8c616ec9/action" status: 404 len: 111 microversion: 2.1 time: 0.016318 Apr 09 21:07:35.287736 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1922/3801] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:35 2022] POST /compute/v2.1/servers/aeb5e01e-07ee-4019-9ecb-461f8c616ec9/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:07:35.292914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.293674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.301462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.301462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.302250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.303005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.487702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.495601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.495782 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38214331-2494-45c0-ae52-c4250a138fbc tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.239175 Apr 09 21:07:35.496183 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1880/3802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:35.502021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.502784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.507146 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f0e60be5-51d6-4921-94a9-ff27984f6eae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1502 microversion: 2.1 time: 0.218226 Apr 09 21:07:35.507970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1923/3803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:35.508815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.509325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.510104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.510537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.519707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.520554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.526915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.527442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.528330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.528863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.620004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.628175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.629950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.631085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f25a799-1905-40fc-b7da-0490d832cc2b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.121512 Apr 09 21:07:35.631970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1924/3804] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:35.636987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cdc9f650-8ac4-430e-b171-85034a53e6d1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:35.643990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdc9f650-8ac4-430e-b171-85034a53e6d1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.644364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cdc9f650-8ac4-430e-b171-85034a53e6d1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.672455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cdc9f650-8ac4-430e-b171-85034a53e6d1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Going to try to stop instance {{(pid=141818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:07:35.685565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.699076 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94741879-054f-4098-9429-d85e781d247f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.201049 Apr 09 21:07:35.699711 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1881/3805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:35.717966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.718895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.723265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cdc9f650-8ac4-430e-b171-85034a53e6d1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933/action" status: 202 len: 0 microversion: 2.1 time: 0.090002 Apr 09 21:07:35.724009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1925/3806] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:35 2022] POST /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:35.726839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.728174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.729381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.730174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.733731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:35.734444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.742658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.743126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.743902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.744514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.933886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.944561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:35.945209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea3aa234-56a9-4445-8cc3-76afc8d021ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.231265 Apr 09 21:07:35.957465 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e8a8cf4-521d-459f-a951-a9207483b0d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.223709 Apr 09 21:07:35.959328 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1882/3807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:35.961929 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1926/3808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:35 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:35.967579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:35.968743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:35.975382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.976041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:35.977143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:35.977679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.007675 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'restore' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active Apr 09 21:07:36.008464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'restore' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:36.009558 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6af92fd4-f531-4a25-9951-28cdcffb34a6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 145 microversion: 2.1 time: 0.046135 Apr 09 21:07:36.021765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1883/3809] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:35 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:07:36.030373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.031136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.037286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.037816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.039140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.039332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.083247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-aa609207-9ca9-45f0-871c-7d83025b7b23 req-99f013cb-e7a5-49b5-8692-b06309efaf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103c226-e4d1-42eb-a8c0-4a9f4d34daf3", "name": "network-vif-unplugged", "status": "completed", "tag": "61bb000c-8420-4fc7-8f3f-a1f3d9041c97"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:36.096796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa609207-9ca9-45f0-871c-7d83025b7b23 req-99f013cb-e7a5-49b5-8692-b06309efaf56 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.097719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa609207-9ca9-45f0-871c-7d83025b7b23 req-99f013cb-e7a5-49b5-8692-b06309efaf56 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.115981 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-aa609207-9ca9-45f0-871c-7d83025b7b23 req-99f013cb-e7a5-49b5-8692-b06309efaf56 service nova] Creating event network-vif-unplugged:61bb000c-8420-4fc7-8f3f-a1f3d9041c97 for instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 on nch2-master-1 Apr 09 21:07:36.123163 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-aa609207-9ca9-45f0-871c-7d83025b7b23 req-99f013cb-e7a5-49b5-8692-b06309efaf56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043598 Apr 09 21:07:36.124812 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1884/3810] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:36.180021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.190154 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d37cae16-85dc-4e01-9c70-f655a4a052e0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.166855 Apr 09 21:07:36.190943 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1927/3811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:36.209065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.209882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.224969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.226094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.227606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.228040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.260843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.261480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.267738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.268287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.269189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.269722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.416997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.426305 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0136d21-5dfe-4cc1-9d6d-8dcd2d9d36da tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.222270 Apr 09 21:07:36.426892 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1885/3812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:36.442766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48e8e137-9269-423c-89e8-040812416d10 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:36.444079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48e8e137-9269-423c-89e8-040812416d10 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: d81b2a32-ecaa-44ba-a67f-bda68bfac1cf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.448223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.449953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-48e8e137-9269-423c-89e8-040812416d10 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance d81b2a32-ecaa-44ba-a67f-bda68bfac1cf could not be found. Apr 09 21:07:36.450653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48e8e137-9269-423c-89e8-040812416d10 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance d81b2a32-ecaa-44ba-a67f-bda68bfac1cf could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:36.451806 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48e8e137-9269-423c-89e8-040812416d10 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/d81b2a32-ecaa-44ba-a67f-bda68bfac1cf/action" status: 404 len: 111 microversion: 2.1 time: 0.013059 Apr 09 21:07:36.453674 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1886/3813] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:36 2022] POST /compute/v2.1/servers/d81b2a32-ecaa-44ba-a67f-bda68bfac1cf/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:36.458590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed8b825a-6cf0-4f6c-8f5d-52174fb713b4 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1606 microversion: 2.1 time: 0.202387 Apr 09 21:07:36.459483 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1928/3814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1606 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:36.462001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.462616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.470069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.470521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.471309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.471742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.512128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.512751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.519609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.520262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.521620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.522211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.661176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.669186 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd2fd71f-b2eb-4e5c-81f3-a3c127b18c98 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.211098 Apr 09 21:07:36.679782 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1887/3815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:36.683528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.684211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.690805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.691411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.692261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.692705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.696707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.705417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e4023c2-5989-4531-ae4c-7a95df773123 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.197356 Apr 09 21:07:36.707791 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1929/3816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:36.712801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.713705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.720420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.721072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.722023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.722612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.762442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.771823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.776056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.777663 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8fcb952-f894-4cb7-85c2-ad7eb99450f6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.106462 Apr 09 21:07:36.789696 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1888/3817] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:36.876882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:36.885360 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3aaf32a-c4fa-4626-a1be-50a1f3007e90 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.176188 Apr 09 21:07:36.886176 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1930/3818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:36.902484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:36.903095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.909359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.909807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.910583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.911010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.934031 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'resume' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active Apr 09 21:07:36.934626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'resume' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:36.935655 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3619488-4bed-4a72-b20b-ae902f8a9ff0 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 144 microversion: 2.1 time: 0.037432 Apr 09 21:07:36.936385 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1889/3819] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:36 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 144 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:07:36.946414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.947279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.955062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.955610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.956585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.957059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.969815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:36.970426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:36.977518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.978480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:36.978743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:36.979178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.175054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:37.179279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:37.182977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0c6f0c5-1d84-4a6a-b0e9-6df1fdee788c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.241720 Apr 09 21:07:37.183910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1931/3820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:37.187199 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85f447c8-e40c-4970-8437-4c9e53ed98e0 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.222436 Apr 09 21:07:37.187780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1890/3821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:36 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:37.206385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:37.207292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:37.213776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.214227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.215339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.215462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.359366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:37.367059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8ed66ed-6653-4176-a134-5df4df22cf87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.164737 Apr 09 21:07:37.367639 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1932/3822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:37 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:37.472221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc2f3082-242f-4e83-89ee-9734a64ae9b8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ad62b125-1df7-49ad-953e-ad87b77a57c1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:37.474204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc2f3082-242f-4e83-89ee-9734a64ae9b8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:37.475184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc2f3082-242f-4e83-89ee-9734a64ae9b8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.007143 Apr 09 21:07:37.476153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:37.476760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:37.479344 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1891/3823] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:37 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:37.485580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:37.486560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:37.489457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.490036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.491198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.492158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.495615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.496317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.497519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.498207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.753493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:37.762438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:37.762994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c09fd0ee-4236-46fe-b77a-5cb988c4ca8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.281846 Apr 09 21:07:37.763542 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1892/3824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:37 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:37.780121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:37.781333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:37.789486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.790278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.791805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.793161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.798517 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bdeddbd4-d459-49aa-9384-2aa5861817ee tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1606 microversion: 2.1 time: 0.325384 Apr 09 21:07:37.799342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1933/3825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:37 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1606 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:37.809268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:37.810548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:37.819142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.820237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:37.821320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:37.822384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.030569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.033431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.039388 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba2f76b7-7211-49c1-939f-4f0468a4f25e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.235842 Apr 09 21:07:38.040272 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1934/3826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:37 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:38.040953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed30d7a7-62d1-423d-a976-ab5b0162302d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.276121 Apr 09 21:07:38.050520 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1893/3827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:37 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:38.058506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.058936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15058cb5-631c-45b1-8861-b9e6388942f7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:38.059526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15058cb5-631c-45b1-8861-b9e6388942f7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: cda08dae-ef32-4a55-af14-ed7289627935] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.060220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.064991 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-15058cb5-631c-45b1-8861-b9e6388942f7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance cda08dae-ef32-4a55-af14-ed7289627935 could not be found. Apr 09 21:07:38.065681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15058cb5-631c-45b1-8861-b9e6388942f7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance cda08dae-ef32-4a55-af14-ed7289627935 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:38.066522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15058cb5-631c-45b1-8861-b9e6388942f7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/cda08dae-ef32-4a55-af14-ed7289627935/action" status: 404 len: 111 microversion: 2.1 time: 0.013808 Apr 09 21:07:38.068079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.068595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.069492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.069936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.070975 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1894/3828] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:38 2022] POST /compute/v2.1/servers/cda08dae-ef32-4a55-af14-ed7289627935/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:07:38.075766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.076458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.084287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.084723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.086953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.087952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.160736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.171178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.172893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.174246 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5a81c58-b202-46ac-afb7-c336d1b87304 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.132395 Apr 09 21:07:38.175686 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1935/3829] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:38.199009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-27918b4d-107a-46a5-972c-3a8cfd2cf9b6 req-a7bf7aea-1814-4c40-909e-76ae104a6833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103c226-e4d1-42eb-a8c0-4a9f4d34daf3", "name": "network-vif-plugged", "status": "completed", "tag": "61bb000c-8420-4fc7-8f3f-a1f3d9041c97"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:38.207653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-27918b4d-107a-46a5-972c-3a8cfd2cf9b6 req-a7bf7aea-1814-4c40-909e-76ae104a6833 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.208259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-27918b4d-107a-46a5-972c-3a8cfd2cf9b6 req-a7bf7aea-1814-4c40-909e-76ae104a6833 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.233223 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-27918b4d-107a-46a5-972c-3a8cfd2cf9b6 req-a7bf7aea-1814-4c40-909e-76ae104a6833 service nova] Creating event network-vif-plugged:61bb000c-8420-4fc7-8f3f-a1f3d9041c97 for instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 on nch2-master-1 Apr 09 21:07:38.245596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-27918b4d-107a-46a5-972c-3a8cfd2cf9b6 req-a7bf7aea-1814-4c40-909e-76ae104a6833 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051592 Apr 09 21:07:38.249138 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1936/3830] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:07:38.268705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.270023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.270148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.278687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65c233a3-7452-435f-a89c-334704fb96ae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.206574 Apr 09 21:07:38.279193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.279935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.292738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.292738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.298106 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1895/3831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:38.310517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.311166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.318492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.318970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.319763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.320276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.520633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.525556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:38.529735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-588baf77-b8c1-49ea-8e3c-e7afd125df59 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.279265 Apr 09 21:07:38.533657 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-460e5ff2-45b2-4eed-bb9b-42737b230a7e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.232576 Apr 09 21:07:38.535392 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1896/3832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:38.537869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1937/3833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:38.551080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:38.551630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.558622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.559013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.559789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.560227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.583260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lazy-loading 'flavor' on Instance uuid 66c2d8f3-9113-4bac-b1da-8e52381492d7 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:07:38.815778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.816393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.823256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.823767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.824547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.824976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.852622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-46eaaa22-19a4-4441-8e35-6a6306ce1f48 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.305213 Apr 09 21:07:38.853845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1897/3834] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:07:38 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:07:38.864029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:38.865213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:38.873024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.873875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:38.875121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:38.875593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.005721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.015892 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1859e0cc-ad29-443c-9b2f-94c8292d8dd5 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1606 microversion: 2.1 time: 0.204054 Apr 09 21:07:39.016847 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1938/3835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1606 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:39.045609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.054112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9bbffabb-ba26-4f5c-a796-ae9496e56bff tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.194451 Apr 09 21:07:39.054721 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1898/3836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:38 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:39.061776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:39.062582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:39.070767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.071353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.072354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.072792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.193176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:39.194325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:39.201062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.201793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.203037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.203826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.300745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.309772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.311295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.312449 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c096a1a-16d7-4add-a27a-faa46eff989a tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1335 microversion: 2.54 time: 0.123678 Apr 09 21:07:39.313438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1899/3837] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:39 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:39.337424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.346139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4062c83-ba18-46c3-b0e2-6c6c3a4d9ce0 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.289989 Apr 09 21:07:39.346851 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1939/3838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:39 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:39.547549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:39.548171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:39.558883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.560347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.561458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:39.561907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:39.774245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:39.781850 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a3ad31c-bd65-47e9-b053-c09495b3d2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.238206 Apr 09 21:07:39.782433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1900/3839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:39 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:40.033450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:40.033987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:40.040372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.041181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.042138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.042571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.071301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:40.072168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:40.079382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.080055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.080995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.081645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.115657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.124808 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-548538da-f8cf-47c7-b4be-8642d68717f1 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1539 microversion: 2.1 time: 0.095241 Apr 09 21:07:40.129732 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1940/3840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:40 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:40.231824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7d6f76c6-82b1-4d9d-814e-600110d782c8 req-11b1f924-83b8-4be6-a2f5-ef1deffebf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65bd15c9-6492-4273-a5fc-12f183befa1c", "name": "network-vif-deleted", "tag": "71880d13-76a1-445e-a3c8-e6054d854829"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:40.257761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7d6f76c6-82b1-4d9d-814e-600110d782c8 req-11b1f924-83b8-4be6-a2f5-ef1deffebf23 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.258539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7d6f76c6-82b1-4d9d-814e-600110d782c8 req-11b1f924-83b8-4be6-a2f5-ef1deffebf23 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.272043 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7d6f76c6-82b1-4d9d-814e-600110d782c8 req-11b1f924-83b8-4be6-a2f5-ef1deffebf23 service nova] Creating event network-vif-deleted:71880d13-76a1-445e-a3c8-e6054d854829 for instance 65bd15c9-6492-4273-a5fc-12f183befa1c on nch2-master-1 Apr 09 21:07:40.278213 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7d6f76c6-82b1-4d9d-814e-600110d782c8 req-11b1f924-83b8-4be6-a2f5-ef1deffebf23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064613 Apr 09 21:07:40.279430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1941/3841] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:40.308650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.332590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c1771b3-4e5b-4c58-8d36-a0b673f0db17 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.265053 Apr 09 21:07:40.335542 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1901/3842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:40 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:40.340501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:40.341357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:40.361027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.361783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.363570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:40.363714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.364472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:40.364841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.372516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.373391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.374424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.375331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.565521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.576273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.579404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.581785 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-02fc24ed-e36e-4e35-99d2-26070d66270f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1356 microversion: 2.54 time: 0.253896 Apr 09 21:07:40.598003 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1942/3843] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:40 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1356 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:07:40.619425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Action: 'create', calling method: .version_select at 0x7fb08eb4a160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-34822057"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:40.652893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for project 9c7578f9ead04b7384247947593935dd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:40.664656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for user 33ea3acc687d49a9868219b4c9fa34dc and project 9c7578f9ead04b7384247947593935dd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:40.737073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:40.751309 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26a54a54-d61c-46ae-950a-2b6daf47ad00 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1522 microversion: 2.1 time: 0.390525 Apr 09 21:07:40.751992 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1902/3844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:40 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:40.800229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:40.800912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:40.815201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.817855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:40.818943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:40.836977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.066528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.078018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4cef401-901e-477d-930b-2626cbb4358b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.282797 Apr 09 21:07:41.079413 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1903/3845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:40 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:41.153025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:41.154055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.170227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.171547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.173229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.173865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.247343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.247907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.248496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lazy-loading 'fault' on Instance uuid 65bd15c9-6492-4273-a5fc-12f183befa1c {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:07:41.345516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f54a88615644f5da8173e9bade66599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4603cd745c848eba3a1645f624e590e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.355447 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3fba4afe-3e45-4093-89bc-03665322d576 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 200 len: 1210 microversion: 2.1 time: 0.216003 Apr 09 21:07:41.356110 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1904/3846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:41 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 1210 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:41.369397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:41.370012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.377666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.378162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.379237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.379902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.507640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for project 9c7578f9ead04b7384247947593935dd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:41.515052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Getting quotas for user 33ea3acc687d49a9868219b4c9fa34dc and project 9c7578f9ead04b7384247947593935dd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:41.539918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0458d55a-3cad-4b1b-907a-e6646b69fa2d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.54 time: 0.924681 Apr 09 21:07:41.548432 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1943/3847] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 21:07:40 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 934 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:07:41.553922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-34822057", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:41.555822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.561429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.562772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.563336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.564226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.564768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.573874 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d2a2491-3e77-40ba-b4a0-0bc4355304c9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.214851 Apr 09 21:07:41.584007 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1905/3848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:41 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:41.662423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:41.662841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:41.663482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:41.664250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:41.664818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:41.745977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.756635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.757363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.759116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.759116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.771328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:41.773152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.786793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.787591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.788879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.793363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.809834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98d63514-6029-4df5-8fb8-2c20df1192f3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "POST /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b/action" status: 202 len: 1137 microversion: 2.54 time: 0.259977 Apr 09 21:07:41.810868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1944/3849] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Apr 9 21:07:41 2022] POST /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b/action => generated 1137 bytes in 262 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 09 21:07:41.837683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:41.838824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:41.846725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.847280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.848654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:41.849512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:41.945238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.954184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.962152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:41.964950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b6c6b1a-31da-4da4-a266-1bc304d35fc2 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.132895 Apr 09 21:07:41.965738 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1945/3850] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:41 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:42.047016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:42.056058 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd977d83-8752-440a-bcb9-df8d4ab3b991 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1507 microversion: 2.1 time: 0.289138 Apr 09 21:07:42.056669 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1906/3851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:41 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:42.072699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.073518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:42.080530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.081168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.094816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.097316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.099625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.100246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:42.121451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.122201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.123303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.123849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.310071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:42.313764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:42.318315 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d68ad82-8e8a-4c98-b6b3-3ad9ea71a96c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 200 len: 1507 microversion: 2.1 time: 0.249869 Apr 09 21:07:42.319261 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1946/3852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:42 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:42.323331 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-128b8abf-638a-48f9-aef7-aed18d09ec8d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.228261 Apr 09 21:07:42.323901 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1907/3853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:42 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:42.339827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.340332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:42.346667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.347116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.347880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.348310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.371556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.372166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] [instance: 65bd15c9-6492-4273-a5fc-12f183befa1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:42.375209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:42.378481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.378928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.379700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.380133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.393941 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] HTTP exception thrown: Instance 65bd15c9-6492-4273-a5fc-12f183befa1c could not be found. Apr 09 21:07:42.394534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Returning 404 to user: Instance 65bd15c9-6492-4273-a5fc-12f183befa1c could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:42.395382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-607d46b9-8d61-4030-8e0f-55796696b6c9 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c" status: 404 len: 111 microversion: 2.1 time: 0.027700 Apr 09 21:07:42.396013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1908/3854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:42 2022] GET /compute/v2.1/servers/65bd15c9-6492-4273-a5fc-12f183befa1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:07:42.406686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85197803-71c7-4ce9-ae7f-20c74127b841 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] Calling method '.version_select at 0x7fb08ec02ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.425260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85197803-71c7-4ce9-ae7f-20c74127b841 tempest-ServersTestBootFromVolume-95666480 tempest-ServersTestBootFromVolume-95666480-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769702859" status: 202 len: 0 microversion: 2.1 time: 0.024373 Apr 09 21:07:42.425848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1909/3855] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769702859 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:07:42.480777 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8faa95e0-ec06-4eb8-b68c-9aa22993eccd tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 204 len: 0 microversion: 2.1 time: 0.143909 Apr 09 21:07:42.482554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1947/3856] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:42 2022] DELETE /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:07:42.591893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:42.593754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:42.595464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1300249492", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "aca23e59-7431-4b5d-8caa-e391d337ad7c"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:42.601854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.618087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.619148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:42.619843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:42.674134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] validate_networks() for [('aca23e59-7431-4b5d-8caa-e391d337ad7c', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:42.994258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.004107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-777210cd-3560-4bf6-96f1-a3947f0c7b8e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.416752 Apr 09 21:07:43.005192 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1948/3857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:42 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:43.010927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:43.011752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:43.019866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.020411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.021315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.021949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.100406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.109660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.111253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.112571 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-527a2366-9f7b-415e-9dec-3eef11d71865 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.105777 Apr 09 21:07:43.114970 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1949/3858] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:43 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:43.340188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:43.340803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:43.348284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.348994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.349907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.350492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.582465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.593137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9407bd20-3719-4c2c-9bd2-aae8b1330404 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.256452 Apr 09 21:07:43.594698 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1950/3859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:43 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:43.611350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:07:43.611976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:07:43.612513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:07:43.612928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:07:43.613365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:07:43.624256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.624710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.625842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:43.626291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:43.659949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:43.665572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Getting quotas for user 4719eac69a2f4f25bbb1abfb3ef7c980 and project 0f4ad084f5dd44c2b99960f4df5cb0e8. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:43.678586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:07:43.680885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:07:43.735155 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0ca318a-6da4-4b05-81ab-decaba939cf4 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148080 Apr 09 21:07:43.735961 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1910/3860] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:07:43.747438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ff1db12-822b-49e0-a770-4f3c0d8c9aef tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:43.748337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5ff1db12-822b-49e0-a770-4f3c0d8c9aef tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:43.814642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5ff1db12-822b-49e0-a770-4f3c0d8c9aef tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:43.822096 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ff1db12-822b-49e0-a770-4f3c0d8c9aef tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1218 microversion: 2.1 time: 0.079140 Apr 09 21:07:43.823205 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1951/3861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:43 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:44.021735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:44.022361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:44.030455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.030913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.031772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.032468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.131822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:44.132520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:44.143875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.145175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.147300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.148791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.267399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:44.275556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:44.281156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:44.282654 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-447bcf27-ae71-44e4-b461-6cf40bd13b90 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.155255 Apr 09 21:07:44.283725 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1952/3862] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:44 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:44.333748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:44.346841 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2135469a-f138-4f04-9e4c-d0561665e869 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.328912 Apr 09 21:07:44.349286 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1911/3863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:44 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:44.615968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:44.617657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:44.626441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.627824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.629522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.630303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.840428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:44.841229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:44.853940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.854539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.855435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:44.855853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:44.928857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:44.941651 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b87d3b6-e154-4b73-833f-6aaeedfb9087 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1270 microversion: 2.1 time: 0.106906 Apr 09 21:07:44.943036 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1912/3864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:44 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:45.026780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:45.049467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-489c3580-4590-4c50-9b05-30b579813316 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.439633 Apr 09 21:07:45.058909 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1953/3865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:44 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:45.228721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1f2f475b-e7c1-4058-9ade-ace5e592e07d req-759f36fc-fee1-4b0f-b7b8-e017ac8d83b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103c226-e4d1-42eb-a8c0-4a9f4d34daf3", "name": "network-vif-deleted", "tag": "61bb000c-8420-4fc7-8f3f-a1f3d9041c97"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:45.246250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1f2f475b-e7c1-4058-9ade-ace5e592e07d req-759f36fc-fee1-4b0f-b7b8-e017ac8d83b3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.246912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1f2f475b-e7c1-4058-9ade-ace5e592e07d req-759f36fc-fee1-4b0f-b7b8-e017ac8d83b3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.263114 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1f2f475b-e7c1-4058-9ade-ace5e592e07d req-759f36fc-fee1-4b0f-b7b8-e017ac8d83b3 service nova] Creating event network-vif-deleted:61bb000c-8420-4fc7-8f3f-a1f3d9041c97 for instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 on nch2-master-1 Apr 09 21:07:45.269003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1f2f475b-e7c1-4058-9ade-ace5e592e07d req-759f36fc-fee1-4b0f-b7b8-e017ac8d83b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044034 Apr 09 21:07:45.270318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1913/3866] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:45.302755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:45.305428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:45.313060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.318589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.318589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.320648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.365612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:45.366388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:45.378775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.380344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.383044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.383523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.536692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:45.549511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:45.551302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:45.552994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b1bd9768-a1fa-4da7-a285-ddbd4e21baec tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.255081 Apr 09 21:07:45.557749 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1954/3867] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:45 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:45.704614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:45.712140 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-482aa105-2ef7-4d7a-b186-43fa7022795e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.351761 Apr 09 21:07:45.717100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1914/3868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:45 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:45.959233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:45.960656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:45.976330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.977281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:45.979309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:45.980780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.078662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:46.079348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:46.086402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.086880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.088160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.088805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.101658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:46.114493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91e75adc-7a24-43c6-816d-9ccd8fa2c888 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1276 microversion: 2.1 time: 0.159068 Apr 09 21:07:46.115103 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1955/3869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:45 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:46.284352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:46.293924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cfa97f89-ebc6-4dbf-8086-f59f8e7435d3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.229877 Apr 09 21:07:46.295177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1915/3870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:46 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:46.575577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:46.576198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:46.582977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.583435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.584222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.584646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.680120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:46.690032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:46.692113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:46.693364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-706f59ba-e6fc-4c94-b107-782765eacc2f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.121935 Apr 09 21:07:46.694270 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1956/3871] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:46 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:46.733057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:46.733761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:46.740083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.740543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:46.741506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:46.741953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.137594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.143568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:47.145947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:47.152611 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ead9fcca-1100-45ee-8ec5-a1af717d8e87 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.423486 Apr 09 21:07:47.164755 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1916/3872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:46 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:47.167313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.169662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.171356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.172954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.311963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:47.312603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:47.320890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.329703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.330683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.331317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.766931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.782433 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-00a99693-1c42-41ed-81be-bb538e5d6f21 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.654320 Apr 09 21:07:47.784093 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1957/3873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:47 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:47.797076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:47.798299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:47.805292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.806203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.806896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.808018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:47.809390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:47.812752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-deaff30f-291d-40c2-83e5-194d5e0c9b3c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.504868 Apr 09 21:07:47.829436 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1917/3874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:47 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:47.926172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.954409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.956452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:47.958546 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b6783c1-53bf-4477-823d-5804040a241f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.172886 Apr 09 21:07:47.959676 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1958/3875] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:47 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:48.036396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-0f2be230-b68d-4c40-b22a-0548a39a86ec req-12bb95c7-d2df-414a-a10b-fa5439380f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b46a6da-35b7-42bd-9565-82a62ba4cd93", "tag": "8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:48.050571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0f2be230-b68d-4c40-b22a-0548a39a86ec req-12bb95c7-d2df-414a-a10b-fa5439380f68 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.052164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0f2be230-b68d-4c40-b22a-0548a39a86ec req-12bb95c7-d2df-414a-a10b-fa5439380f68 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.069546 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-0f2be230-b68d-4c40-b22a-0548a39a86ec req-12bb95c7-d2df-414a-a10b-fa5439380f68 service nova] Creating event network-changed:8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3 for instance 9b46a6da-35b7-42bd-9565-82a62ba4cd93 on nch1-master-1 Apr 09 21:07:48.089236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-0f2be230-b68d-4c40-b22a-0548a39a86ec req-12bb95c7-d2df-414a-a10b-fa5439380f68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056642 Apr 09 21:07:48.091449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1918/3876] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:48.173962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:48.175112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:48.184025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.184742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.186258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.186893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.507933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:48.522905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-748d76c6-a025-43ab-b9aa-1e0ad1fa432d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.354968 Apr 09 21:07:48.523788 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1959/3877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:48 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:48.800600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:48.801330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:48.807781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.808307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.808999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.809459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.838368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:48.839024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:48.846609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.858300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:48.859444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:48.860127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:49.007233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.017581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-255d4897-0de6-4330-b9bb-d1b341285d8a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.221783 Apr 09 21:07:49.028824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1919/3878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:48 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:49.034682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:49.035424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:49.045897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:49.046360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:49.047157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:49.047716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:49.070530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.078488 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eda5f479-7b96-419e-9038-8f310948e768 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.244648 Apr 09 21:07:49.079406 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1960/3879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:48 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:49.128450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.137346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.140061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.141387 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-857062e1-a7ab-42aa-8f0a-248509f53e09 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.111266 Apr 09 21:07:49.142018 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1920/3880] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:49 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:49.543526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:49.544357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:49.550637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:49.551205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:49.551981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:49.552542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:49.674054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2773ca3-95c4-49fe-a05f-72881b9245da tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2086662424", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:49.676997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e2773ca3-95c4-49fe-a05f-72881b9245da tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] HTTP exception thrown: min_count must be <= max_count Apr 09 21:07:49.677949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2773ca3-95c4-49fe-a05f-72881b9245da tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Returning 400 to user: min_count must be <= max_count {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:49.678997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2773ca3-95c4-49fe-a05f-72881b9245da tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.270091 Apr 09 21:07:49.680090 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1961/3881] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:49 2022] POST /compute/v2.1/servers => generated 74 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 09 21:07:49.712190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:49.723386 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e05a900-6fb1-4d54-b868-81c4f3b291fa tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.183554 Apr 09 21:07:49.723770 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1921/3882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:49 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:49.755108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b49f2fe8-0407-482b-a9db-4fd31460a4be tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2099188867", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "max_count": 0}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:49.757627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b49f2fe8-0407-482b-a9db-4fd31460a4be tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:49.758446 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b49f2fe8-0407-482b-a9db-4fd31460a4be tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007542 Apr 09 21:07:49.758979 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1962/3883] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:49.809507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70348619-ac70-484a-a911-565b2947caf0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-228358712", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "max_count": 2.5}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:49.811015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70348619-ac70-484a-a911-565b2947caf0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:49.811819 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70348619-ac70-484a-a911-565b2947caf0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006258 Apr 09 21:07:49.812346 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1922/3884] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:49.858811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5e85b8d-f1ab-4b18-9433-214e3158c135 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1848290130", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 0}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:49.860207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5e85b8d-f1ab-4b18-9433-214e3158c135 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:49.861022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5e85b8d-f1ab-4b18-9433-214e3158c135 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006249 Apr 09 21:07:49.861577 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1963/3885] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:49.912755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-484d193e-852b-4a39-85ce-369b7048d8a0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1294790849", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 2.5}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:49.914308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-484d193e-852b-4a39-85ce-369b7048d8a0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:49.915043 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-484d193e-852b-4a39-85ce-369b7048d8a0 tempest-MultipleCreateNegativeTestJSON-1181439686 tempest-MultipleCreateNegativeTestJSON-1181439686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006377 Apr 09 21:07:49.915596 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1923/3886] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:50.035407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:50.036089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:50.043798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.044579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.045605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.046408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.097648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:50.098625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:50.106962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.107661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.108671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.109351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.306389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.315205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e093c91-2bd5-4f8f-b306-9673930f50a7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.283781 Apr 09 21:07:50.315866 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1964/3887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:50 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:50.321016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:50.321717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:50.328494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.329241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.330416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.331073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.392677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.401198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84a14d70-9a2e-44e9-bc81-ec9c53851fab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.308913 Apr 09 21:07:50.402111 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1924/3888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:50 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:50.418074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.430734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.432400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.433596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07972065-11af-4d17-bc38-8df9453e231f tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.116358 Apr 09 21:07:50.437375 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1965/3889] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:50 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:50.740675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:50.741326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:50.747801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.748510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.749279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:50.749878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:50.903179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:50.915519 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-976d9267-a0a9-421e-af01-370879f3fabc tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.178674 Apr 09 21:07:50.916122 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1925/3890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:50 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:51.333394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:51.334995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:51.343860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.344405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.345301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.348798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.422970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:51.423736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:51.434142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.434841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.435865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.436748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.570817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:51.580338 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae09078a-7a66-49bc-9479-da72b26f8ea7 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.251441 Apr 09 21:07:51.591606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1966/3891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:51 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:51.598428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:51.599493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:51.607417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.608538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.609570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.610213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.628111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:51.640584 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5cdfcb7-8785-4162-b3db-4987350ddaba tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.222045 Apr 09 21:07:51.646185 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1926/3892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:51 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:51.705623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:51.714712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:51.718938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:51.720707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eb34e0cd-03dd-43ea-8763-5d087c1ab2e6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.127033 Apr 09 21:07:51.721962 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1967/3893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:51 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:51.932623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:51.933274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:51.942375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.943115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:51.944101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:51.944696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.096382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.103879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9cfc8b17-81ab-4035-98df-b423b9b6a55b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.175758 Apr 09 21:07:52.104468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1927/3894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:51 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:52.599205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:52.602960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:52.609231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.609623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.610424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.610865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.657784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:52.658424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:52.665834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.666640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.667620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.668220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.807703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.819478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dcdb6e73-228a-4209-852b-5cd94c44c22c tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.224454 Apr 09 21:07:52.826063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1968/3895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:52 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:52.841867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:52.842536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:52.849453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.850128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.851321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:52.851924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:52.885066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.893705 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4904296b-340f-4a19-95c9-c0196f43b4a9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.241235 Apr 09 21:07:52.894852 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1928/3896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:52 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:52.934792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.945519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.947285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:52.948668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ec7669a-7e1f-4c65-8372-fdda7e874ae5 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.111639 Apr 09 21:07:52.949473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1969/3897] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:52 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:53.120999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.121679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:53.128205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.128662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.129692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.130169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.239637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Action: 'create', calling method: .version_select at 0x7fb08e64e700>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:53.259486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Getting quotas for project c9f995113d394d2fa8d8f8a6b69fdf80. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:53.278233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:53.280271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Getting quotas for user dfc0efaed98343d59dd81317352938e6 and project c9f995113d394d2fa8d8f8a6b69fdf80. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:53.286252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89f5fbee-e0c5-4be9-a80b-3139124308cf tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.169760 Apr 09 21:07:53.287393 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1970/3898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:53 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:53.322807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Getting quotas for project c9f995113d394d2fa8d8f8a6b69fdf80. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:53.328289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Getting quotas for user dfc0efaed98343d59dd81317352938e6 and project c9f995113d394d2fa8d8f8a6b69fdf80. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:53.341179 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5d54e60a-c420-4a46-99ba-a6c16c7be19a tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.357334 Apr 09 21:07:53.341797 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1929/3899] 10.222.0.30 () {62 vars in 1213 bytes} [Sat Apr 9 21:07:52 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:07:53.352424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0d78bb6-7dc9-477a-9c85-ea35bcd62f00 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.366123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0d78bb6-7dc9-477a-9c85-ea35bcd62f00 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.017649 Apr 09 21:07:53.366869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1971/3900] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Apr 9 21:07:53 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:07:53.376834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1837fb2f-63e9-4bdc-8381-1142584a0394 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.395254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1837fb2f-63e9-4bdc-8381-1142584a0394 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280" status: 200 len: 235 microversion: 2.64 time: 0.022443 Apr 09 21:07:53.395801 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1930/3901] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Apr 9 21:07:53 2022] GET /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280 => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:07:53.405760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1579fe4c-0ac1-4634-8a98-95f33af1e945 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.433702 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1579fe4c-0ac1-4634-8a98-95f33af1e945 tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280" status: 204 len: 0 microversion: 2.64 time: 0.031785 Apr 09 21:07:53.434302 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1972/3902] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Apr 9 21:07:53 2022] DELETE /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:07:53.443877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59e1db7c-080b-48a1-a074-998822c2085c tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.449896 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-59e1db7c-080b-48a1-a074-998822c2085c tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] HTTP exception thrown: Instance group aa900040-5de3-4014-83c0-a21cc70d8280 could not be found. Apr 09 21:07:53.450486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59e1db7c-080b-48a1-a074-998822c2085c tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] Returning 404 to user: Instance group aa900040-5de3-4014-83c0-a21cc70d8280 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:07:53.451370 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-59e1db7c-080b-48a1-a074-998822c2085c tempest-ServerGroup264TestJSON-75732724 tempest-ServerGroup264TestJSON-75732724-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280" status: 404 len: 117 microversion: 2.64 time: 0.011661 Apr 09 21:07:53.451910 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1931/3903] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Apr 9 21:07:53 2022] DELETE /compute/v2.1/os-server-groups/aa900040-5de3-4014-83c0-a21cc70d8280 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:07:53.762010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9a6a3dda-f38e-49bc-8245-022aad8c4e63 req-1ef8b6a8-1960-4702-8160-f795ae09fe29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b46a6da-35b7-42bd-9565-82a62ba4cd93", "name": "network-vif-plugged", "status": "completed", "tag": "8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:53.774841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9a6a3dda-f38e-49bc-8245-022aad8c4e63 req-1ef8b6a8-1960-4702-8160-f795ae09fe29 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.775460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9a6a3dda-f38e-49bc-8245-022aad8c4e63 req-1ef8b6a8-1960-4702-8160-f795ae09fe29 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.796794 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9a6a3dda-f38e-49bc-8245-022aad8c4e63 req-1ef8b6a8-1960-4702-8160-f795ae09fe29 service nova] Creating event network-vif-plugged:8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3 for instance 9b46a6da-35b7-42bd-9565-82a62ba4cd93 on nch1-master-1 Apr 09 21:07:53.802383 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9a6a3dda-f38e-49bc-8245-022aad8c4e63 req-1ef8b6a8-1960-4702-8160-f795ae09fe29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044801 Apr 09 21:07:53.803615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1973/3904] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:53.841853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.843153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:53.850967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.851765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.853102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.853952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.912701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:53.913415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:53.923521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.924201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:53.925237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:53.925679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:54.566989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.574465 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac7e21e7-7f91-4fe5-8e4e-bae44e2005ce tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.736419 Apr 09 21:07:54.575056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1932/3905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:53 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:54.581170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:54.582018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:54.589271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:54.589993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:54.591024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:54.593478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:54.605485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.621971 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-804c50b4-4a35-47e5-8897-3cf875635d7c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.712410 Apr 09 21:07:54.622612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1974/3906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:53 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:54.631077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:54.637695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:54.646376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:54.647032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:54.647823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:54.648256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:54.669740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.678649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.680175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.681455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a12e261b-603a-4ac1-b26a-bfa11df22520 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.104187 Apr 09 21:07:54.681954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1933/3907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:54 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:54.810078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:54.818504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-525d1202-8a79-4165-b1c3-d3fd4d993367 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.193699 Apr 09 21:07:54.819070 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1975/3908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:54 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:55.591678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:55.592656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:55.601256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.601786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.602635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.603221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.641377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:55.642030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:55.652540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.657415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.658291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.658756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.811044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:55.828412 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-343ad16a-4f1c-452c-92f0-c10f8b921225 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1318 microversion: 2.1 time: 0.240844 Apr 09 21:07:55.829240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1934/3909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:55 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:55.835492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:55.836526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:55.847329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.848219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.849789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.850449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.892596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:55.907835 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d829114-1549-4780-8a56-9e32c199a554 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.271147 Apr 09 21:07:55.909130 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1976/3910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:55 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:55.916459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:55.917223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:55.926968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.929086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.930016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:55.930639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:55.998349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:56.009312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:56.011182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:56.012747 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a40ba893-d37d-4dbc-8ddc-d400ca63ccfd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.182360 Apr 09 21:07:56.025383 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1935/3911] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:55 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:56.126338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:56.136019 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22d7989a-4d83-4a29-9886-ce3d8b755160 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1533 microversion: 2.1 time: 0.225727 Apr 09 21:07:56.147416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1977/3912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:55 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1533 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:56.847623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:56.848820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:56.856920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:56.857722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:56.858524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:56.859126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:56.926482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:56.927584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:56.937508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:56.937979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:56.938770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:56.939215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.086017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.101422 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a6ee2f7-8881-41f1-96d2-1820592af74f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1507 microversion: 2.1 time: 0.259398 Apr 09 21:07:57.117747 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1936/3913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:56 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:57.122798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:57.123494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.144803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.155275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.156337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.158725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.164444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.173831 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03dd6a19-eb48-4fde-a98a-560999d32fcc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.251934 Apr 09 21:07:57.174568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1978/3914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:56 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:57.179405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:57.180404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.186770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.187457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.188391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.188976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.298813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.307414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.309451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.311068 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c02c9de0-f657-40a4-8f6b-28aed2fbb7dd tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.192159 Apr 09 21:07:57.311649 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1937/3915] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:57 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:57.316470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:57.317506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.323769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.324597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.325599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.326417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.389527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.397352 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af476684-3184-47cf-bb26-6a8516b32033 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1507 microversion: 2.1 time: 0.221617 Apr 09 21:07:57.398116 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1979/3916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:57 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:57.496501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.503797 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-092dbe93-7c19-4c0e-9d9f-28f2f1ac7453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1533 microversion: 2.1 time: 0.191015 Apr 09 21:07:57.504379 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1938/3917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:57 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1533 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:57.508839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:57.510514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.516440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.516890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.517887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.518121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.584392 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b65d760-64d0-4d4f-af15-c92f0353e261 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "PUT /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1079 microversion: 2.1 time: 0.078955 Apr 09 21:07:57.594489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1939/3918] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:07:57 2022] PUT /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:57.599741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:57.600361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.617591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.618194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.619059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.619501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.659954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: .version_select at 0x7fb08e255940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1859716690", "policies": ["affinity"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:57.680944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:57.687149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:57.737299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:57.746031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:57.760746 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-420e952a-a8e1-43d6-a7e2-ea53a18eed39 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.351389 Apr 09 21:07:57.762225 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1980/3919] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Apr 9 21:07:57 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:57.770003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:57.772206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: .version_select at 0x7fb08ed56670>, body: {"server_group": {"name": "tempest-server-group-1697629322", "policies": ["affinity"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:57.778407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63bd60bc-822a-40e7-a4c3-55bd689cd3fa tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1505 microversion: 2.1 time: 0.182474 Apr 09 21:07:57.779663 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1940/3920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:57 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:57.796693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:57.797873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:57.804779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.805167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:57.805447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.807097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:57.807607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:57.812638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:57.868457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:57.876464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:57.912434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-19c21079-78e0-4296-acfb-f0f84f1027e1 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.143948 Apr 09 21:07:57.918423 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1981/3921] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 21:07:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:57.923423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: .version_select at 0x7fb08ed56280>, body: {"server_group": {"name": "tempest-server-group-1697629322", "policies": ["affinity"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:57.946277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:57.954293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:58.040180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.051900 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0302b0e0-57c9-4b21-90c2-37f240f70dca tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1505 microversion: 2.1 time: 0.259678 Apr 09 21:07:58.052068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:58.053357 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1941/3922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:57 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.062243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:58.075904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:58.077885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.078401 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b56afbbc-a551-4740-8da6-a9e732c795a2 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.158643 Apr 09 21:07:58.079411 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1982/3923] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 21:07:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:58.085256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.086090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.087063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.087679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.090068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3032c764-ca75-4a56-822b-4f69da98d5d8 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.123530 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3032c764-ca75-4a56-822b-4f69da98d5d8 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/f74658f8-45a7-4193-97fa-b7f92bbeb6e4" status: 204 len: 0 microversion: 2.1 time: 0.038328 Apr 09 21:07:58.124498 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1983/3924] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:07:58 2022] DELETE /compute/v2.1/os-server-groups/f74658f8-45a7-4193-97fa-b7f92bbeb6e4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:07:58.132835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed0f14bf-4fb8-4358-844a-be1284bbd763 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.143048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed0f14bf-4fb8-4358-844a-be1284bbd763 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.014349 Apr 09 21:07:58.144608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1984/3925] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:58.156305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f106d9e7-470f-4423-9203-2aff49777b5f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.191582 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef05c218-3bdf-4fef-9ea3-b50b6fa5dfe1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "PUT /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1081 microversion: 2.1 time: 0.120650 Apr 09 21:07:58.201148 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1942/3926] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:07:58 2022] PUT /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1081 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.205364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f106d9e7-470f-4423-9203-2aff49777b5f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/17b4b215-daa9-4393-a4dd-ed474d631f10" status: 204 len: 0 microversion: 2.1 time: 0.054865 Apr 09 21:07:58.206145 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1985/3927] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:07:58 2022] DELETE /compute/v2.1/os-server-groups/17b4b215-daa9-4393-a4dd-ed474d631f10 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:58.206747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.207781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.211463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.212081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.214225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.214687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.216132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.216910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.221862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.222318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.223196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.223530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.432261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.449959 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38d61ff2-2b09-441c-9118-31788f65ae9f tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.247394 Apr 09 21:07:58.451275 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1943/3928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.456764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.465980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d217d435-0651-4a07-a25c-609d5e37b33c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.469311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93c17b42-f3a6-49fa-a1f6-31e22e7a758d tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1507 microversion: 2.1 time: 0.261849 Apr 09 21:07:58.469943 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1986/3929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.474797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.475407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.492422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.492776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.493492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.493932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.499664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d217d435-0651-4a07-a25c-609d5e37b33c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045800 Apr 09 21:07:58.500704 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1944/3930] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:58.505580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.506366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.513487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.513972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.514758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.515198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.633543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.645875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.647689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.649086 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9fac6200-ba85-42f4-a84c-b2278089eabf tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.177998 Apr 09 21:07:58.650290 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1987/3931] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:58.657637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: .version_select at 0x7fb08ee24af0>, body: {"server_group": {"name": "tempest-server-group-64423986", "policies": ["affinity"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:58.684369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:58.691380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:58.711783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.720136 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a882196-4001-441c-9773-cc0430c1b2a1 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1507 microversion: 2.1 time: 0.218220 Apr 09 21:07:58.721887 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1945/3932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.726734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.727460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.733726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.741884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.743182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.743741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.774167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:58.792081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:58.823380 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e9d795d-fb65-41fc-acea-92d334a5e0be tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.170317 Apr 09 21:07:58.824273 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1988/3933] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 21:07:58 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:58.834024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:58.835025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:58.842065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.842498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.843710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:58.844584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:58.895339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:58.922777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:58.935597 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1448c87-0989-4b9d-ba3c-28c74f1830c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.212097 Apr 09 21:07:58.948207 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1946/3934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:58 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:58.954376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0bee730-7193-4019-9009-d50f253682e4 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.005372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0bee730-7193-4019-9009-d50f253682e4 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/89ce5f6f-0ca3-4086-87ec-97a463bf2a8d" status: 204 len: 0 microversion: 2.1 time: 0.055518 Apr 09 21:07:59.006183 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1947/3935] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:07:58 2022] DELETE /compute/v2.1/os-server-groups/89ce5f6f-0ca3-4086-87ec-97a463bf2a8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:59.022945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6394cab-12c4-403c-806e-bb10b53be225 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.042687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6394cab-12c4-403c-806e-bb10b53be225 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032031 Apr 09 21:07:59.044643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1948/3936] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:07:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:59.059993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: .version_select at 0x7fb098486820>, body: {"server_group": {"name": "tempest-server-group-1860830529", "policies": ["anti-affinity"]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:59.061336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1b299ac-2ae3-4d63-960c-39b843c8d462 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 204 len: 0 microversion: 2.1 time: 0.230795 Apr 09 21:07:59.063170 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1989/3937] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:58 2022] DELETE /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:59.076124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.077230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:59.079759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:59.089522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:59.092659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.093592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.097262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.097951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.142767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:07:59.184980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:07:59.200025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_groups'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:07:59.231581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3496ced2-cc4e-447d-a33e-6fc4fb56f50c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.179380 Apr 09 21:07:59.240257 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1949/3938] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 21:07:59 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:07:59.245189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92f69b5d-1516-4c7e-a1f9-a96ebf57962e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.251468 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.api [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Instance is already in deleting state, ignoring this request Apr 09 21:07:59.255037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9860fb7-3e37-4f59-86c9-cd78f877dca9 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 204 len: 0 microversion: 2.1 time: 0.183587 Apr 09 21:07:59.257088 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1990/3939] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:07:59 2022] DELETE /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:59.265572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.267905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:59.279036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.280127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.280998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.281546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.290323 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92f69b5d-1516-4c7e-a1f9-a96ebf57962e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/9e10b484-02e1-4b5c-bb6c-1c201dd61e19" status: 204 len: 0 microversion: 2.1 time: 0.048979 Apr 09 21:07:59.291331 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1950/3940] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:07:59 2022] DELETE /compute/v2.1/os-server-groups/9e10b484-02e1-4b5c-bb6c-1c201dd61e19 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:07:59.299640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ee16778-9722-4533-80c2-7ff67b62e2bb tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.322364 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ee16778-9722-4533-80c2-7ff67b62e2bb tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023900 Apr 09 21:07:59.329000 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1951/3941] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:07:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:07:59.467642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.468584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:59.485947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.486582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.487394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.487835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.500037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:59.507725 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6c3a4fe-86e5-47d2-95ec-096c9f1c4594 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1513 microversion: 2.1 time: 0.246022 Apr 09 21:07:59.519378 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1991/3942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:59 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:07:59.519378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1097301129", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "d5d3d6c0-0a35-4735-83f2-767b0bfabafa"}]}, "os:scheduler_hints": {"group": "043544cc-68ae-444b-a6f8-75a61461f68c"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:07:59.596375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] validate_networks() for [('d5d3d6c0-0a35-4735-83f2-767b0bfabafa', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:07:59.726068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:59.736663 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82c861b5-8318-4b1f-ad16-54003470edee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.272907 Apr 09 21:07:59.737468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1952/3943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:07:59 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:07:59.745577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:07:59.749254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:07:59.755786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.759661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.760502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:07:59.760951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:07:59.942791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:59.955432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:59.958547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:07:59.965480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd71b1b1-870f-4d2f-a0ac-9a938fe23e49 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.227123 Apr 09 21:07:59.966617 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1953/3944] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:07:59 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:07:59.983582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f769fd7e-3d2a-4b40-ac8d-bf98d7c4432a req-70fb2d77-ddc9-4d78-85f9-25141bf9c565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "name": "network-vif-plugged", "status": "completed", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:00.001482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f769fd7e-3d2a-4b40-ac8d-bf98d7c4432a req-70fb2d77-ddc9-4d78-85f9-25141bf9c565 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.002618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f769fd7e-3d2a-4b40-ac8d-bf98d7c4432a req-70fb2d77-ddc9-4d78-85f9-25141bf9c565 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.016355 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f769fd7e-3d2a-4b40-ac8d-bf98d7c4432a req-70fb2d77-ddc9-4d78-85f9-25141bf9c565 service nova] Creating event network-vif-plugged:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch1-master-1 Apr 09 21:08:00.022494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f769fd7e-3d2a-4b40-ac8d-bf98d7c4432a req-70fb2d77-ddc9-4d78-85f9-25141bf9c565 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054103 Apr 09 21:08:00.023978 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1954/3945] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:00.030496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:00.031447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:00.038314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.038761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.039543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.039977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.267854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:00.268538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:00.269561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:00.270080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:00.270731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:00.294324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:00.305089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b91b9916-6228-4f98-aa2c-91cd460585f3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.277486 Apr 09 21:08:00.305089 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1955/3946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:00 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:00.315683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.316229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.317297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.317558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.338822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:00.346163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:00.414078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:00.418294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:00.520730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:00.527484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:00.529550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:00.530211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:00.538437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.538889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.539827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.540282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.579246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:00.586773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Getting quotas for user be8710e814d542608427c3386a09708a and project 535d9672c979478f9aac7df36e55fc72. Resources: {'server_group_members'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:00.619448 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23b746ff-c9e3-4064-9436-fce0040c2b1e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107528 Apr 09 21:08:00.620474 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1992/3947] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:00.636915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e32f553f-de76-4bff-a0a3-e893317daf89 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:00.639797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e32f553f-de76-4bff-a0a3-e893317daf89 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:00.777392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e32f553f-de76-4bff-a0a3-e893317daf89 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:00.788688 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e32f553f-de76-4bff-a0a3-e893317daf89 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1213 microversion: 2.1 time: 0.161323 Apr 09 21:08:00.794259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1993/3948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:00 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:00.802526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:00.806016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:00.814113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.814573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.815866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:00.816227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:00.890705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:00.901890 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b1def5b6-6852-4e25-8405-f906ca32decb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1513 microversion: 2.1 time: 0.378519 Apr 09 21:08:00.906426 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1956/3949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:00 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:00.988158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:00.989115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:01.001818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.002382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.004484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.006822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.153905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.172196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.178404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.181838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5bfff776-4a04-44fd-95e9-7838354e64f0 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.198337 Apr 09 21:08:01.187450 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1957/3950] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:00 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:01.321348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:01.322101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:01.339921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.340533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.347183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.347650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.449652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.459855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d0eaa2b-ac72-4520-9fa9-9333cd917044 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.662845 Apr 09 21:08:01.460346 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1994/3951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:00 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:01.614092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.621981 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7570e766-933e-42b1-97c1-472ba03d438c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.304903 Apr 09 21:08:01.629330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1958/3952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:01 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:01.812256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:01.813000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:01.813160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9d951c50-afa9-43b5-85f8-f12b944713a6 req-e269b810-965f-4ea2-8040-66ffa8053902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b46a6da-35b7-42bd-9565-82a62ba4cd93", "name": "network-vif-deleted", "tag": "8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:01.825652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9d951c50-afa9-43b5-85f8-f12b944713a6 req-e269b810-965f-4ea2-8040-66ffa8053902 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.826332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9d951c50-afa9-43b5-85f8-f12b944713a6 req-e269b810-965f-4ea2-8040-66ffa8053902 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.826539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.827101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.828199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.829416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.840254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9d951c50-afa9-43b5-85f8-f12b944713a6 req-e269b810-965f-4ea2-8040-66ffa8053902 service nova] Creating event network-vif-deleted:8eca0edf-fe32-4ebf-a7d0-a0abcf52f2f3 for instance 9b46a6da-35b7-42bd-9565-82a62ba4cd93 on nch1-master-1 Apr 09 21:08:01.847615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9d951c50-afa9-43b5-85f8-f12b944713a6 req-e269b810-965f-4ea2-8040-66ffa8053902 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038358 Apr 09 21:08:01.849003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1959/3953] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:01.925516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:01.926879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:01.943860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:01.945376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.945837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.948225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:01.948691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:01.957307 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3f316481-827a-49f8-bf60-c3397b39d655 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1209 microversion: 2.1 time: 0.150877 Apr 09 21:08:01.959030 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1995/3954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:01 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:02.081417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4719eac69a2f4f25bbb1abfb3ef7c980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4ad084f5dd44c2b99960f4df5cb0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:02.093382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30fba7a1-b871-4bb9-bd35-c4df09cea8ec tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 200 len: 1303 microversion: 2.1 time: 0.171161 Apr 09 21:08:02.096418 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1960/3955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:01 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:02.200363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:02.201733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:02.208295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.208752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.209575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.210017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.279115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:02.290359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:02.293220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:02.295455 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7209149e-8b95-4c56-b306-1e9b5eb163c4 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.098403 Apr 09 21:08:02.296043 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1996/3956] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:02 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:02.480829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:02.481589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:02.502846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.503243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.515467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.515467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.639718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:02.640476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:02.651603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.652288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.661373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:02.662419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:02.981172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:02.992691 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1931872b-1619-414f-8ac8-8eecac869220 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.518881 Apr 09 21:08:03.003747 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1961/3957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:02 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:03.009983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.010958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.018959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.019682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.020918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.021696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.026938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:03.039469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af6017d4-9a80-4a7b-8821-faef9fd54f45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.404069 Apr 09 21:08:03.040064 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1997/3958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:02 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:03.110430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.114085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 9b46a6da-35b7-42bd-9565-82a62ba4cd93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.131581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.132317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.133319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.143277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.145585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:03.155859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-925a896a-9042-4734-8e8b-2a9a341fd917 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1271 microversion: 2.1 time: 0.150433 Apr 09 21:08:03.161828 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1962/3959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:03 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:03.172103 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] HTTP exception thrown: Instance 9b46a6da-35b7-42bd-9565-82a62ba4cd93 could not be found. Apr 09 21:08:03.172869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Returning 404 to user: Instance 9b46a6da-35b7-42bd-9565-82a62ba4cd93 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:03.174002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c44ad39b-8406-4422-ad70-54f7cc9fa78f tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93" status: 404 len: 111 microversion: 2.1 time: 0.067479 Apr 09 21:08:03.175029 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1998/3960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:03 2022] GET /compute/v2.1/servers/9b46a6da-35b7-42bd-9565-82a62ba4cd93 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:08:03.183323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.183845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.191199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.192548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.193855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.194680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.216335 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] HTTP exception thrown: Instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 could not be found. Apr 09 21:08:03.218038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Returning 404 to user: Instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:03.221207 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-88cd8324-11d7-4c74-a550-0aa65877dd1a tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 404 len: 111 microversion: 2.1 time: 0.040578 Apr 09 21:08:03.222333 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1963/3961] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:03 2022] DELETE /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:03.231910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.232875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: e103c226-e4d1-42eb-a8c0-4a9f4d34daf3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.241199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.242014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.242999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.243647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.262179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] HTTP exception thrown: Instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 could not be found. Apr 09 21:08:03.262858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Returning 404 to user: Instance e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:03.264056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51174893-6035-4755-8556-8144f97db7cb tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3" status: 404 len: 111 microversion: 2.1 time: 0.036682 Apr 09 21:08:03.274177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.275030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.282285 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 1999/3962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:03 2022] GET /compute/v2.1/servers/e103c226-e4d1-42eb-a8c0-4a9f4d34daf3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:08:03.285694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.286405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.287478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.288119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.316498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.318475 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] HTTP exception thrown: Instance 95b84c86-30cb-41cd-9654-0f3a7569149f could not be found. Apr 09 21:08:03.319088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Returning 404 to user: Instance 95b84c86-30cb-41cd-9654-0f3a7569149f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:03.319937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e6de5e3-847b-43ba-98fe-5fa1af2f3f08 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 404 len: 111 microversion: 2.1 time: 0.050176 Apr 09 21:08:03.326300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.328148 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1964/3963] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:03 2022] DELETE /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:03.333206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:03.333835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] [instance: 95b84c86-30cb-41cd-9654-0f3a7569149f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:03.344532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.345915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.346992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.347945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.357212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.358510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.359389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:03.359852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:03.402506 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] HTTP exception thrown: Instance 95b84c86-30cb-41cd-9654-0f3a7569149f could not be found. Apr 09 21:08:03.403114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] Returning 404 to user: Instance 95b84c86-30cb-41cd-9654-0f3a7569149f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:03.403965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0691e413-640a-44ef-98f9-6c949e84e164 tempest-ServerDiskConfigTestJSON-2143727614 tempest-ServerDiskConfigTestJSON-2143727614-project] 10.222.0.30 "GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f" status: 404 len: 111 microversion: 2.1 time: 0.074764 Apr 09 21:08:03.404538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1965/3964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:03 2022] GET /compute/v2.1/servers/95b84c86-30cb-41cd-9654-0f3a7569149f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:03.446190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:03.458699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:03.461262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:03.462473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8753a083-b97c-4acf-8765-fb0423fc77fc tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.150633 Apr 09 21:08:03.473083 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2000/3965] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:03 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:08:04.010487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:04.011775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:04.021759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.023191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.024966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.028712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.056100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:04.057352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:04.066842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.070745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.072184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.073640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.427531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.436063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f17652f-93c4-4b7b-b25a-3eaed98494ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.429654 Apr 09 21:08:04.449599 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1966/3966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:04 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:04.456086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:04.457328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:04.465772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.466748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.468049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.469305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.506941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.522006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-209e4237-ae69-44aa-b785-16e877c59463 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.469673 Apr 09 21:08:04.523426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2001/3967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:04 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:04.534879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:04.535944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:04.545542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.546292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.547277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.547938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.779456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.799732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.803122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.805481 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-798720d2-fa13-480c-bbb9-0a0ba120f6fe tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.280800 Apr 09 21:08:04.810207 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2002/3968] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:04 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:04.820596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:04.823127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:04.833396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:04.840422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.841051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.842750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:04.843751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:04.846054 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4e73898-b369-4b7b-a1e1-60125391f02c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.394948 Apr 09 21:08:04.853087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1967/3969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:04 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:04.915586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:05.067439 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff25d5f1-55f6-48df-a2a0-66186c19e3c3 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 204 len: 0 microversion: 2.1 time: 0.253625 Apr 09 21:08:05.068503 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2003/3970] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:04 2022] DELETE /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:05.078132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:05.079184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:05.097439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.099357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.103370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.105298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.413314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e8d9a6b3-8c2d-460b-9bff-4e3821e602bc req-117cba5f-3247-49e7-b515-73ae5542a756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b45fb9-910b-4f44-90a8-d88fd1f0d9e7", "tag": "b5a493c3-f133-4d49-b725-84e30819e49b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:05.452603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e8d9a6b3-8c2d-460b-9bff-4e3821e602bc req-117cba5f-3247-49e7-b515-73ae5542a756 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.453087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e8d9a6b3-8c2d-460b-9bff-4e3821e602bc req-117cba5f-3247-49e7-b515-73ae5542a756 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.477070 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e8d9a6b3-8c2d-460b-9bff-4e3821e602bc req-117cba5f-3247-49e7-b515-73ae5542a756 service nova] Creating event network-changed:b5a493c3-f133-4d49-b725-84e30819e49b for instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 on nch2-master-1 Apr 09 21:08:05.484534 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e8d9a6b3-8c2d-460b-9bff-4e3821e602bc req-117cba5f-3247-49e7-b515-73ae5542a756 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076305 Apr 09 21:08:05.485695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2004/3971] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:08:05.491941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:05.492683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:05.503710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.504221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.504965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.505493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.562990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:05.576907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2535ba06-5c1f-459b-8cac-e7bb44d61287 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1663 microversion: 2.1 time: 0.499694 Apr 09 21:08:05.578682 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1968/3972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:05 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1663 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:05.591895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:05.592914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:05.609641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.614561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.615400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.615849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.879783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:05.888212 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff102caf-b55a-4e89-994b-0682d89fb783 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1512 microversion: 2.1 time: 0.401304 Apr 09 21:08:05.890955 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2005/3973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:05 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:05.908616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:05.909644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:05.917528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.918062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:05.919104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:05.919612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:06.038192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:06.040702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:06.051399 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-54d7f4ef-6bc6-4e55-93f6-6b46b39cfe8b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.468797 Apr 09 21:08:06.052515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1969/3974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:05 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:06.061797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:06.065944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:06.069298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:06.071873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:06.074025 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6367969-2f06-4e1f-9b23-47f9464821b6 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.180413 Apr 09 21:08:06.085096 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2006/3975] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:05 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:06.089221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:06.089806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:06.090663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:06.091198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:06.461802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:06.481772 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eb2a7e63-e1d5-4cbc-a619-8976d0e24087 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.425972 Apr 09 21:08:06.482424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1970/3976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:06 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:06.595222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:06.597573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:06.607256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:06.608680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:06.609762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:06.610935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:06.816294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1014135400", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:07.084517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:07.085279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:07.086200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:07.086774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:07.087324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:07.099580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.100797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.101816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.102418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.122197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Getting quotas for project 76d0c33645544aac925f571c5572f115. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:07.128375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Getting quotas for user f591cadcc8564d51a4433748e0f84638 and project 76d0c33645544aac925f571c5572f115. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:07.145617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:07.148986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:07.221709 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4f84e1b-9eae-44ad-90b6-840f504ab630 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.566683 Apr 09 21:08:07.223061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1971/3977] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 09 21:08:07.232088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:07.241909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:07.266222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.266671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.270359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.270815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.456747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:07.473942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e901873e-7b51-4c2b-b727-b0e8a71993af tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1663 microversion: 2.1 time: 0.878225 Apr 09 21:08:07.474609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2007/3978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:06 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1663 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:07.484716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:07.484716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:07.502971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.503603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.504454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:07.506189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:07.929000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:07.947984 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0efbca8-ca82-4d5a-a178-f7de0b6025a4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.472129 Apr 09 21:08:07.962027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2008/3979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:07 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:07.972025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:07.976957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:07.983553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:07.993124 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-751f4942-b62b-4f8a-8c11-9ccd3bae0864 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1489 microversion: 2.1 time: 0.768578 Apr 09 21:08:08.016375 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1972/3980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:07 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1489 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:08.020942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.024411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.025155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.026165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.026846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.030542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.051775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.052618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.053703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.054676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.165328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.173754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.175766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.177262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-461f331f-d62c-4a7a-a66a-6fd18bb2dcda tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.213836 Apr 09 21:08:08.178066 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2009/3981] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:07 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:08.190498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.192009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.210512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.210970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.211766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.212200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.214889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.227624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.231304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.233304 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45ec5361-8431-48f2-86fa-2fff01b1effd tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1285 microversion: 2.47 time: 0.215315 Apr 09 21:08:08.242841 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1973/3982] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:08 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:08.248973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.249828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.257793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.258580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.260408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.261139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.318628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:08.476226 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a8f19ccb-66a0-4ebf-9a60-fef8a1d324ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 204 len: 0 microversion: 2.1 time: 0.231647 Apr 09 21:08:08.488772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1974/3983] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:08 2022] DELETE /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:08.495372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.500090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.517108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.517636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.519133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.519700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.616160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.635886 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5bb829f7-68fb-456c-a218-ffdda26f50a6 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1596 microversion: 2.1 time: 0.146632 Apr 09 21:08:08.636485 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1975/3984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:08 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1596 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:08.651068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.651952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.658571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.659318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.660400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.661599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.879677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.887467 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f936593-fefc-421a-a25b-24e2bb8c8fee tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.708001 Apr 09 21:08:08.888053 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2010/3985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:08 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:08.943231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:08.955760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28419d40-62aa-49eb-90c5-6bdf1b72b2f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1495 microversion: 2.1 time: 0.308486 Apr 09 21:08:08.959925 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1976/3986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:08 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1495 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:08.971219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:08.973478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:08.988087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.989127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:08.990369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:08.992544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.026372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.030996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.032333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Searching by: {'deleted': False, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:08:09.041590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.042044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.042878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.050311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.094136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:08:09.136316 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dff4b1d2-d2ef-4543-bd01-392a96f7936e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.114575 Apr 09 21:08:09.137577 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1977/3987] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers => generated 339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:08:09.154903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.163988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.164736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Searching by: {'deleted': False, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:08:09.170841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.171266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.172051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.172476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.215514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:08:09.274249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.297006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.297490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.300940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.308882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b6b89994-eef5-4b8f-ac16-42235115eed5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.342796 Apr 09 21:08:09.325929 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2011/3988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:08 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:09.338171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.340262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:09.351690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.352141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.352957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.353430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.480801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.489811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.494770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.500535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c27316f8-105b-41aa-8e2a-f8ce265ef51d tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1406 microversion: 2.54 time: 0.172626 Apr 09 21:08:09.511863 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2012/3989] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:09.522153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.523164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:09.537363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.540379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.541528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.542192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.581664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1560b2c6-c5df-4215-a40b-021df8a3028e tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.435459 Apr 09 21:08:09.582511 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1978/3990] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:09.592289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f5eb478d-b5c8-4761-9ce0-a0002c6f9e23 req-512a5764-3ddf-4a0d-b89f-7db786017c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfc1f6b-c179-437c-a528-6b7d93c8091b", "name": "network-vif-deleted", "tag": "44e52bdb-7117-4379-a4df-ef7116499a41"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:09.610443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f5eb478d-b5c8-4761-9ce0-a0002c6f9e23 req-512a5764-3ddf-4a0d-b89f-7db786017c99 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.611240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f5eb478d-b5c8-4761-9ce0-a0002c6f9e23 req-512a5764-3ddf-4a0d-b89f-7db786017c99 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.631378 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f5eb478d-b5c8-4761-9ce0-a0002c6f9e23 req-512a5764-3ddf-4a0d-b89f-7db786017c99 service nova] Creating event network-vif-deleted:44e52bdb-7117-4379-a4df-ef7116499a41 for instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b on nch1-master-1 Apr 09 21:08:09.639723 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f5eb478d-b5c8-4761-9ce0-a0002c6f9e23 req-512a5764-3ddf-4a0d-b89f-7db786017c99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054908 Apr 09 21:08:09.640910 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1979/3991] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:09.646696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30553972-7a87-4206-a208-1afb3a6be681 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.657257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30553972-7a87-4206-a208-1afb3a6be681 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014848 Apr 09 21:08:09.658805 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1980/3992] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:09.663322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.677479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.682987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:09.683600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.685409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:09.687067 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9de509c3-13d3-4507-94fd-57285052e0d4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1341 microversion: 2.47 time: 0.171722 Apr 09 21:08:09.687981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2013/3993] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:09.713875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.714537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.715502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.716099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.903955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:09.905379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:09.918609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.920554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:09.922730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:09.923356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.130728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.140298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e39fde8-08f3-4a00-9765-4711867a4bd5 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1596 microversion: 2.1 time: 0.472658 Apr 09 21:08:10.141831 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1981/3994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1596 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:10.148375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:10.149353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:10.157322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.158699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.159783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.160602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.311517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.324328 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2347aa52-9c4e-4efd-9b46-e60c4a571650 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.423702 Apr 09 21:08:10.338156 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2014/3995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:09 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:10.351599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:10.352087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:10.374629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.375102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.380714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.381209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.450851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:10.620979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0daa295f-6284-4fb6-90de-99be14783d10 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 204 len: 0 microversion: 2.1 time: 0.280310 Apr 09 21:08:10.622163 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2015/3996] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:10 2022] DELETE /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:10.637750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:10.643899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:10.662025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.662933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.665660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.668846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.735293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.745413 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-872b7122-758f-481a-b117-35a62e35e6e9 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1495 microversion: 2.1 time: 0.602190 Apr 09 21:08:10.746508 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1982/3997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:10 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1495 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:10.764372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:10.764991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:10.795521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.796005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.798219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.798730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.906627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.930078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.932069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:10.936591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2ffb2100-2f07-4b87-ac8a-4a454b2d8b05 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1412 microversion: 2.54 time: 0.179255 Apr 09 21:08:10.937340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1983/3998] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:10 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:10.946329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:10.946955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:10.967020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.968117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:10.971677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:10.972176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.012521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.023089 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-103959e9-c51f-487d-abda-5ea7a7aa3313 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.397489 Apr 09 21:08:11.024443 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2016/3999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:10 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:11.050346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:11.054903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:11.060857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.061510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.062306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.062751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.280554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.300683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.302568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.303787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b1f0f292-8b6d-4e6f-8bf2-efab3d6f0306 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1339 microversion: 2.47 time: 0.275658 Apr 09 21:08:11.304565 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2017/4000] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:11 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:11.320613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:11.321270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:11.336374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.336867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.339800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.340258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.349740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.360153 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4756a06a-b955-4148-8167-51c954972ee4 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1713 microversion: 2.1 time: 0.416829 Apr 09 21:08:11.361954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1984/4001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:10 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1713 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:11.373605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:11.376584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:11.393514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.396079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.398483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.399150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.418624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.419146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.419626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lazy-loading 'fault' on Instance uuid 0cfc1f6b-c179-437c-a528-6b7d93c8091b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:11.540678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918209191d2a40e5a996bb469bc26b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c950fe626e0b4d1a88be8c0943fe3965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.550262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f19214a-8942-438a-9b16-b3bb22274342 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 200 len: 1315 microversion: 2.1 time: 0.233529 Apr 09 21:08:11.552569 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2018/4002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:11 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:11.725074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.736810 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4988c911-ee24-474a-bf47-800e47f46ef6 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.373067 Apr 09 21:08:11.743295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1985/4003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:11 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:11.766313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:11.767737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:11.779049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.794022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.794886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.795392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.868305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7f5bdb5e-2f8f-4742-9530-42ceb7875bd6 req-82c9bc57-8f5f-48ad-92de-17015e3344ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f593a18-b8be-4120-a758-0d18a7adf933", "name": "network-vif-deleted", "tag": "63629146-b55f-40f2-a6c3-24d1bb7fce83"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:11.888926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f5bdb5e-2f8f-4742-9530-42ceb7875bd6 req-82c9bc57-8f5f-48ad-92de-17015e3344ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.890183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f5bdb5e-2f8f-4742-9530-42ceb7875bd6 req-82c9bc57-8f5f-48ad-92de-17015e3344ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.903480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7f5bdb5e-2f8f-4742-9530-42ceb7875bd6 req-82c9bc57-8f5f-48ad-92de-17015e3344ac service nova] Creating event network-vif-deleted:63629146-b55f-40f2-a6c3-24d1bb7fce83 for instance 2f593a18-b8be-4120-a758-0d18a7adf933 on nch1-master-1 Apr 09 21:08:11.908927 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7f5bdb5e-2f8f-4742-9530-42ceb7875bd6 req-82c9bc57-8f5f-48ad-92de-17015e3344ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044551 Apr 09 21:08:11.910257 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1986/4004] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:11.942457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:11.953235 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97fd73bd-0072-4fb1-9a06-f419beba1909 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1453 microversion: 2.1 time: 0.192030 Apr 09 21:08:11.959091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:11.960180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:11.963586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2019/4005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:11 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:11.967350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.967866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:11.969110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:11.969760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.040791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.041985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:12.043033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.052715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.053978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.055166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.055672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.057912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.059976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.061463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad4e916a-fa2f-44fa-b57b-7d41508a0b16 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1412 microversion: 2.54 time: 0.106768 Apr 09 21:08:12.062375 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1987/4006] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:11 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:12.257446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.267872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07bae345-a771-42c0-8c56-3b6fedefab2b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.231380 Apr 09 21:08:12.268881 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2020/4007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:12.323156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.324778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:12.335563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.336615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.337799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.338439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.377542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.378515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:12.398597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.402140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.403177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.403619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.458834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.470424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.474247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.476265 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-151be18d-5d66-49a5-8ca0-00550ff539ba tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1339 microversion: 2.47 time: 0.157687 Apr 09 21:08:12.478501 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1988/4008] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:12.573211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.574460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] [instance: 0cfc1f6b-c179-437c-a528-6b7d93c8091b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:12.586702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.587899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.589622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.590569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.608094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:12.611517 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] HTTP exception thrown: Instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b could not be found. Apr 09 21:08:12.612553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Returning 404 to user: Instance 0cfc1f6b-c179-437c-a528-6b7d93c8091b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:12.613720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2f20f3b-40da-424a-9778-64a1045ddaea tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b" status: 404 len: 111 microversion: 2.1 time: 0.049417 Apr 09 21:08:12.617133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe974dbf-a042-442e-abe0-bb876cd55694 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1713 microversion: 2.1 time: 0.244054 Apr 09 21:08:12.619611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1989/4009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/0cfc1f6b-c179-437c-a528-6b7d93c8091b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:08:12.619950 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2021/4010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1713 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:12.630562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab696997-644b-4a84-ad8c-8e775323adb9 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] Calling method '.version_select at 0x7fb08e0b1700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.658840 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab696997-644b-4a84-ad8c-8e775323adb9 tempest-ServersTestFqdnHostnames-140756591 tempest-ServersTestFqdnHostnames-140756591-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145365121" status: 202 len: 0 microversion: 2.1 time: 0.032595 Apr 09 21:08:12.660107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1990/4011] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145365121 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:08:12.756076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.756825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:12.769432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.769913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.772472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:12.773624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:12.990688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:12.991309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:13.018572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.022471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.023583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.027646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.149263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.149718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.150170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lazy-loading 'fault' on Instance uuid 2f593a18-b8be-4120-a758-0d18a7adf933 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:13.177661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.230991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b215c81a-3253-4152-95b2-75c06ab18154 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.438784 Apr 09 21:08:13.231541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.233291 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2022/4012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:13.242536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:13.243374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:13.251363 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ffb3cf9f-1fef-436c-8410-4feb3f2b8fe1 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 200 len: 1305 microversion: 2.1 time: 0.272664 Apr 09 21:08:13.252983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.253971 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1991/4013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:12 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 1305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:13.254206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.255159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.255742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.286583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:13.287521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:13.296796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.309665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.313643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.314157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.396633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.404625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.406235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.407419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-138f3bc7-6bba-4ae1-85f2-98f6ba3387a9 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1412 microversion: 2.54 time: 0.168933 Apr 09 21:08:13.414481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2023/4014] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:13 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:13.496525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:13.497074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:13.518545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.527078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.528232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.528825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.725278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.748979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.754632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.754632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63310f07-a71f-48d7-9014-2e643f50e24e tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1360 microversion: 2.47 time: 0.262298 Apr 09 21:08:13.759376 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2024/4015] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:13 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1360 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:13.778239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2d0536ef-2e83-4863-9261-8255a6feca26 req-a5537d61-1d41-49a6-afd7-f65700d9a812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b45fb9-910b-4f44-90a8-d88fd1f0d9e7", "name": "network-vif-plugged", "status": "completed", "tag": "b5a493c3-f133-4d49-b725-84e30819e49b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:13.797013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2d0536ef-2e83-4863-9261-8255a6feca26 req-a5537d61-1d41-49a6-afd7-f65700d9a812 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.797721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2d0536ef-2e83-4863-9261-8255a6feca26 req-a5537d61-1d41-49a6-afd7-f65700d9a812 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.852499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2d0536ef-2e83-4863-9261-8255a6feca26 req-a5537d61-1d41-49a6-afd7-f65700d9a812 service nova] Creating event network-vif-plugged:b5a493c3-f133-4d49-b725-84e30819e49b for instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 on nch2-master-1 Apr 09 21:08:13.861801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2d0536ef-2e83-4863-9261-8255a6feca26 req-a5537d61-1d41-49a6-afd7-f65700d9a812 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101012 Apr 09 21:08:13.862771 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2025/4016] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:13.874497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:13.875688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:13.885311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.886777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.897894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:13.904063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:13.940625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:13.948726 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e14a3b00-ba8b-45e9-a58b-da27a29db02b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.667302 Apr 09 21:08:13.949352 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1992/4017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:13 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:13.970718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-953684637"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:13.983685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.007943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.008652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.009090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.009530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.221543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.233544 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-904e4c56-4fb4-4dd9-b49b-ed14323263b2 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1713 microversion: 2.1 time: 0.369146 Apr 09 21:08:14.243514 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2026/4018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:13 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1713 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:14.249851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.250661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.257454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.258171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.259119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.260195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.467957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.480159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3cc279fe-bbac-46b5-9ebf-4ac4c787bc98 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.234630 Apr 09 21:08:14.489099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2027/4019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:14 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:14.496764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.497612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.506642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.507272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.509874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.511185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.532646 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. Apr 09 21:08:14.533372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:14.534573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1298dc92-9cb9-4b08-8a4a-e71d0b1568ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 404 len: 111 microversion: 2.1 time: 0.051512 Apr 09 21:08:14.538334 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2028/4020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:14 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:14.554114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.555090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.564170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.564636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.566211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.566761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.574769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78682ff8-0f0f-44c9-99c7-b40481cb2285 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "POST /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93/action" status: 202 len: 52 microversion: 2.47 time: 0.616267 Apr 09 21:08:14.580824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1993/4021] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:08:13 2022] POST /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93/action => generated 52 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 09 21:08:14.598153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.598790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.617758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.618216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.619008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.619910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.685476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:14.702612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.712441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.730114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.731455 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a62f8719-6fa9-4450-9ffa-b6f59c937777 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1412 microversion: 2.54 time: 0.194686 Apr 09 21:08:14.741350 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2029/4022] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:14 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1412 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:14.767049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-49789936", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "57943a23-6f13-487e-bf5b-7f0bc2bfd4b2"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:14.816542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-71bc460b-0cac-4c94-b78a-0614f8c7dbd7 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 204 len: 0 microversion: 2.47 time: 0.227752 Apr 09 21:08:14.821195 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1994/4023] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:08:14 2022] DELETE /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:08:14.828484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.829372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] validate_networks() for [('57943a23-6f13-487e-bf5b-7f0bc2bfd4b2', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:14.829682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.837877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.838650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.839812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.840465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.948844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.961114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.962975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:14.964688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-58a2e479-0b8c-4265-ae79-2d1614cbc0f4 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1366 microversion: 2.47 time: 0.141445 Apr 09 21:08:14.976538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1995/4024] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:14 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:14.982322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:14.983248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:14.991023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.991601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:14.992515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:14.993100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.294967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:15.304955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e2c3fe6a-c2b3-4fb4-99cf-df9fb1dc3816 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1528 microversion: 2.1 time: 0.326871 Apr 09 21:08:15.305632 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1996/4025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:14 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1528 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:15.333342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:15.334129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:15.351230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.351752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.353751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.354319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.469372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:15.469858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:15.470598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:15.471016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:15.471715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:15.487115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.488110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.489687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.491013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.518963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:15.526430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Getting quotas for user 38f474d5daf947ff9f632424e909390a and project 184d9189f1364fc1bdd88feff79103e6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:15.547635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:15.556596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:15.667336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-756d5ccc-b7de-497e-acf9-8377df148a12 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906864 Apr 09 21:08:15.670128 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2030/4026] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:08:15.688342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:15.689657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:15.698908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.699495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.701503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:15.702184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:15.930235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:15.947684 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7031a4d8-fa5f-4ba3-bab5-85953c1b3d4d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1713 microversion: 2.1 time: 0.626865 Apr 09 21:08:15.949637 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1997/4027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:15 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1713 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:15.957534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e2bd7d4-71bc-4245-baf5-a1a770a3e32e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:15.958210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e2bd7d4-71bc-4245-baf5-a1a770a3e32e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.061713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e2bd7d4-71bc-4245-baf5-a1a770a3e32e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.065612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.073994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7ea3397-20ab-4896-ae85-dc43c184181c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1313 microversion: 2.1 time: 0.402613 Apr 09 21:08:16.074782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2031/4028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:15 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:16.079978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.081161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e2bd7d4-71bc-4245-baf5-a1a770a3e32e tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1213 microversion: 2.1 time: 0.120494 Apr 09 21:08:16.087848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.089820 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1998/4029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:15 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:16.099718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.100641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.108101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.109015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.110092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.110686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.112273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.115286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.116602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.119093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.244360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.267682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.269664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.271145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30339f0d-1cf1-4a17-908d-9e86ae14b6b3 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1397 microversion: 2.54 time: 0.195189 Apr 09 21:08:16.272056 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2032/4030] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:16 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1397 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:16.292691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8735572f-969d-40a4-96b0-a6ef3d950f7b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '.version_select at 0x7fb08ef20700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.323476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.334995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.336879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.337947 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8735572f-969d-40a4-96b0-a6ef3d950f7b tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-34822057" status: 204 len: 0 microversion: 2.54 time: 0.048136 Apr 09 21:08:16.338731 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5629a6b4-8078-4b96-bf58-d163ae4ebd70 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1366 microversion: 2.47 time: 0.247648 Apr 09 21:08:16.339420 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2033/4031] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Apr 9 21:08:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-34822057 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:08:16.340201 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 1999/4032] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:16 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:16.349829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.350727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.358203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.358995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.365109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.365469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.370043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.370505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.378758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.379518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.380666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.381377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.415535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:16.520009 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f91662ab-4491-4c32-a000-fb1498cf478c tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 204 len: 0 microversion: 2.54 time: 0.158464 Apr 09 21:08:16.523832 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2000/4033] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:08:16 2022] DELETE /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 21:08:16.545730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.547260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:16.556850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.557357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.558146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.559306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.599357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:16.609917 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71bd48bc-1f93-4f4d-9b0d-e16b0618f668 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1510 microversion: 2.1 time: 0.266659 Apr 09 21:08:16.611355 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2034/4034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:16 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:16.739216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-15481e69-42ac-4401-b77e-89ca87bfa278 req-5a58e5e8-62df-44d9-9e14-00d643ae44c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbcefe5-59b3-4919-b321-cbcb7a47e014", "name": "network-vif-deleted", "tag": "0e43d1e5-8511-4e37-ac37-577627349f47"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:16.757980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-15481e69-42ac-4401-b77e-89ca87bfa278 req-5a58e5e8-62df-44d9-9e14-00d643ae44c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:16.758530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-15481e69-42ac-4401-b77e-89ca87bfa278 req-5a58e5e8-62df-44d9-9e14-00d643ae44c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:16.780145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-15481e69-42ac-4401-b77e-89ca87bfa278 req-5a58e5e8-62df-44d9-9e14-00d643ae44c4 service nova] Creating event network-vif-deleted:0e43d1e5-8511-4e37-ac37-577627349f47 for instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 on nch2-master-1 Apr 09 21:08:16.786179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-15481e69-42ac-4401-b77e-89ca87bfa278 req-5a58e5e8-62df-44d9-9e14-00d643ae44c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051699 Apr 09 21:08:16.787185 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2035/4035] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:08:16.970483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:16.971960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:17.002889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.005639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.009677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.010173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.087952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.088869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.089518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lazy-loading 'fault' on Instance uuid 9fbcefe5-59b3-4919-b321-cbcb7a47e014 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:17.310915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.322155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.323666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.332063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-10770d7f-97d3-4285-862d-45ea8c233d8e tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1403 microversion: 2.54 time: 0.804664 Apr 09 21:08:17.334084 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2001/4036] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:16 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1403 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:17.341532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:17.342465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:17.354954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.355732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.358146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.358970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.399318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844e9ec7bb34861aa23f38af40da479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8cef49b0454f9bb34f7d52b7918a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.409987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c663c33-a80a-47a9-9ad4-aa04993dd440 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 200 len: 1366 microversion: 2.1 time: 0.446839 Apr 09 21:08:17.423130 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2036/4037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:16 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:17.431142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:17.432880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:17.448380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.448848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.449663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.450101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.668761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.695653 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7136dabe-ce7a-4edf-9f01-550f4c999131 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1265 microversion: 2.1 time: 0.268736 Apr 09 21:08:17.704606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2037/4038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:17 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:17.718528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:17.730934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:17.753629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.754236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.755132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:17.755669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:17.962052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.972127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.980718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f591cadcc8564d51a4433748e0f84638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d0c33645544aac925f571c5572f115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:17.981995 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7416945d-dfda-48bf-b823-fecc0773fa69 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 200 len: 1366 microversion: 2.47 time: 0.274911 Apr 09 21:08:17.982580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2038/4039] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:17 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:17.999279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.001803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.030689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.031487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.033248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.033690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.159474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.167141 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5f09ce4-d194-4ad0-bc01-8d2391d83779 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1497 microversion: 2.1 time: 0.831205 Apr 09 21:08:18.191315 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2002/4040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:17 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1497 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:18.214614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95f4f03c-2134-4101-89c3-6611ed89ca05 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.248314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.server_groups [None req-95f4f03c-2134-4101-89c3-6611ed89ca05 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Querying cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) for 1 instances {{(pid=141819) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 09 21:08:18.249256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f4f03c-2134-4101-89c3-6611ed89ca05 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.249706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f4f03c-2134-4101-89c3-6611ed89ca05 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.302022 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95f4f03c-2134-4101-89c3-6611ed89ca05 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c" status: 200 len: 222 microversion: 2.1 time: 0.107536 Apr 09 21:08:18.302823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2003/4041] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:18.314622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.315609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.322266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.323012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.324076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.325237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.367781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:18.492298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a115a8a3-a4ba-4709-a5c3-a1b22367d008 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 204 len: 0 microversion: 2.1 time: 0.180555 Apr 09 21:08:18.501158 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2004/4042] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:18 2022] DELETE /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:18.512120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.513134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.535318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.535871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.536742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.537300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.676838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.686620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.693141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.694289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-315e6cc3-eeb3-4d70-af2d-af5a9ce8a729 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1403 microversion: 2.54 time: 0.190657 Apr 09 21:08:18.698226 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2005/4043] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1403 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:18.708991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.709726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] [instance: 9fbcefe5-59b3-4919-b321-cbcb7a47e014] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.723942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.724313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.725165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.725609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.743716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] HTTP exception thrown: Instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 could not be found. Apr 09 21:08:18.744429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Returning 404 to user: Instance 9fbcefe5-59b3-4919-b321-cbcb7a47e014 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:18.745372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ced2dfbe-13fd-46e9-b773-e5020c3a5e0d tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014" status: 404 len: 111 microversion: 2.1 time: 0.044476 Apr 09 21:08:18.750235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2006/4044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/servers/9fbcefe5-59b3-4919-b321-cbcb7a47e014 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:18.755429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.759849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.769954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.771880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.773642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.774677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.775361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.781627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2535c375-ad40-40c6-a9d3-61eb237825c1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1510 microversion: 2.1 time: 0.796146 Apr 09 21:08:18.794675 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2039/4045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:17 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1510 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:18.801180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.801999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:18.809880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.810734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.811770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:18.812372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:18.933303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:18.952192 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f46cc156-49b7-4c8a-92b2-74b700746a9b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1271 microversion: 2.1 time: 0.155806 Apr 09 21:08:18.962237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2040/4046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:18.966005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2964943-2803-488e-b50f-63d808835c40 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] Calling method '.version_select at 0x7fb08ed4d0d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:18.997680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2964943-2803-488e-b50f-63d808835c40 tempest-ServersTestManualDisk-83251098 tempest-ServersTestManualDisk-83251098-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115501374" status: 202 len: 0 microversion: 2.1 time: 0.043565 Apr 09 21:08:18.999148 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2041/4047] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115501374 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:08:19.016563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:19.017702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] [instance: 7278718f-1679-43ee-acfc-e94c764c2f93] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:19.028245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.029128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.030312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.030917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.061103 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] HTTP exception thrown: Instance 7278718f-1679-43ee-acfc-e94c764c2f93 could not be found. Apr 09 21:08:19.061741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] Returning 404 to user: Instance 7278718f-1679-43ee-acfc-e94c764c2f93 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:19.062595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf45a43e-beb2-4de0-90ec-3f53ee7dd4c0 tempest-ServersAaction247Test-16599429 tempest-ServersAaction247Test-16599429-project] 10.222.0.30 "GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93" status: 404 len: 111 microversion: 2.47 time: 0.062303 Apr 09 21:08:19.070200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2042/4048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/servers/7278718f-1679-43ee-acfc-e94c764c2f93 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:08:19.181700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:19.202267 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9fe9cc4b-e2e5-4342-bc10-1868f92cdd73 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1503 microversion: 2.1 time: 0.450922 Apr 09 21:08:19.203160 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2007/4049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:18 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:19.717509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:19.718224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:19.739178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.741663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.745226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.745954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.801921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:19.802642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:19.812258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.813346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.814361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lazy-loading 'fault' on Instance uuid b522ddbd-ea81-44b1-bb9b-65794df10c6b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:19.814893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.815525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.822133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.824163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.896560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:19.907814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:19.910917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33ea3acc687d49a9868219b4c9fa34dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7578f9ead04b7384247947593935dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:19.912879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b38a251b-9cab-46a8-8033-0e2b871da6d8 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 200 len: 1408 microversion: 2.54 time: 0.199424 Apr 09 21:08:19.914522 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2043/4050] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:19 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:08:19.970283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:19.971229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:19.984610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.985347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:19.986319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:19.987864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.136270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:20.147262 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8d82966-2ac9-4f02-91e6-4372edf993c2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1510 microversion: 2.1 time: 0.349084 Apr 09 21:08:20.151145 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2008/4051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:19 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:20.220777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:20.226096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:20.233559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:20.234236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.235186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:20.235775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.256853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:20.268041 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2efaf208-c28f-415e-a3ac-974391fa25d6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.301757 Apr 09 21:08:20.269189 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2044/4052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:19 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:20.283306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ff1b6307-c4b4-470c-a03c-11e1d01235ed req-142ed558-8346-4949-8009-09c488edf80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "name": "network-vif-unplugged", "status": "completed", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:20.305293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff1b6307-c4b4-470c-a03c-11e1d01235ed req-142ed558-8346-4949-8009-09c488edf80d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:20.307878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff1b6307-c4b4-470c-a03c-11e1d01235ed req-142ed558-8346-4949-8009-09c488edf80d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.327861 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ff1b6307-c4b4-470c-a03c-11e1d01235ed req-142ed558-8346-4949-8009-09c488edf80d service nova] Creating event network-vif-unplugged:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch1-master-1 Apr 09 21:08:20.340690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ff1b6307-c4b4-470c-a03c-11e1d01235ed req-142ed558-8346-4949-8009-09c488edf80d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069700 Apr 09 21:08:20.341685 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2045/4053] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:20.444535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:20.452938 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57de0bfd-a8a2-480c-9000-1e67185139e3 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1503 microversion: 2.1 time: 0.236904 Apr 09 21:08:20.456184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2009/4054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:20 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:20.938721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:20.939579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] [instance: b522ddbd-ea81-44b1-bb9b-65794df10c6b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:20.949470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:20.952587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.956134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:20.959328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:20.991374 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] HTTP exception thrown: Instance b522ddbd-ea81-44b1-bb9b-65794df10c6b could not be found. Apr 09 21:08:20.992366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] Returning 404 to user: Instance b522ddbd-ea81-44b1-bb9b-65794df10c6b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:20.993588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de47d52e-a9af-4e9f-b4ae-b1db3c00d123 tempest-ServerShowV254Test-872074930 tempest-ServerShowV254Test-872074930-project] 10.222.0.30 "GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b" status: 404 len: 111 microversion: 2.54 time: 0.063243 Apr 09 21:08:20.994410 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2046/4055] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:20 2022] GET /compute/v2.1/servers/b522ddbd-ea81-44b1-bb9b-65794df10c6b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:08:21.167130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:21.167755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:21.182557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.183098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:21.184071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.184666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:21.292522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:21.293561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:21.300793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.305309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:21.308819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.309660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:21.610292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:21.628613 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28bbb0d0-7007-47aa-844c-278e7ed8451e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1453 microversion: 2.1 time: 0.461870 Apr 09 21:08:21.630958 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2010/4056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1453 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:21.637145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:21.638013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:21.644528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.645258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:21.646377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:21.646995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.003089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:22.022044 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4065220-8c61-4c91-93de-5db319b17cd3 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.729749 Apr 09 21:08:22.023208 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2047/4057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:21 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:22.030909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:22.036554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:22.053128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.053602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.055279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.055733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.130582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8710e814d542608427c3386a09708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d9672c979478f9aac7df36e55fc72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:22.153473 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b0200aa-723f-4a34-8c7e-67251fffb35e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 200 len: 1503 microversion: 2.1 time: 0.509253 Apr 09 21:08:22.154837 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2011/4058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:21 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 1503 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:22.160143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d188f05f-a41f-4663-8172-eb73e76be815 req-0c0cb9d7-0dd9-43c7-a3b0-efe641c393d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b45fb9-910b-4f44-90a8-d88fd1f0d9e7", "name": "network-vif-deleted", "tag": "b5a493c3-f133-4d49-b725-84e30819e49b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:22.178504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d188f05f-a41f-4663-8172-eb73e76be815 req-0c0cb9d7-0dd9-43c7-a3b0-efe641c393d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.179876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d188f05f-a41f-4663-8172-eb73e76be815 req-0c0cb9d7-0dd9-43c7-a3b0-efe641c393d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.196764 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d188f05f-a41f-4663-8172-eb73e76be815 req-0c0cb9d7-0dd9-43c7-a3b0-efe641c393d7 service nova] Creating event network-vif-deleted:b5a493c3-f133-4d49-b725-84e30819e49b for instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 on nch2-master-1 Apr 09 21:08:22.202259 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d188f05f-a41f-4663-8172-eb73e76be815 req-0c0cb9d7-0dd9-43c7-a3b0-efe641c393d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045723 Apr 09 21:08:22.203503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2012/4059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:22.225890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-234c9ea7-efcd-4836-8e1b-2d496a81680a req-66122c73-ac78-4763-a485-b6c14b700bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b65a0d7-8c88-46e6-ac52-45246891d7b3", "tag": "86342107-c191-409d-a7f1-662450d04178"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:22.242792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-234c9ea7-efcd-4836-8e1b-2d496a81680a req-66122c73-ac78-4763-a485-b6c14b700bf3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.244109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-234c9ea7-efcd-4836-8e1b-2d496a81680a req-66122c73-ac78-4763-a485-b6c14b700bf3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.256280 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-234c9ea7-efcd-4836-8e1b-2d496a81680a req-66122c73-ac78-4763-a485-b6c14b700bf3 service nova] Creating event network-changed:86342107-c191-409d-a7f1-662450d04178 for instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 on nch1-master-1 Apr 09 21:08:22.262198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-234c9ea7-efcd-4836-8e1b-2d496a81680a req-66122c73-ac78-4763-a485-b6c14b700bf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057154 Apr 09 21:08:22.263811 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2013/4060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:22.578259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:22.594883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7be8e166-00ff-4278-9880-49d944d732e9 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Calling method '.version_select at 0x7fb08e0b39d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:22.600896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03ce5249-86c9-44c9-944b-6412e9ae3d73 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1453 microversion: 2.1 time: 0.576425 Apr 09 21:08:22.606085 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2048/4061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1453 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:22.737879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7be8e166-00ff-4278-9880-49d944d732e9 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75/defaults" status: 200 len: 371 microversion: 2.1 time: 0.472223 Apr 09 21:08:22.738609 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2014/4062] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:08:22 2022] GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75/defaults => generated 371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:22.750898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff500085-af45-4a9d-bfe9-6d647d63ad15 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Calling method '.version_select at 0x7fb08ed56550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:22.765462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:22.766031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:22.821652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.823648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.830011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:22.832356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:22.939985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lazy-loading 'flavor' on Instance uuid 66c2d8f3-9113-4bac-b1da-8e52381492d7 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:22.977283 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'shelve' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state shelved_offloaded Apr 09 21:08:22.977894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'shelve' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state shelved_offloaded {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:22.979638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-51236fb6-108c-46f7-a6e0-a7f856739c45 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 155 microversion: 2.1 time: 0.219545 Apr 09 21:08:22.983659 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2015/4063] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:08:22 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 155 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 09 21:08:23.001893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:23.002477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.022205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.023799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.024764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.025722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.097090 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff500085-af45-4a9d-bfe9-6d647d63ad15 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75" status: 200 len: 371 microversion: 2.1 time: 0.346865 Apr 09 21:08:23.105049 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2049/4064] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:08:22 2022] GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75 => generated 371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:08:23.132008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.134102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.160513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.161196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.166840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.168781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.200666 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d67c96a-eccb-4b68-a364-eb2e12571135 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.209077 Apr 09 21:08:23.201461 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2016/4065] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:08:22 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:08:23.208403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b409da87-5d4e-404e-9fd6-3c5d03e77f73 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Calling method '.version_select at 0x7fb08e079d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.373078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:23.387076 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e72bf7b-ec26-4d8e-ac1e-516eb7684fcb tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.278594 Apr 09 21:08:23.388054 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2050/4066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:23.394507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.395116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.402604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.403263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.404387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.405253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.424133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. Apr 09 21:08:23.424874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.425791 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac035afc-2812-42fa-aa88-957c91526930 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 404 len: 111 microversion: 2.1 time: 0.036818 Apr 09 21:08:23.426892 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2051/4067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.435229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.435854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.449643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.450102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.450913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.451353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.656630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:23.673257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cbf9647c-f253-47e2-9a73-79c9cef59886 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1461 microversion: 2.1 time: 0.245135 Apr 09 21:08:23.674767 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2052/4068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:23.691549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2aed360-11a7-4a0f-9a25-aff66ec1023f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.712970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_groups [None req-b2aed360-11a7-4a0f-9a25-aff66ec1023f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Querying cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) for 1 instances {{(pid=141818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 09 21:08:23.718243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2aed360-11a7-4a0f-9a25-aff66ec1023f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.721084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2aed360-11a7-4a0f-9a25-aff66ec1023f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.735416 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2aed360-11a7-4a0f-9a25-aff66ec1023f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.048897 Apr 09 21:08:23.736482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2053/4069] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:23.751420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4113c4c-26ca-4d86-8349-03bc361ee78e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.751616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b409da87-5d4e-404e-9fd6-3c5d03e77f73 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75/defaults" status: 200 len: 371 microversion: 2.1 time: 0.548936 Apr 09 21:08:23.752331 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2017/4070] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75/defaults => generated 371 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:23.767314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_groups [None req-a4113c4c-26ca-4d86-8349-03bc361ee78e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Querying cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) for 1 instances {{(pid=141818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 09 21:08:23.768360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4113c4c-26ca-4d86-8349-03bc361ee78e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.769130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4113c4c-26ca-4d86-8349-03bc361ee78e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.772418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-23246a1f-ae3c-4b2c-9d72-503bbd23ecad tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Calling method '.version_select at 0x7fb08e0a9dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.782318 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4113c4c-26ca-4d86-8349-03bc361ee78e tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c" status: 200 len: 184 microversion: 2.1 time: 0.039038 Apr 09 21:08:23.783325 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2054/4071] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c => generated 184 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:23.796791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.798685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.812714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.813199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.813981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.817610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.833248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. Apr 09 21:08:23.834052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.835040 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-817402b8-9c5c-4505-907c-2281f1bdd478 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 404 len: 111 microversion: 2.1 time: 0.044236 Apr 09 21:08:23.836126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2055/4072] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.844289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.845221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] [instance: 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:23.853060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.853517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.854450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:23.854836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:23.876334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. Apr 09 21:08:23.876937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance 68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.877796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35dc5ca4-d07c-4b38-9da6-ad80a9f6636f tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7" status: 404 len: 111 microversion: 2.1 time: 0.037898 Apr 09 21:08:23.878355 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2056/4073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/servers/68b45fb9-910b-4f44-90a8-d88fd1f0d9e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.894219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ce3038a-00e6-4691-a081-898c378b54ed tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.900152 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5ce3038a-00e6-4691-a081-898c378b54ed tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance group 9e10b484-02e1-4b5c-bb6c-1c201dd61e19 could not be found. Apr 09 21:08:23.900959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ce3038a-00e6-4691-a081-898c378b54ed tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance group 9e10b484-02e1-4b5c-bb6c-1c201dd61e19 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.902021 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ce3038a-00e6-4691-a081-898c378b54ed tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/9e10b484-02e1-4b5c-bb6c-1c201dd61e19" status: 404 len: 117 microversion: 2.1 time: 0.011802 Apr 09 21:08:23.902844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2057/4074] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/os-server-groups/9e10b484-02e1-4b5c-bb6c-1c201dd61e19 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.910877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f81c4734-3e00-43cf-bc0b-7b46240ef021 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.923681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-f81c4734-3e00-43cf-bc0b-7b46240ef021 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance group 89ce5f6f-0ca3-4086-87ec-97a463bf2a8d could not be found. Apr 09 21:08:23.924844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f81c4734-3e00-43cf-bc0b-7b46240ef021 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance group 89ce5f6f-0ca3-4086-87ec-97a463bf2a8d could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.926266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f81c4734-3e00-43cf-bc0b-7b46240ef021 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/89ce5f6f-0ca3-4086-87ec-97a463bf2a8d" status: 404 len: 117 microversion: 2.1 time: 0.018698 Apr 09 21:08:23.929864 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2058/4075] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/os-server-groups/89ce5f6f-0ca3-4086-87ec-97a463bf2a8d => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:08:23.941495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e48518c-5814-4c41-8084-1d7d77dd9572 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.951272 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-0e48518c-5814-4c41-8084-1d7d77dd9572 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance group 17b4b215-daa9-4393-a4dd-ed474d631f10 could not be found. Apr 09 21:08:23.952624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e48518c-5814-4c41-8084-1d7d77dd9572 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance group 17b4b215-daa9-4393-a4dd-ed474d631f10 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.953742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e48518c-5814-4c41-8084-1d7d77dd9572 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/17b4b215-daa9-4393-a4dd-ed474d631f10" status: 404 len: 117 microversion: 2.1 time: 0.020937 Apr 09 21:08:23.958296 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2059/4076] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/os-server-groups/17b4b215-daa9-4393-a4dd-ed474d631f10 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.964459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e90348d5-aa51-48bf-a5b7-c3800fc5c7b9 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:23.972772 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e90348d5-aa51-48bf-a5b7-c3800fc5c7b9 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] HTTP exception thrown: Instance group f74658f8-45a7-4193-97fa-b7f92bbeb6e4 could not be found. Apr 09 21:08:23.973892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e90348d5-aa51-48bf-a5b7-c3800fc5c7b9 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Returning 404 to user: Instance group f74658f8-45a7-4193-97fa-b7f92bbeb6e4 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:23.975137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e90348d5-aa51-48bf-a5b7-c3800fc5c7b9 tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/f74658f8-45a7-4193-97fa-b7f92bbeb6e4" status: 404 len: 117 microversion: 2.1 time: 0.015434 Apr 09 21:08:23.979716 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2060/4077] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/os-server-groups/f74658f8-45a7-4193-97fa-b7f92bbeb6e4 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:23.987095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7a79aeb-1202-4590-b2d4-cded6ec83e9c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:24.027807 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7a79aeb-1202-4590-b2d4-cded6ec83e9c tempest-ServerGroupTestJSON-1924039148 tempest-ServerGroupTestJSON-1924039148-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c" status: 204 len: 0 microversion: 2.1 time: 0.046660 Apr 09 21:08:24.028531 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2061/4078] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Apr 9 21:08:23 2022] DELETE /compute/v2.1/os-server-groups/043544cc-68ae-444b-a6f8-75a61461f68c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:24.406272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:24.407695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:24.421524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:24.422348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:24.423945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:24.425672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:24.444109 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-23246a1f-ae3c-4b2c-9d72-503bbd23ecad tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75" status: 200 len: 371 microversion: 2.1 time: 0.682349 Apr 09 21:08:24.444722 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2018/4079] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:08:23 2022] GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75 => generated 371 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:24.465927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92fe0057-ca24-424b-99a9-107a64e22039 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] Calling method '.version_select at 0x7fb08e0921f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:24.812332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:24.821518 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c30a5e78-f03f-4cbd-8e32-11527e5786f2 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.421496 Apr 09 21:08:24.822776 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2062/4080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:24 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:24.828410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:24.829541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:24.836754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:24.837491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:24.838396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:24.838943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:25.119517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:25.131526 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-499129f1-c3ac-4516-bd1e-f4d4a778205e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1461 microversion: 2.1 time: 0.307425 Apr 09 21:08:25.144018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2063/4081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:24 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1461 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:25.235524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92fe0057-ca24-424b-99a9-107a64e22039 tempest-QuotasTestJSON-819550467 tempest-QuotasTestJSON-819550467-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75?user_id=1ad067bf99a94e85a0e932643ed1cbf1" status: 200 len: 371 microversion: 2.1 time: 0.779438 Apr 09 21:08:25.236250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2019/4082] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Apr 9 21:08:24 2022] GET /compute/v2.1/os-quota-sets/9ef722f37add412d995982bf015f8b75?user_id=1ad067bf99a94e85a0e932643ed1cbf1 => generated 371 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:25.849446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:25.850070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:25.869298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:25.870559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:25.872691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:25.874625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:26.152077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:26.152694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:26.175538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:26.176022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:26.176908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:26.177381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:26.494788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:26.507406 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-736aa506-b400-4abd-970c-d483ac8c14fc tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.670165 Apr 09 21:08:26.508041 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2064/4083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:25 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:26.634665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:26.651177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90708289-0f2b-4dbd-b8e0-34b7f4049a28 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.502199 Apr 09 21:08:26.653494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2020/4084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:26 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:27.523924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:27.525295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:27.540993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:27.553828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:27.555049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:27.555652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:27.673187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:27.674586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:27.690681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:27.691513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:27.692519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:27.693201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:28.264571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:28.295641 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6da5c54b-12fa-4ce6-afed-3477311243e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.775443 Apr 09 21:08:28.300284 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2065/4085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:27 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:28.312903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ea550295-474e-4cda-98e5-49787c19011b req-b476bdfb-2bf3-4739-b7d7-763d3476401a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:28.321539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:28.332327 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee8325f2-5bb5-4a1b-90ba-6115849e9b69 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.665992 Apr 09 21:08:28.338771 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2021/4086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:27 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:28.341306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ea550295-474e-4cda-98e5-49787c19011b req-b476bdfb-2bf3-4739-b7d7-763d3476401a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:28.341776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ea550295-474e-4cda-98e5-49787c19011b req-b476bdfb-2bf3-4739-b7d7-763d3476401a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:28.376694 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ea550295-474e-4cda-98e5-49787c19011b req-b476bdfb-2bf3-4739-b7d7-763d3476401a service nova] Creating event network-changed:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch2-master-1 Apr 09 21:08:28.388075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ea550295-474e-4cda-98e5-49787c19011b req-b476bdfb-2bf3-4739-b7d7-763d3476401a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085162 Apr 09 21:08:28.393161 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2066/4087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:28.861752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c3b6fd38-f914-46b6-b2a9-f4687e31747d req-335943fd-a400-4abd-aa6d-fb9725664f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b65a0d7-8c88-46e6-ac52-45246891d7b3", "name": "network-vif-plugged", "status": "completed", "tag": "86342107-c191-409d-a7f1-662450d04178"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:28.893101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3b6fd38-f914-46b6-b2a9-f4687e31747d req-335943fd-a400-4abd-aa6d-fb9725664f9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:28.893610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3b6fd38-f914-46b6-b2a9-f4687e31747d req-335943fd-a400-4abd-aa6d-fb9725664f9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:28.939181 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c3b6fd38-f914-46b6-b2a9-f4687e31747d req-335943fd-a400-4abd-aa6d-fb9725664f9d service nova] Creating event network-vif-plugged:86342107-c191-409d-a7f1-662450d04178 for instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 on nch1-master-1 Apr 09 21:08:28.957419 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c3b6fd38-f914-46b6-b2a9-f4687e31747d req-335943fd-a400-4abd-aa6d-fb9725664f9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116900 Apr 09 21:08:28.961258 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2022/4088] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:29.317806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:29.318977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:29.329779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:29.331919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:29.336667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:29.337460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:29.778833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:29.790469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f43f00c5-6774-44ef-becf-713ba1e02d1d tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1313 microversion: 2.1 time: 0.477405 Apr 09 21:08:29.791588 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2023/4089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:29 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:29.805336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:29.806947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:29.825392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:29.826688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:29.831135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:29.832210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:29.932518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-669676715", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cfaa58a1-2911-4cfc-bc73-e74e59941c5e"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:30.030520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] validate_networks() for [('cfaa58a1-2911-4cfc-bc73-e74e59941c5e', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:30.634701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:30.663855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d7677bd-93f0-49d8-89ad-8d662ad4034a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.864965 Apr 09 21:08:30.667345 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2024/4090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:29 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:30.809796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:30.810423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:30.823407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:30.823856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:30.826402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:30.827060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.472180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:31.486424 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-04dcfc94-b9c4-420b-a219-87dff308aed6 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1499 microversion: 2.1 time: 0.682423 Apr 09 21:08:31.487978 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2025/4091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:30 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1499 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:31.504535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:31.505562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:31.518255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.519008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.523632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.524487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.544788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:31.546353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:31.547048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:31.547840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:31.548387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:31.590339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.592871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.600463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.600984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.629268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lazy-loading 'flavor' on Instance uuid 3b65a0d7-8c88-46e6-ac52-45246891d7b3 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:31.731445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Getting quotas for project bfb1a94e7e044a6390e09032a39366f8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:31.776409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Getting quotas for user 6ea522ee568943d6afe754d6c86668f6 and project bfb1a94e7e044a6390e09032a39366f8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:31.828717 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30428175-1e85-4a0f-bfb3-e08fcfb9e85b tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "POST /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.328749 Apr 09 21:08:31.830867 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2026/4092] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:08:31 2022] POST /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:08:31.835144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:31.841863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:31.845839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:31.849823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:31.870961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.874376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.879840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:31.882968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:31.964144 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e79a6cc-d7a3-4ec2-9c77-3fa056a71589 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.898647 Apr 09 21:08:31.968022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2067/4093] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:31.987640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:31.988631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:32.009636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:32.013737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:32.016943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:32.020937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:32.873187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:32.886854 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f719dec2-03c7-44ac-9881-848265cd17d9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 1.054102 Apr 09 21:08:32.893474 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2027/4094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:31 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:32.924438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9c9f75a-dbc2-476e-befb-997aefa72f38 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:32.925437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9c9f75a-dbc2-476e-befb-997aefa72f38 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:33.190625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:33.204979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43e2ed24-4f2b-46bd-bd74-59bab91c28ff tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1507 microversion: 2.1 time: 1.232655 Apr 09 21:08:33.206637 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2068/4095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:31 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1507 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:33.217815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f1295605-5d7f-4e6b-9fe0-5500bd1c699c tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08f0585e0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:33.308805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c9c9f75a-dbc2-476e-befb-997aefa72f38 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:33.316389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9c9f75a-dbc2-476e-befb-997aefa72f38 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1224 microversion: 2.1 time: 0.412903 Apr 09 21:08:33.316974 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2028/4096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:32 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1224 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:33.346828 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f1295605-5d7f-4e6b-9fe0-5500bd1c699c tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bc727759-fac6-4647-b6d1-3bc210398620" status: 200 len: 344 microversion: 2.1 time: 0.138733 Apr 09 21:08:33.348070 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2069/4097] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:08:33 2022] GET /compute/v2.1/os-volumes/bc727759-fac6-4647-b6d1-3bc210398620 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:33.911139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:33.913572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:33.933982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:33.937075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:33.938619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:33.942422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:34.225357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:34.226206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:34.247759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:34.250314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:34.255903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:34.256220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:34.590006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:34.620654 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56a7639c-e32e-41b0-b440-926cb4554dc3 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.715276 Apr 09 21:08:34.621639 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2029/4098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:33 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:34.657391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:34.658286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:34.673899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:34.674714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:34.675726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:34.685943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.067791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:35.082354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad9c0285-94e7-4999-8f8b-ecf40f6ae278 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1294 microversion: 2.1 time: 0.447400 Apr 09 21:08:35.085196 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2030/4099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:34 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1294 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:35.169279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:35.182354 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-27d24fde-254c-4d02-9b36-7daeb773b2cf tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1490 microversion: 2.1 time: 0.962258 Apr 09 21:08:35.189718 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2070/4100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:34 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1490 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:35.214453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:35.215412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:35.233334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.236921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.239489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.240628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.289760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90b340bb-795b-4aa2-b088-f90c639955db tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08f6f8ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:35.317814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:08:35.462679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90b340bb-795b-4aa2-b088-f90c639955db tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c2522bba-83b3-4fd0-9394-ea578cfd8752" status: 200 len: 344 microversion: 2.1 time: 0.178203 Apr 09 21:08:35.463781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2071/4101] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:08:35 2022] GET /compute/v2.1/os-volumes/c2522bba-83b3-4fd0-9394-ea578cfd8752 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:08:35.488652 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd0c0b42-f235-431e-9d5e-c23c005d8150 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 204 len: 0 microversion: 2.1 time: 0.276741 Apr 09 21:08:35.493137 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2031/4102] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:35 2022] DELETE /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:08:35.501199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:35.502177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:35.516089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.519055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.520339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.523770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.639291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:35.640318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:35.651632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.661416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:35.662668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:35.663358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:36.634021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:36.646612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:36.660038 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84fc54ae-a4a1-4473-8a9a-940d59b6c84c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 1.025225 Apr 09 21:08:36.672662 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93e1f9b5-dc57-47e4-b1a1-b643352a52ab tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1496 microversion: 2.1 time: 1.170723 Apr 09 21:08:36.672870 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2032/4103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:35 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:36.687190 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2072/4104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:35 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1496 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:36.693106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:36.696991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:36.732454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:36.736086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:36.737256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:36.737880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:37.040228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:37.051132 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4629d193-e1a3-411d-99ff-1b5b95451efd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1282 microversion: 2.1 time: 0.379716 Apr 09 21:08:37.052728 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2033/4105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:36 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1282 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:37.432132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-58da7860-ee42-4816-88d6-b8af48dfc036 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08e005790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:37.571046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-335450531", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "789b051e-cb74-421c-9a69-8135c2375c29"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:37.582462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-58da7860-ee42-4816-88d6-b8af48dfc036 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4beefcd8-b027-4b6c-86eb-7a298d0edd5c" status: 200 len: 344 microversion: 2.1 time: 0.154161 Apr 09 21:08:37.583383 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2034/4106] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:08:37 2022] GET /compute/v2.1/os-volumes/4beefcd8-b027-4b6c-86eb-7a298d0edd5c => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:37.595025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e824c6d-753d-40e1-9ee8-d6a86f5db222 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08e056550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:37.754591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] validate_networks() for [('789b051e-cb74-421c-9a69-8135c2375c29', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:37.871353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e824c6d-753d-40e1-9ee8-d6a86f5db222 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.280542 Apr 09 21:08:37.872759 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2035/4107] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:08:37 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:37.880235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:37.882675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:37.892050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:37.895654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:37.897525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:37.899277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.455677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:38.465755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2469886-306f-49b8-ad22-d0bb7781f5e8 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.591627 Apr 09 21:08:38.467825 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2036/4108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:37 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:38.476748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:38.479154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:38.496766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.501375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.502686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.503306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.521006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:38.522019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:38.522615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:38.523140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:38.523663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:38.543686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.544302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.545291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.545933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.555808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.558990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.560290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lazy-loading 'fault' on Instance uuid 3b65a0d7-8c88-46e6-ac52-45246891d7b3 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:08:38.590150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:38.622465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for user a340104b44ec49f98a5aec0d0ce5a015 and project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:38.657779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:38.662219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f474d5daf947ff9f632424e909390a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184d9189f1364fc1bdd88feff79103e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:38.665224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:38.671684 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05814f34-fb25-4e9e-9e53-b7b4b51cb891 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 200 len: 1303 microversion: 2.1 time: 0.201127 Apr 09 21:08:38.678564 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2037/4109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:38 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:38.691190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14acb15e-8daf-47db-8be8-c913550d17e3 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08e079e50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:38.861236 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e255e19d-a6f6-482e-ad34-291c3b64c49a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.642667 Apr 09 21:08:38.878367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2073/4110] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:08:38.903038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:38.904262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:38.926091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.929539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.930979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:38.934366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:38.999081 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14acb15e-8daf-47db-8be8-c913550d17e3 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.318974 Apr 09 21:08:38.999693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2038/4111] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Apr 9 21:08:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:39.010449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-15bfb545-8dc2-4b1f-b421-d1024ed8d8c9 req-c6309dec-b457-4c51-99d7-61957e3641db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b65a0d7-8c88-46e6-ac52-45246891d7b3", "name": "network-vif-deleted", "tag": "86342107-c191-409d-a7f1-662450d04178"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:39.051465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-15bfb545-8dc2-4b1f-b421-d1024ed8d8c9 req-c6309dec-b457-4c51-99d7-61957e3641db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:39.052568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-15bfb545-8dc2-4b1f-b421-d1024ed8d8c9 req-c6309dec-b457-4c51-99d7-61957e3641db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:39.090313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-15bfb545-8dc2-4b1f-b421-d1024ed8d8c9 req-c6309dec-b457-4c51-99d7-61957e3641db service nova] Creating event network-vif-deleted:86342107-c191-409d-a7f1-662450d04178 for instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 on nch1-master-1 Apr 09 21:08:39.101616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-15bfb545-8dc2-4b1f-b421-d1024ed8d8c9 req-c6309dec-b457-4c51-99d7-61957e3641db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100046 Apr 09 21:08:39.117440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2039/4112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:39.123885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1135370782", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "789b051e-cb74-421c-9a69-8135c2375c29"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:39.203166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] validate_networks() for [('789b051e-cb74-421c-9a69-8135c2375c29', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:39.528339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:39.540742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76c2bbdc-ba35-4bb7-a321-6681b404ef7a tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.652240 Apr 09 21:08:39.541737 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2074/4113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:38 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:39.556781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1e467be-b76e-456a-9a30-9bd594a66c6c tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08eaefa60>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:39.728832 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1e467be-b76e-456a-9a30-9bd594a66c6c tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.184083 Apr 09 21:08:39.729758 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2075/4114] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:08:39 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:39.734669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:39.735514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:39.776781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:39.782992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:39.784983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:39.791921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:40.742522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:40.758937 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f767f954-2245-4819-9448-29c9502fc7e1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 1.023728 Apr 09 21:08:40.761289 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2076/4115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:39 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:40.794920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:40.796977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:40.825504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:40.827442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:40.835131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:40.835609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:40.898149 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. Apr 09 21:08:40.898790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:40.907104 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce0d0658-301f-4224-8d8b-f983b1da9805 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 404 len: 111 microversion: 2.1 time: 0.139538 Apr 09 21:08:40.908754 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2077/4116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:40 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:40.929016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0318c736-3f3d-4610-9911-053602ad4f08 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08f0688b0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:41.169971 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0318c736-3f3d-4610-9911-053602ad4f08 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.259098 Apr 09 21:08:41.170960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2078/4117] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 21:08:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:41.176332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:41.179116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:41.204391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.205704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.207325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.208385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.295992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:41.297784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:41.298864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:41.299633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:41.300533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:41.325191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.327081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.329829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.333253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.407277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:41.427090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for user a340104b44ec49f98a5aec0d0ce5a015 and project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:41.459201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:41.467267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:41.595006 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9f67ad8-de22-4ccc-b92c-de1128f001af tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474062 Apr 09 21:08:41.599533 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2040/4118] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:41.627752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:41.629677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:41.654114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.657207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.658505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:41.662564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:41.701667 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. Apr 09 21:08:41.702700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:41.703794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2edcdcde-5372-4e5b-bac6-fb1bc3e4abfe tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 404 len: 111 microversion: 2.1 time: 0.102713 Apr 09 21:08:41.708345 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2041/4119] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:41 2022] DELETE /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:41.714562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a239918a-c88f-46eb-84dc-4950240d5358 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08e0a95e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:41.868604 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a239918a-c88f-46eb-84dc-4950240d5358 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.158855 Apr 09 21:08:41.870252 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2042/4120] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 21:08:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:41.882093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1817841395", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "451", "networks": [{"uuid": "789b051e-cb74-421c-9a69-8135c2375c29"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:41.929431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:41.939122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-579302d9-321a-459e-a3bf-a951d6f4f692 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.765180 Apr 09 21:08:41.940003 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2079/4121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:41 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:41.982891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:41.985006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b65a0d7-8c88-46e6-ac52-45246891d7b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:42.029362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:42.030257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:42.034140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:42.036199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:42.066111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] validate_networks() for [('789b051e-cb74-421c-9a69-8135c2375c29', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:42.080413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. Apr 09 21:08:42.081579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b65a0d7-8c88-46e6-ac52-45246891d7b3 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:42.082841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd5a1526-be7d-4a7b-9367-5755989dfe24 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3" status: 404 len: 111 microversion: 2.1 time: 0.140782 Apr 09 21:08:42.085512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2080/4122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:41 2022] GET /compute/v2.1/servers/3b65a0d7-8c88-46e6-ac52-45246891d7b3 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:42.093813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:42.097876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:42.114003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:42.114689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:42.117358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:42.118465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:43.744274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:43.759548 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fcf573a-00c8-4981-af9b-fc14b4c2935a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 1.671455 Apr 09 21:08:43.762092 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2081/4123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:42 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:43.787077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ae6b483-1741-45e3-ad31-0788dcdaecf2 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08f2f1dc0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:44.068925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ae6b483-1741-45e3-ad31-0788dcdaecf2 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.304078 Apr 09 21:08:44.069964 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2082/4124] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 21:08:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:44.077974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:44.078575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:44.101337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.101940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.102851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.106977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.144257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. Apr 09 21:08:44.155222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:44.167086 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da6b291f-9b7c-40e5-955b-7d004e3378f8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 404 len: 111 microversion: 2.1 time: 0.085156 Apr 09 21:08:44.170700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2083/4125] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:44 2022] DELETE /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:44.182006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:44.182838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:44.195092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.195559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.204940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.205442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.736742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:44.751977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91d6a5de-d13c-44e0-b07a-d4f66753de48 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.580122 Apr 09 21:08:44.753539 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2084/4126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:44 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:44.769891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a291237a-9e49-4227-8a23-887a82fcbfe9 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08ef20280>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:44.955264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:44.956477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:44.957154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:44.957738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:44.958308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:44.976685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.978971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.980020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:44.981929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:44.999883 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a291237a-9e49-4227-8a23-887a82fcbfe9 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.244120 Apr 09 21:08:45.000609 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2085/4127] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Apr 9 21:08:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:45.006550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.007559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 2f593a18-b8be-4120-a758-0d18a7adf933] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.030686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.032797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.033986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.038890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.051355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:45.070184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. Apr 09 21:08:45.071104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 2f593a18-b8be-4120-a758-0d18a7adf933 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:45.071412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Getting quotas for user a340104b44ec49f98a5aec0d0ce5a015 and project 78452efb7ef143efa0123d3bc4873b53. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:45.072536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2ab6ed5-0282-46cc-a2ea-2168b1020fed tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933" status: 404 len: 111 microversion: 2.1 time: 0.070060 Apr 09 21:08:45.073890 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2086/4128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/servers/2f593a18-b8be-4120-a758-0d18a7adf933 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:45.085959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c5cc63c7-cb98-4c22-9c45-08068392162a req-8f4db705-0b6a-4ce6-a13c-1458267588d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b", "tag": "fd96a99c-2050-4890-8f96-e3204de0562e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:45.098732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c5cc63c7-cb98-4c22-9c45-08068392162a req-8f4db705-0b6a-4ce6-a13c-1458267588d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.099752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c5cc63c7-cb98-4c22-9c45-08068392162a req-8f4db705-0b6a-4ce6-a13c-1458267588d6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.115217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:45.116994 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c5cc63c7-cb98-4c22-9c45-08068392162a req-8f4db705-0b6a-4ce6-a13c-1458267588d6 service nova] Creating event network-changed:fd96a99c-2050-4890-8f96-e3204de0562e for instance e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b on nch2-master-1 Apr 09 21:08:45.124869 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c5cc63c7-cb98-4c22-9c45-08068392162a req-8f4db705-0b6a-4ce6-a13c-1458267588d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044614 Apr 09 21:08:45.125521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:45.126304 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2087/4129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:45.148918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.150323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.163408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.165067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.167246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.174099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.249581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-af9ef19e-dee6-4372-ae00-2081cd819d92 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.377540 Apr 09 21:08:45.255196 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2043/4130] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:45.266987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f5bda2c-a357-447d-868b-9111751f0603 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] Calling method '.version_select at 0x7fb08e079040>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.457052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f5bda2c-a357-447d-868b-9111751f0603 tempest-VolumesTestJSON-1095162168 tempest-VolumesTestJSON-1095162168-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.200500 Apr 09 21:08:45.457645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2044/4131] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:45.462420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.464237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.482216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.490007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.494927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.495501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.531051 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. Apr 09 21:08:45.531672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:45.532525 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df76f92f-d913-4e11-8927-61601f6f2e6c tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 404 len: 111 microversion: 2.1 time: 0.073962 Apr 09 21:08:45.541188 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2045/4132] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:45 2022] DELETE /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:45.550650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2d7768dc-393b-4c0a-adbf-a2b150fb7a35 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.551289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2d7768dc-393b-4c0a-adbf-a2b150fb7a35 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.837568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2d7768dc-393b-4c0a-adbf-a2b150fb7a35 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:45.846539 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2d7768dc-393b-4c0a-adbf-a2b150fb7a35 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1221 microversion: 2.1 time: 0.303704 Apr 09 21:08:45.850751 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2046/4133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1221 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:45.862892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.864157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 276af9a8-cb98-49e4-b5f7-b53121790a25] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.884547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.885015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.888959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.892654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.929570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. Apr 09 21:08:45.930268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 276af9a8-cb98-49e4-b5f7-b53121790a25 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:45.931161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-46f5ee1d-4603-406b-a89e-b3e4b97c5f54 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25" status: 404 len: 111 microversion: 2.1 time: 0.079219 Apr 09 21:08:45.935680 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2047/4134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/servers/276af9a8-cb98-49e4-b5f7-b53121790a25 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:45.954308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:45.955023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:45.983708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.986898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:45.988429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:45.991493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:46.286424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:46.302605 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9e22f54-4dd4-4a4e-bc21-00889c516e49 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 1.171490 Apr 09 21:08:46.317143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2088/4135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:46.348565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:46.349331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:46.375823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:46.382385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:46.383355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:46.383820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:46.467068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. Apr 09 21:08:46.467913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:46.472589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff97fb5f-a0f0-4491-bae3-c91c9f4a92ee tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 404 len: 111 microversion: 2.1 time: 0.151321 Apr 09 21:08:46.482451 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2089/4136] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:46 2022] DELETE /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:46.623763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: .version_select at 0x7fb08f2f1dc0>, body: {"keypair": {"name": "tempest-keypair-1219254406"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:46.672827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:46.713889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:46.901575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:46.922801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dfb2365-078a-458f-a668-b1e1504447fa tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.984794 Apr 09 21:08:46.938055 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2048/4137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:45 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:46.952325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:46.954144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: f547d94a-a0fa-49d6-8a26-369b8f5a1c59] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:46.976646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:46.977128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:46.981120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:46.981578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:46.985925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:47.006606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:47.047299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de686c7e-ad71-4230-9423-6aa0bc3f917e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.561311 Apr 09 21:08:47.051893 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2090/4138] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 21:08:46 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 569 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:08:47.064307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:47.065120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:47.066046 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. Apr 09 21:08:47.067261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance f547d94a-a0fa-49d6-8a26-369b8f5a1c59 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:47.068276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a799cd47-c28b-4627-b8a0-b24334dc7347 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59" status: 404 len: 111 microversion: 2.1 time: 0.128891 Apr 09 21:08:47.069313 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2049/4139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:46 2022] GET /compute/v2.1/servers/f547d94a-a0fa-49d6-8a26-369b8f5a1c59 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:47.081598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7bc07a4-a86f-47b4-977a-261e94dcfd33 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:47.081849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.082106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7bc07a4-a86f-47b4-977a-261e94dcfd33 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:47.082425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:47.086190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.091374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:47.093862 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f7bc07a4-a86f-47b4-977a-261e94dcfd33 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. Apr 09 21:08:47.095004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7bc07a4-a86f-47b4-977a-261e94dcfd33 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:47.102168 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7bc07a4-a86f-47b4-977a-261e94dcfd33 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73" status: 404 len: 111 microversion: 2.1 time: 0.024572 Apr 09 21:08:47.103776 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2050/4140] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:47 2022] DELETE /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:47.111877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42efe020-50f2-44fe-91b1-1dcd7d7755e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:47.112775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42efe020-50f2-44fe-91b1-1dcd7d7755e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 082e5cc2-3b4d-4355-aff4-6791f878fd73] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:47.126622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-42efe020-50f2-44fe-91b1-1dcd7d7755e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. Apr 09 21:08:47.128615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42efe020-50f2-44fe-91b1-1dcd7d7755e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 082e5cc2-3b4d-4355-aff4-6791f878fd73 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:47.131264 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42efe020-50f2-44fe-91b1-1dcd7d7755e8 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73" status: 404 len: 111 microversion: 2.1 time: 0.023484 Apr 09 21:08:47.133387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2051/4141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:47 2022] GET /compute/v2.1/servers/082e5cc2-3b4d-4355-aff4-6791f878fd73 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:08:47.232588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:47.254538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97c4dcf0-3c75-4066-8866-1c9e0850a220 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1273 microversion: 2.1 time: 0.198943 Apr 09 21:08:47.266107 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2091/4142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:47 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:47.323256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:47.324139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:47.335867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.338036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:47.339948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.341733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:47.800063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:47.810222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12137e79-d1df-4bb9-bc62-d5c38728c229 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.490650 Apr 09 21:08:47.822895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2052/4143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:47 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:47.955729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:47.956355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:47.966040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.966517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:47.967308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:47.971746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:48.272804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:48.273502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:48.284566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:48.286732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:48.288795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:48.289326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.138215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:49.148927 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-006ef480-69a4-4aa9-a93f-a61a3f822b0d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1273 microversion: 2.1 time: 0.880659 Apr 09 21:08:49.153916 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2053/4144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:48 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1273 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:49.177250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:49.179094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:49.195203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.196048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.197374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.198041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.209008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:49.224167 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. Apr 09 21:08:49.225263 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-338de7e1-e93e-453e-9079-cad5e509a2cd tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 1.267983 Apr 09 21:08:49.225742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:49.225943 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2092/4145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:47 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:49.237615 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-884f693f-1d2d-443c-a99c-69107d69ce72 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 404 len: 111 microversion: 2.1 time: 0.078578 Apr 09 21:08:49.238007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:49.239522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:49.242265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2054/4146] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:49 2022] DELETE /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:49.257176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.257823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.259167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:49.262716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.263540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.264270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 3b5fe469-5023-4fb7-a476-c2d2317003ad] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:49.299320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.309953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.318258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.319073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.363801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. Apr 09 21:08:49.365190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 3b5fe469-5023-4fb7-a476-c2d2317003ad could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:49.369160 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2783a5bb-d7d2-4545-8950-6da10674dd29 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad" status: 404 len: 111 microversion: 2.1 time: 0.121136 Apr 09 21:08:49.371232 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2055/4147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:49 2022] GET /compute/v2.1/servers/3b5fe469-5023-4fb7-a476-c2d2317003ad => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:49.388393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:49.391367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:49.413627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.414354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.418888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.420053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.460792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. Apr 09 21:08:49.463676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:49.464760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-480705cc-644f-40df-ab50-f5bb496d3d14 tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 404 len: 111 microversion: 2.1 time: 0.089118 Apr 09 21:08:49.468464 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2056/4148] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:08:49 2022] DELETE /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:49.598482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1810929334", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:49.717157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] validate_networks() for [('6ba3f1cd-154a-468d-adbc-6dec47d2b32d', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:49.828999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:49.846253 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e4ebc7f-7e99-471a-a200-0b7059a65fe5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.619036 Apr 09 21:08:49.856628 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2093/4149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:49 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:49.866688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:49.867580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] [instance: 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:49.888904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.889459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.890446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:49.891035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:49.912002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] HTTP exception thrown: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. Apr 09 21:08:49.925991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] Returning 404 to user: Instance 5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:08:49.927175 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43b5cd6b-a2f4-4b33-84c2-7f4fef27c0ae tempest-DeleteServersTestJSON-183073171 tempest-DeleteServersTestJSON-183073171-project] 10.222.0.30 "GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79" status: 404 len: 111 microversion: 2.1 time: 0.069468 Apr 09 21:08:49.927923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2094/4150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:49 2022] GET /compute/v2.1/servers/5f6c5f3a-d12c-41cd-84cc-8bc7d4189a79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:08:50.173072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:50.173860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:50.187393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:50.198916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:50.199818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:50.200447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:50.503667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:50.518490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98883731-bdfd-4018-be89-d876acb24839 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1279 microversion: 2.1 time: 0.346808 Apr 09 21:08:50.520571 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2095/4151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:50 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:50.538940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:50.539578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:50.562260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:50.567510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:50.570859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:50.572070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.535683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:51.555268 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7738c04-2264-4df6-ac34-5c118c6ad4d7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 1.030839 Apr 09 21:08:51.567371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2096/4152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:50 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:51.583214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4dadd936-8a3d-4908-99ed-d3a1584b9f2c req-78b42fc0-78cf-4d23-9f30-5b256937ac41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1420da11-8d6c-4a24-80ae-1d15af7fd212", "tag": "0b5260ea-bc03-4717-8368-2372659dfd8f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:51.609593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4dadd936-8a3d-4908-99ed-d3a1584b9f2c req-78b42fc0-78cf-4d23-9f30-5b256937ac41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:51.610126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4dadd936-8a3d-4908-99ed-d3a1584b9f2c req-78b42fc0-78cf-4d23-9f30-5b256937ac41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.644578 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4dadd936-8a3d-4908-99ed-d3a1584b9f2c req-78b42fc0-78cf-4d23-9f30-5b256937ac41 service nova] Creating event network-changed:0b5260ea-bc03-4717-8368-2372659dfd8f for instance 1420da11-8d6c-4a24-80ae-1d15af7fd212 on nch1-master-1 Apr 09 21:08:51.661913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4dadd936-8a3d-4908-99ed-d3a1584b9f2c req-78b42fc0-78cf-4d23-9f30-5b256937ac41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093084 Apr 09 21:08:51.662859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2097/4153] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:51.672694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:51.686419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:51.712516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:51.713266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.717026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:51.717802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.750485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:51.752824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:51.753583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:51.754237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:51.754881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:51.791502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:51.792027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.792855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:51.793339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:51.846979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:51.865775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for user 2abb09d2f7844f3ba0f7a20787d73e4b and project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:51.902353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:51.904809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:52.049830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ad137e7-f899-4aed-8340-5640694ee31d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.580038 Apr 09 21:08:52.053485 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2057/4154] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:52.078640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:52.079764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:52.102641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:52.103488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:52.105214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:52.106039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:52.223502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:52.258271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4101c16c-2a2b-48f3-a8fa-5e90ae64d391 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.582453 Apr 09 21:08:52.261234 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2098/4155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:51 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:52.292281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:52.304244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3921c48f-4525-4995-8e33-1287514fc782 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1279 microversion: 2.1 time: 0.244331 Apr 09 21:08:52.316707 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2058/4156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:52 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:52.317861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1ba3877-6ada-4a9d-b128-14a47c28d87f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:52.317861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1ba3877-6ada-4a9d-b128-14a47c28d87f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:52.574532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:52.575677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:52.590513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:52.601650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1ba3877-6ada-4a9d-b128-14a47c28d87f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:52.626290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:52.630920 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1ba3877-6ada-4a9d-b128-14a47c28d87f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1222 microversion: 2.1 time: 0.366322 Apr 09 21:08:52.633537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:52.634189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:52.640414 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2099/4157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:52 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1222 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:52.908359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-190007676", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:52.972845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:52.981189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc0db0fe-9d42-43bf-a58f-2a43efbb48e6 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.411346 Apr 09 21:08:52.981792 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2059/4158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:52 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:53.015162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] validate_networks() for [('6ba3f1cd-154a-468d-adbc-6dec47d2b32d', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:53.282530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:53.283581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:53.294368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:53.295203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:53.296292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:53.296958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:54.001710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:54.029024 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c58149c-05c0-479a-87c5-bf804f5efe93 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.755083 Apr 09 21:08:54.036618 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2060/4159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:53 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:54.049338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:54.075790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:54.099854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:54.100868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:54.103248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:54.117749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:54.877514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:54.878687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:54.879327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:54.879897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:54.880492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:54.903346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:54.904084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:54.905209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:54.905821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:54.940776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:54.948237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for user 2abb09d2f7844f3ba0f7a20787d73e4b and project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:54.983071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:54.986146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:55.081306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e84905ca-5bfa-49cd-ae2b-b08d646f8974 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.177549 Apr 09 21:08:55.083136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:55.105944 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2100/4160] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:08:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:08:55.106792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b02d48d2-d1a9-4c5e-ba67-7d6f489dbf93 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 1.067132 Apr 09 21:08:55.108352 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2061/4161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:54 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:55.113473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bcfbbdb4-44ef-4891-ae80-0c919742243d req-982009cf-25b6-4ce1-aa2d-d7c51093cb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e715c6e5-ef93-4e1e-99f6-bef6977c722d", "tag": "ac563efd-83c8-45fd-823a-435cae4d5a0d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:55.121216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:55.125683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:55.131895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bcfbbdb4-44ef-4891-ae80-0c919742243d req-982009cf-25b6-4ce1-aa2d-d7c51093cb17 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.132350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bcfbbdb4-44ef-4891-ae80-0c919742243d req-982009cf-25b6-4ce1-aa2d-d7c51093cb17 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.154298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.156551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.159222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.159924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.162184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bcfbbdb4-44ef-4891-ae80-0c919742243d req-982009cf-25b6-4ce1-aa2d-d7c51093cb17 service nova] Creating event network-changed:ac563efd-83c8-45fd-823a-435cae4d5a0d for instance e715c6e5-ef93-4e1e-99f6-bef6977c722d on nch1-master-1 Apr 09 21:08:55.179056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bcfbbdb4-44ef-4891-ae80-0c919742243d req-982009cf-25b6-4ce1-aa2d-d7c51093cb17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071692 Apr 09 21:08:55.179682 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2101/4162] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:55.199114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:55.206903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:55.220071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.220794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.223769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.225135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.627490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:55.642700 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2299b8b5-9879-417e-98c4-7e854373aa2e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.449485 Apr 09 21:08:55.643867 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2102/4163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:55 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:55.648146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:55.659829 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56374c86-2e78-455c-a651-62f68506c71b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.549030 Apr 09 21:08:55.665614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2062/4164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:55 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:55.667755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b8d00f3-9126-47b6-a94c-0ad744ac5a8a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:55.668639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b8d00f3-9126-47b6-a94c-0ad744ac5a8a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:55.767622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b8d00f3-9126-47b6-a94c-0ad744ac5a8a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:55.776536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b8d00f3-9126-47b6-a94c-0ad744ac5a8a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1221 microversion: 2.1 time: 0.115488 Apr 09 21:08:55.777789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2103/4165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:55 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:55.784744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-939573cc-cdd4-46dc-9afd-de5fec8ce7d1 req-96e70f1d-0151-4eac-b57b-d6d0ac637110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "name": "network-vif-plugged", "status": "completed", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:55.812585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-939573cc-cdd4-46dc-9afd-de5fec8ce7d1 req-96e70f1d-0151-4eac-b57b-d6d0ac637110 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:55.814215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-939573cc-cdd4-46dc-9afd-de5fec8ce7d1 req-96e70f1d-0151-4eac-b57b-d6d0ac637110 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:55.853797 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-939573cc-cdd4-46dc-9afd-de5fec8ce7d1 req-96e70f1d-0151-4eac-b57b-d6d0ac637110 service nova] Creating event network-vif-plugged:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch2-master-1 Apr 09 21:08:55.864203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1161336451", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ff888c0-c368-48bd-816c-de9ec28120a0"}], "security_groups": [{"name": "tempest-securitygroup--1327340545"}], "key_name": "tempest-keypair-1219254406", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:55.881229 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-939573cc-cdd4-46dc-9afd-de5fec8ce7d1 req-96e70f1d-0151-4eac-b57b-d6d0ac637110 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097345 Apr 09 21:08:55.895363 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2063/4166] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:56.125281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:56.125998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:56.164917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:56.165454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:56.167184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:56.169622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:56.637802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] validate_networks() for [('7ff888c0-c368-48bd-816c-de9ec28120a0', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:08:57.542270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:57.554625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9de4e90-f7cc-4fb4-a9dd-a03149ed6abd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 1.432032 Apr 09 21:08:57.556336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2064/4167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:56 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:08:57.566665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:57.569286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:57.583675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:57.585347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:57.586477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:57.587975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:58.170491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:58.179901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5f38836-c5a8-45df-97ec-a3680ed87406 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.617510 Apr 09 21:08:58.180512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2065/4168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:57 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:58.195495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:58.196313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:58.214710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:58.215134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:58.216048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:58.216672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:58.955283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:58.963241 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-582f3ae8-1f8a-4d42-abc5-237207fbbf8b tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.775471 Apr 09 21:08:58.971406 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2066/4169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:58 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:58.976699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:58.977164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:58.990710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:58.991880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:58.993358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:58.997862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.158711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:08:59.159220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:08:59.159793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:08:59.160318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:08:59.160794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:08:59.187219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.188139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.190501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.190962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.207047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:59.217738 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4985bae2-bbf0-46dc-9833-810b31ac9363 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1279 microversion: 2.1 time: 0.244914 Apr 09 21:08:59.220504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2067/4170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:58 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:59.230691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-25b55cff-0d7c-44f4-95dd-7b5d08754701 req-8b86b41a-7587-4e8a-85a6-dd93ec759051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9935d3-690d-491f-bdc0-54c1af4a0627", "tag": "d7f56580-7bb2-4c4f-8b27-f07713dc360b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:59.241220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:08:59.255279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-25b55cff-0d7c-44f4-95dd-7b5d08754701 req-8b86b41a-7587-4e8a-85a6-dd93ec759051 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.255834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-25b55cff-0d7c-44f4-95dd-7b5d08754701 req-8b86b41a-7587-4e8a-85a6-dd93ec759051 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.257329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:08:59.283884 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-25b55cff-0d7c-44f4-95dd-7b5d08754701 req-8b86b41a-7587-4e8a-85a6-dd93ec759051 service nova] Creating event network-changed:d7f56580-7bb2-4c4f-8b27-f07713dc360b for instance ff9935d3-690d-491f-bdc0-54c1af4a0627 on nch2-master-1 Apr 09 21:08:59.286328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:08:59.289928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:08:59.294804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-25b55cff-0d7c-44f4-95dd-7b5d08754701 req-8b86b41a-7587-4e8a-85a6-dd93ec759051 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071336 Apr 09 21:08:59.298590 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2068/4171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:59.309959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:59.316202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:59.331772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.332212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.338292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.338814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.362299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e318a76-aca8-4dca-a7c1-a87a33ab60e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.502898 Apr 09 21:08:59.363443 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2104/4172] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:08:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3505 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 09 21:08:59.369318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0d2a5e7b-79de-4fc2-b770-8dfad1ec21f0 req-6862d321-0c2c-4b14-b636-bbf075e25b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1420da11-8d6c-4a24-80ae-1d15af7fd212", "name": "network-vif-plugged", "status": "completed", "tag": "0b5260ea-bc03-4717-8368-2372659dfd8f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:08:59.379864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0d2a5e7b-79de-4fc2-b770-8dfad1ec21f0 req-6862d321-0c2c-4b14-b636-bbf075e25b0c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.381488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0d2a5e7b-79de-4fc2-b770-8dfad1ec21f0 req-6862d321-0c2c-4b14-b636-bbf075e25b0c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.422915 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0d2a5e7b-79de-4fc2-b770-8dfad1ec21f0 req-6862d321-0c2c-4b14-b636-bbf075e25b0c service nova] Creating event network-vif-plugged:0b5260ea-bc03-4717-8368-2372659dfd8f for instance 1420da11-8d6c-4a24-80ae-1d15af7fd212 on nch1-master-1 Apr 09 21:08:59.432201 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0d2a5e7b-79de-4fc2-b770-8dfad1ec21f0 req-6862d321-0c2c-4b14-b636-bbf075e25b0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066683 Apr 09 21:08:59.434122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2105/4173] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:08:59.457081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:08:59.458129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:08:59.499642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.500105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.500900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:08:59.508081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:08:59.979478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:08:59.991572 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-668d2230-ccdc-4e08-8da1-6e43bea930f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 0.688865 Apr 09 21:08:59.993222 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2069/4174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:59 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:08:59.999580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:00.000530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:00.008943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.009778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.010803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.011483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.100275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.110111 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06d363cc-927a-4af7-8cdb-6fb858cef4f4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1519 microversion: 2.1 time: 0.673734 Apr 09 21:09:00.110707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2106/4175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:08:59 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1519 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:00.123975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.124153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:00.124844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:00.138441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.145474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.146072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.147664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e78b2b0d-af05-43e1-94d0-d01c30256dff tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1286 microversion: 2.20 time: 0.153273 Apr 09 21:09:00.150057 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2070/4176] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:08:59 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:00.150209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.152024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.152481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.239919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:00.241236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:00.255938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.256750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.257970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:00.259202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:00.537339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.546778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-632d361e-c019-45c7-905f-d00ebedcb6a7 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.433676 Apr 09 21:09:00.551033 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2107/4177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:00 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:00.655293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:00.672912 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7c47603-e8d7-4419-993c-1c7e804597bd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.431715 Apr 09 21:09:00.673999 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2071/4178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:00 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:01.010012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:01.010920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:01.023622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:01.024361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:01.025357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:01.025958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:01.127539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:01.128162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:01.136815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:01.137360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:01.138140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:01.138576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.043035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.050800 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-001327f6-7ff7-4b7f-ba39-5304861b2a43 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.927356 Apr 09 21:09:02.061744 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2072/4179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:01 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:02.066742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:02.067369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:02.087651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.088140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.088979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.089457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.256373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.266592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.270821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.277743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9330bad-4af7-4bb3-88a3-32d2bd26ac94 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1340 microversion: 2.20 time: 0.214700 Apr 09 21:09:02.279074 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2073/4180] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:02 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:02.293815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cd398bc0-5f05-41d3-ba4d-1ba37a31c268 req-e5b1b7a0-61ee-4d05-9291-2bdda979f98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5c2a8d-465a-4048-b5dc-68d900a9879b", "tag": "26dc0e8e-93b6-4aae-af6f-97e1d095b96f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:02.310546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cd398bc0-5f05-41d3-ba4d-1ba37a31c268 req-e5b1b7a0-61ee-4d05-9291-2bdda979f98e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.313594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cd398bc0-5f05-41d3-ba4d-1ba37a31c268 req-e5b1b7a0-61ee-4d05-9291-2bdda979f98e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.341967 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cd398bc0-5f05-41d3-ba4d-1ba37a31c268 req-e5b1b7a0-61ee-4d05-9291-2bdda979f98e service nova] Creating event network-changed:26dc0e8e-93b6-4aae-af6f-97e1d095b96f for instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b on nch2-master-1 Apr 09 21:09:02.352822 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cd398bc0-5f05-41d3-ba4d-1ba37a31c268 req-e5b1b7a0-61ee-4d05-9291-2bdda979f98e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072295 Apr 09 21:09:02.353903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2074/4181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:02.377124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b", "name": "network-vif-plugged", "status": "completed", "tag": "fd96a99c-2050-4890-8f96-e3204de0562e"}, {"server_uuid": "e715c6e5-ef93-4e1e-99f6-bef6977c722d", "name": "network-vif-plugged", "status": "completed", "tag": "ac563efd-83c8-45fd-823a-435cae4d5a0d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:02.396478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.397593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.399867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.413774 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0de6b631-ed1e-43bd-86a0-d005e08f1720 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 1.402081 Apr 09 21:09:02.416131 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] Creating event network-vif-plugged:fd96a99c-2050-4890-8f96-e3204de0562e for instance e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b on nch2-master-1 Apr 09 21:09:02.425260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] Creating event network-vif-plugged:ac563efd-83c8-45fd-823a-435cae4d5a0d for instance e715c6e5-ef93-4e1e-99f6-bef6977c722d on nch1-master-1 Apr 09 21:09:02.425711 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2108/4182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:01 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:02.425711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:02.425711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:02.435326 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-757110aa-9a17-4429-a29c-db6586a5d74c req-a07bf88a-920a-444f-9f3b-2c5d1fbe46cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079154 Apr 09 21:09:02.436963 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2075/4183] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:02.443281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.449514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.455780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.456560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.457574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:02.458298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:02.467226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.468039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.469195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:02.469798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:02.949880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:02.970526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39a76a8e-6ccd-48d2-8737-06a6821683b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.530988 Apr 09 21:09:02.980666 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2076/4184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:02 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:02.989933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:02.990563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:03.001411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.001989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.002920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.003359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.092810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.101178 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f6280c6-0518-4f4b-b41a-ec2f60ff744d tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 0.682912 Apr 09 21:09:03.101775 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2109/4185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:02 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:03.298364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:03.299007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:03.309691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.310242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.311109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.317622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.490390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.509256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.512184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.519391 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5c53895-ed11-49ca-aa71-a840b0914c5b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1340 microversion: 2.20 time: 0.225917 Apr 09 21:09:03.521094 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2110/4186] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:03 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:09:03.527066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:03.527692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:03.535975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.537921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.538546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.539497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.540085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.548734 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d911531-1a4d-4713-bf30-7c62af03d0d4 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.574481 Apr 09 21:09:03.569702 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2077/4187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:02 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:03.576554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:03.577558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:03.592310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.593065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.594185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.594856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.959210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:03.967580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a12f0ea8-cfa7-4d09-aacb-01eb666a5733 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 0.445410 Apr 09 21:09:03.968200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2111/4188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:03 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:03.988294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:03.988818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:03.998088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.998547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:03.999477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:03.999847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:04.041485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:04.062252 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0bad62a4-bc20-4988-9f5e-1a1ec40599cb tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.490055 Apr 09 21:09:04.066258 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2078/4189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:03 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:04.088663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6dae4716-afdc-42c4-96a7-ed536da39aa5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:04.100696 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6dae4716-afdc-42c4-96a7-ed536da39aa5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 6fbf8921-5bf1-43a8-93f0-61feaecf16a0 has no mapping to a cell. Apr 09 21:09:04.102586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6dae4716-afdc-42c4-96a7-ed536da39aa5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 6fbf8921-5bf1-43a8-93f0-61feaecf16a0 has no mapping to a cell. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:04.103556 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6dae4716-afdc-42c4-96a7-ed536da39aa5 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/6fbf8921-5bf1-43a8-93f0-61feaecf16a0/action" status: 404 len: 117 microversion: 2.1 time: 0.025104 Apr 09 21:09:04.104553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2079/4190] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:04 2022] POST /compute/v2.1/servers/6fbf8921-5bf1-43a8-93f0-61feaecf16a0/action => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:04.115591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:04.116135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:04.154902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:04.159491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:04.162417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:04.163429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:04.853408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:04.862493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-615a079e-35ef-4896-8bae-fb94349f7ca2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.878367 Apr 09 21:09:04.863079 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2112/4191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:03 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:04.869606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:04.870218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:04.887608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:04.890677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:04.892531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:04.894202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.027957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:05.044590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0da0eee-1cad-4b6b-b197-15aa3cc99959 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.933829 Apr 09 21:09:05.046138 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2080/4192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:04 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:05.064394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e2d1c6c0-89dc-45fa-affa-fb0fde7fee23 req-05744422-d7b2-4e81-9526-b527bef36669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e8348e-3b60-4836-b44b-12cb6b2094e9", "tag": "36fd7931-5c26-4cf6-ba41-57e00cc54451"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:05.073743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d1c6c0-89dc-45fa-affa-fb0fde7fee23 req-05744422-d7b2-4e81-9526-b527bef36669 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.074203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d1c6c0-89dc-45fa-affa-fb0fde7fee23 req-05744422-d7b2-4e81-9526-b527bef36669 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.088766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e2d1c6c0-89dc-45fa-affa-fb0fde7fee23 req-05744422-d7b2-4e81-9526-b527bef36669 service nova] Creating event network-changed:36fd7931-5c26-4cf6-ba41-57e00cc54451 for instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 on nch1-master-1 Apr 09 21:09:05.096834 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e2d1c6c0-89dc-45fa-affa-fb0fde7fee23 req-05744422-d7b2-4e81-9526-b527bef36669 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049066 Apr 09 21:09:05.097981 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2081/4193] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:05.104311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:05.105536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:05.113802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.114470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.115485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.115919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.667083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:05.681883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:05.683649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:05.685541 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3c4b098-362b-4ecc-9a60-2e78fdf36245 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1340 microversion: 2.20 time: 0.585583 Apr 09 21:09:05.686229 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2082/4194] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:05 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1340 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:05.692819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-926f9aa6-b4e2-4894-bd21-31df228f5e11 req-5e1b1e51-d25b-4abd-aa54-1c2c558dcf32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9935d3-690d-491f-bdc0-54c1af4a0627", "name": "network-vif-plugged", "status": "completed", "tag": "d7f56580-7bb2-4c4f-8b27-f07713dc360b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:05.701725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-926f9aa6-b4e2-4894-bd21-31df228f5e11 req-5e1b1e51-d25b-4abd-aa54-1c2c558dcf32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.702423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-926f9aa6-b4e2-4894-bd21-31df228f5e11 req-5e1b1e51-d25b-4abd-aa54-1c2c558dcf32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.731336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-926f9aa6-b4e2-4894-bd21-31df228f5e11 req-5e1b1e51-d25b-4abd-aa54-1c2c558dcf32 service nova] Creating event network-vif-plugged:d7f56580-7bb2-4c4f-8b27-f07713dc360b for instance ff9935d3-690d-491f-bdc0-54c1af4a0627 on nch2-master-1 Apr 09 21:09:05.737523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-926f9aa6-b4e2-4894-bd21-31df228f5e11 req-5e1b1e51-d25b-4abd-aa54-1c2c558dcf32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048771 Apr 09 21:09:05.738797 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2083/4195] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:05.745224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:05.746710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:05.758528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.759273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.760272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.760870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.951027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:05.967207 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ea9d511d-e307-406f-8997-e5fbe418ff52 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1324 microversion: 2.1 time: 1.102971 Apr 09 21:09:05.968624 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2113/4196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:04 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1324 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:05.976374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:05.977596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:05.987981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.989850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:05.991710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:05.993808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.508215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:06.517246 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d8a4349-ea82-45bf-8bac-288cb4b2ca91 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1321 microversion: 2.1 time: 0.776982 Apr 09 21:09:06.518480 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2084/4197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:05 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:06.523287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:06.524132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:06.530490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.531251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.532325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.532918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.591065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:06.603958 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e83b23dc-a095-443f-aed2-bcdf05b61a24 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.633804 Apr 09 21:09:06.605247 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2114/4198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:05 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:06.622235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a8a24a3-4b7c-4b44-9313-b725f384ad7c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:06.623070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a8a24a3-4b7c-4b44-9313-b725f384ad7c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 4bf3fe19-77e2-4b70-ab82-35dc6ecbf256] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:06.629873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8a8a24a3-4b7c-4b44-9313-b725f384ad7c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 4bf3fe19-77e2-4b70-ab82-35dc6ecbf256 could not be found. Apr 09 21:09:06.631360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a8a24a3-4b7c-4b44-9313-b725f384ad7c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 4bf3fe19-77e2-4b70-ab82-35dc6ecbf256 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:06.632430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a8a24a3-4b7c-4b44-9313-b725f384ad7c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/4bf3fe19-77e2-4b70-ab82-35dc6ecbf256/action" status: 404 len: 111 microversion: 2.1 time: 0.014694 Apr 09 21:09:06.633024 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2115/4199] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:06 2022] POST /compute/v2.1/servers/4bf3fe19-77e2-4b70-ab82-35dc6ecbf256/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:09:06.641783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:06.642552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:06.650417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.651063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.651845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.652291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.925387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:06.933460 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fdda4a1-3220-47b5-a11b-bcd3d34ed36d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.413674 Apr 09 21:09:06.943465 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2085/4200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:06 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:06.948710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:06.949353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:06.955944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.956616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:06.957415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:06.959049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.059092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:07.073416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:07.075549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:07.079500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4579102e-2bcc-4682-9c50-ed4882eaf80d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1340 microversion: 2.20 time: 0.133340 Apr 09 21:09:07.080330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2086/4201] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:06 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1340 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:07.085812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:07.086596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:07.087435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:07.096283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.097885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.099140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.100172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.100424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b63f7ba-e886-4c31-beda-376855b4cc05 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.462873 Apr 09 21:09:07.104213 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2116/4202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:06 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:07.127797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:07.128467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:07.166868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.167700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.168948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.169600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.626625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:07.634441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2dbb030d-c2de-447d-9104-705671d3b991 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1522 microversion: 2.1 time: 0.552644 Apr 09 21:09:07.637815 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2087/4203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:07 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:07.643572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:07.645223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:07.661425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.662101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:07.663377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:07.663972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.037551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:08.048253 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb2c1dc2-bde0-4eb4-8012-f75612079b12 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.929085 Apr 09 21:09:08.049544 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2117/4204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:07 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:08.056744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:08.060051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:08.070748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.071151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.073976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.075624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.151188 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] HTTP exception thrown: Action 999 not found Apr 09 21:09:08.153457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Returning 404 to user: Action 999 not found {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:08.154551 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95bcc549-4973-4ebf-adce-fffcf8686c28 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.103741 Apr 09 21:09:08.162748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2118/4205] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Apr 9 21:09:08 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b/os-instance-actions/999 => generated 66 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:09:08.167656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-51d400aa-3014-4258-8d82-7f81b05c674a req-cd33ee3f-e83b-413d-9e23-d780ebce41f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5c2a8d-465a-4048-b5dc-68d900a9879b", "name": "network-vif-plugged", "status": "completed", "tag": "26dc0e8e-93b6-4aae-af6f-97e1d095b96f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:08.176168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-51d400aa-3014-4258-8d82-7f81b05c674a req-cd33ee3f-e83b-413d-9e23-d780ebce41f2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.176954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-51d400aa-3014-4258-8d82-7f81b05c674a req-cd33ee3f-e83b-413d-9e23-d780ebce41f2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.191485 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-51d400aa-3014-4258-8d82-7f81b05c674a req-cd33ee3f-e83b-413d-9e23-d780ebce41f2 service nova] Creating event network-vif-plugged:26dc0e8e-93b6-4aae-af6f-97e1d095b96f for instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b on nch2-master-1 Apr 09 21:09:08.199313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-51d400aa-3014-4258-8d82-7f81b05c674a req-cd33ee3f-e83b-413d-9e23-d780ebce41f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034532 Apr 09 21:09:08.200263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2119/4206] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:08.220855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:08.225389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:08.242886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.245521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.250600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.251289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.645776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:08.654500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87e8831d-755c-419d-8364-d8dc093e5abc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1513 microversion: 2.1 time: 1.015102 Apr 09 21:09:08.668502 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2088/4207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:07 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1513 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:08.676322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:08.679360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:08.697266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.697970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.699187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.699781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.764566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lazy-loading 'flavor' on Instance uuid 66c2d8f3-9113-4bac-b1da-8e52381492d7 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:08.890526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e8e4d94-de14-4867-9eaa-481d7f0c3114 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.218717 Apr 09 21:09:08.895034 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2089/4208] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:08 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:08.934570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:08.936177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:08.957065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.960270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:08.962420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:08.963060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.019752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:09.027302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51326125-8b8d-48b1-b29c-046f8614a248 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.823684 Apr 09 21:09:09.038602 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2120/4209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:08 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:09.055231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1030a8c-69b4-4050-90c5-9aff77312814 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '.version_select at 0x7fb08eae6b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:09.056130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1030a8c-69b4-4050-90c5-9aff77312814 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: 3f153f12-190b-44f8-be3c-50f1fa9e4ec2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:09.068633 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e1030a8c-69b4-4050-90c5-9aff77312814 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] HTTP exception thrown: Instance 3f153f12-190b-44f8-be3c-50f1fa9e4ec2 could not be found. Apr 09 21:09:09.069277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1030a8c-69b4-4050-90c5-9aff77312814 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Returning 404 to user: Instance 3f153f12-190b-44f8-be3c-50f1fa9e4ec2 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:09.070328 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1030a8c-69b4-4050-90c5-9aff77312814 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/3f153f12-190b-44f8-be3c-50f1fa9e4ec2/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030611 Apr 09 21:09:09.071240 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2121/4210] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 21:09:09 2022] GET /compute/v2.1/servers/3f153f12-190b-44f8-be3c-50f1fa9e4ec2/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:09.087356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:09.088011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:09.105427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.106731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.108465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.109308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.581954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:09.591107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e9c3dba-3b2a-49ad-8dbe-b645569bf38b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1512 microversion: 2.1 time: 0.518564 Apr 09 21:09:09.596744 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2122/4211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:09 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:09.603072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:09.604562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:09.610206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:09.616643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:09.623497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:09.624312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.624703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd038524-3347-4d58-857d-bc8ee381c7a6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.730474 Apr 09 21:09:09.624824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.625614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.628105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.637189 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2090/4212] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:08 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:09.641591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:09.644086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:09.659095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.659817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.660339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:09.662871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:09.716940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:09:09.974398 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f36ed1b-3b4e-43d6-9b0d-23289f08c92c tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 204 len: 0 microversion: 2.1 time: 0.342565 Apr 09 21:09:09.975913 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2091/4213] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:09 2022] DELETE /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:09:09.985993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:09.987250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:10.000560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:10.002361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:10.004780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:10.006690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.136299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.146443 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4694f595-60d9-42e8-93e6-b6324eea5881 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1514 microversion: 2.1 time: 1.548209 Apr 09 21:09:11.147057 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2123/4214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:09 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1514 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:11.176885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:11.178933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:11.202045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.202524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.203320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.203758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.240200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.255302 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ac417c8-70a8-4633-8455-28a9b4b4806a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1512 microversion: 2.1 time: 1.277554 Apr 09 21:09:11.255908 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2092/4215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:09 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1512 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:11.289241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:11.290352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:11.297897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.299538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.300516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.304951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.611540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.621698 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68e0207c-cea6-4708-89fd-d6e0810067f4 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1528 microversion: 2.1 time: 0.457615 Apr 09 21:09:11.622746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2124/4216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:11 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1528 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:11.628149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:11.629620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:11.636450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.637280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.638367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.639041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.802245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.813181 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40d1ca12-104f-4033-90f2-a9e80f597d9e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.542786 Apr 09 21:09:11.815650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2093/4217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:11 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:11.822520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:11.835124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.839673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:11.872567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.877702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.878139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.885087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.885497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:11.892042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:11.892274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:11.893657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43529f28-45e6-4ec7-8538-ae947500e961 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.269691 Apr 09 21:09:11.894879 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2125/4218] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:11 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:12.027746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-da894c05-de6a-4f65-afa4-9d4dccc5d3de req-a236fec7-9abf-4920-a270-d63ac16ee3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:12.064455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-da894c05-de6a-4f65-afa4-9d4dccc5d3de req-a236fec7-9abf-4920-a270-d63ac16ee3b1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.065589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-da894c05-de6a-4f65-afa4-9d4dccc5d3de req-a236fec7-9abf-4920-a270-d63ac16ee3b1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.106950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-da894c05-de6a-4f65-afa4-9d4dccc5d3de req-a236fec7-9abf-4920-a270-d63ac16ee3b1 service nova] Creating event network-changed:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:09:12.122899 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-da894c05-de6a-4f65-afa4-9d4dccc5d3de req-a236fec7-9abf-4920-a270-d63ac16ee3b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102802 Apr 09 21:09:12.129883 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2126/4219] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:09:12.169659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:12.170444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:12.187099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.198827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.200309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.203220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.291974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:12.523028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:12.536601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.539160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.833462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd413a18-7c3b-4057-b94f-2d3e052d7cd3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 1.016451 Apr 09 21:09:12.834391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2094/4220] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Apr 9 21:09:11 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:12.862546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-54d9f576-7ccf-43ac-a40a-69280b060447 req-0f8c2cf8-3321-4949-b8dd-35822da2f2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b", "name": "network-vif-deleted", "tag": "fd96a99c-2050-4890-8f96-e3204de0562e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:12.879565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-54d9f576-7ccf-43ac-a40a-69280b060447 req-0f8c2cf8-3321-4949-b8dd-35822da2f2cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.880587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-54d9f576-7ccf-43ac-a40a-69280b060447 req-0f8c2cf8-3321-4949-b8dd-35822da2f2cb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.893655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:12.903917 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-54d9f576-7ccf-43ac-a40a-69280b060447 req-0f8c2cf8-3321-4949-b8dd-35822da2f2cb service nova] Creating event network-vif-deleted:fd96a99c-2050-4890-8f96-e3204de0562e for instance e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b on nch2-master-1 Apr 09 21:09:12.908127 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3239d40-38cc-40b3-b5f8-e1291586de5f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1497 microversion: 2.1 time: 0.745931 Apr 09 21:09:12.909852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2127/4221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:12 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1497 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:12.923528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:12.924469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:12.930442 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-54d9f576-7ccf-43ac-a40a-69280b060447 req-0f8c2cf8-3321-4949-b8dd-35822da2f2cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070599 Apr 09 21:09:12.932109 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2095/4222] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:12.946275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:12.947708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:12.959130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.961623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.962906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.966164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.968185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.968701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:12.969471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:12.979217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.068442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.069965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.071391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lazy-loading 'fault' on Instance uuid e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:13.214497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea522ee568943d6afe754d6c86668f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a94e7e044a6390e09032a39366f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:13.226840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fae2f38a-6d93-4819-8538-56196c7d7440 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 200 len: 1314 microversion: 2.1 time: 0.313309 Apr 09 21:09:13.227678 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2128/4223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:12 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:13.245546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:13.252318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:13.254058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-335450531', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:13.267648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.268349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.269441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.270445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.493957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:13.581601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:13.591323 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8fc4f083-428e-4dc3-ac5a-87df88ccc0b9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.656282 Apr 09 21:09:13.595091 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2096/4224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:12 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:13.600403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:13.606540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:13.607166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:13.608192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.608890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.622712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.623172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:13.624347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:13.626390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.035143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4af813be-9c3e-4f74-99d9-bccb360a21e5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-335450531" status: 200 len: 1515 microversion: 2.1 time: 0.802962 Apr 09 21:09:14.037241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2129/4225] 10.222.0.30 () {58 vars in 1260 bytes} [Sat Apr 9 21:09:13 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-335450531 => generated 1515 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:14.042754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:14.043508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:14.073945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.074755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.075778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.078207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.145180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lazy-loading 'flavor' on Instance uuid 66c2d8f3-9113-4bac-b1da-8e52381492d7 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:14.175605 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'suspend' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state suspended Apr 09 21:09:14.176727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'suspend' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state suspended {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:14.177845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50251a0e-0498-427e-8bf4-ffe6d1b963fd tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 148 microversion: 2.1 time: 0.139495 Apr 09 21:09:14.179219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2130/4226] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:14 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 148 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:09:14.192438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3734456b-030e-435b-8ffd-af654260dccc req-1197b84d-4ca6-49f7-974c-fc44fad4cc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e8348e-3b60-4836-b44b-12cb6b2094e9", "name": "network-vif-plugged", "status": "completed", "tag": "36fd7931-5c26-4cf6-ba41-57e00cc54451"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:14.209051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:14.219948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3734456b-030e-435b-8ffd-af654260dccc req-1197b84d-4ca6-49f7-974c-fc44fad4cc9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.220816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3734456b-030e-435b-8ffd-af654260dccc req-1197b84d-4ca6-49f7-974c-fc44fad4cc9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.246647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:14.252450 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3734456b-030e-435b-8ffd-af654260dccc req-1197b84d-4ca6-49f7-974c-fc44fad4cc9d service nova] Creating event network-vif-plugged:36fd7931-5c26-4cf6-ba41-57e00cc54451 for instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 on nch1-master-1 Apr 09 21:09:14.253940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:14.256652 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-513f74f9-7ada-43d1-a0a2-d9cc306c7676 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.660048 Apr 09 21:09:14.267749 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3734456b-030e-435b-8ffd-af654260dccc req-1197b84d-4ca6-49f7-974c-fc44fad4cc9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084404 Apr 09 21:09:14.268987 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2131/4227] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:14.270455 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2097/4228] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:13 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:14.284716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:14.287661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:14.291574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:14.301589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:14.304833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:14.306418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.308813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.311983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.312151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.312553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.313143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.314193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.314844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.492059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:14.513692 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a20ed16-86ff-4016-8a5c-3da1977ee47b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 202 len: 0 microversion: 2.1 time: 0.237009 Apr 09 21:09:14.524679 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2098/4229] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:14 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:14.554850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:14.561627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] [instance: e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:14.587782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.588391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.593931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.594997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.612568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:14.630457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.635402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.646735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] HTTP exception thrown: Instance e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b could not be found. Apr 09 21:09:14.647381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] Returning 404 to user: Instance e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:14.656637 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24a5936c-daf7-4fe4-8d7a-eeb6c5cf5126 tempest-InstanceActionsNegativeTestJSON-1206770756 tempest-InstanceActionsNegativeTestJSON-1206770756-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b" status: 404 len: 111 microversion: 2.1 time: 0.118862 Apr 09 21:09:14.662783 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2099/4230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:14 2022] GET /compute/v2.1/servers/e8b226cd-00fc-4e8d-a7bb-457fcaab4c8b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:14.675098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:14.677534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:14.694418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.695293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.698882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.699589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.892059 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-13eedd7b-7fb2-420b-91b9-08071e66b6aa tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.619739 Apr 09 21:09:14.892668 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2132/4231] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Apr 9 21:09:14 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:14.902801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:14.904076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:14.915600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.916319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:14.917971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:14.918689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:15.149934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:15.159379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d963ec4-243a-42be-8b0e-0b9d082fab52 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1503 microversion: 2.1 time: 0.494866 Apr 09 21:09:15.161717 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2100/4232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:14 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1503 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:15.181495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:15.192486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:15.193653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.servers [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Removing options 'limit' from query {{(pid=141819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 09 21:09:15.198073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:15.209409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:15.212191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:15.213448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:15.218082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:15.298355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:15.312555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:15.313887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:15.352439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:15.360019 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9307b814-10d0-4355-bfd6-1e457ef0d657 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1321 microversion: 2.1 time: 0.465529 Apr 09 21:09:15.360605 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2133/4233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:14 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:15.374324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:15.375268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:15.393336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:15.394099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:15.395043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:15.395653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.139154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.157067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.158606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.167298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-77ed0ddb-14d6-42f1-994c-22576fff79ca tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 1.003758 Apr 09 21:09:16.169549 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2101/4234] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 21:09:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:16.180941 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38d130ad-04af-4600-a391-2ac9013ef08c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.807781 Apr 09 21:09:16.180941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2134/4235] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:15 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:16.188685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:16.189111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:16.189736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:16.197797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.198631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:16.204328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.204790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.207897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.208918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.215078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.216705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.221258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.228874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.296311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:16.346461 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f90c7322-f99a-426f-97ae-5a62e60065c9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.163090 Apr 09 21:09:16.354574 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2102/4236] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:16.360817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:16.365315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.366059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.servers [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Removing options 'limit' from query {{(pid=141819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 09 21:09:16.367058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:16.376067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.376832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.377896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.378543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.416079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:16.453061 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f3c9b3b-f431-4f8b-b790-bc42fbb854f9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.095505 Apr 09 21:09:16.457993 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2103/4237] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:16.463056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:16.465695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:16.477146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.481467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.482422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.482873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.776468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.784100 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83ab6832-9340-4412-b8d5-ce80574d9944 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1503 microversion: 2.1 time: 0.598756 Apr 09 21:09:16.790093 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2135/4238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1503 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:16.798749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:16.810877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:16.815322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:16.829794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.830877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.831843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:16.837679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:16.903555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:16.977395 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-537423d9-6f92-4e1e-a78c-b51414b919c0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.185671 Apr 09 21:09:16.980359 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2136/4239] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers => generated 1011 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:16.992849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:17.004661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:17.007272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:17.039183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.039795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.040679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.041217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.149270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:17.157638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f1f6afe-9d84-47a7-b841-fb2629e0f7c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1515 microversion: 2.1 time: 0.698460 Apr 09 21:09:17.162176 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2104/4240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1515 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:17.184951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:17.188258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:17.204353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.206287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.207309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.208049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.262229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:17.271213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'flavor' on Instance uuid b1e8348e-3b60-4836-b44b-12cb6b2094e9 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:17.384490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-762d46c1-8d6f-451c-89fe-76d808195521 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.397604 Apr 09 21:09:17.385120 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2137/4241] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:09:16 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:17.408622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:17.412995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:17.432593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.433069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.433869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.439182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.508172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3afbfc88-a68f-4bf5-948c-77cdf9ee3a9a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action" status: 200 len: 32 microversion: 2.1 time: 0.328398 Apr 09 21:09:17.515577 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2105/4242] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:17 2022] POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:09:17.522553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:17.527123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:17.528166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.servers [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Removing options 'limit' from query {{(pid=141819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 09 21:09:17.529619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:17.544696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.545444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.548513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.549950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.583386 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6692a91-e39c-46fc-a902-ebb4c5aa3b87 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.065809 Apr 09 21:09:17.592823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2106/4243] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:09:17 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:17.607622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:17.608526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:17.618283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.618733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:17.619530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:17.619952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.135509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:18.143891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:18.145233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:18.153515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d95a658d-b23d-4eab-817f-b5edeec24e0c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.761492 Apr 09 21:09:18.154679 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2138/4244] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:17 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:18.159511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:18.172849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:18.173841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-335450531', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:18.185234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:18.185964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.187022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:18.187635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.396910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:18.553711 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c2ddc16-8bab-4762-acc7-7b4f75f031be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-335450531" status: 200 len: 345 microversion: 2.1 time: 0.397684 Apr 09 21:09:18.563558 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2139/4245] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Apr 9 21:09:18 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-335450531 => generated 345 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:18.569590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:18.570663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:18.580594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:18.581620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.584575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:18.585502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.862218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:18.872530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-986aefea-265c-434c-bf25-304103d30e28 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 1.275356 Apr 09 21:09:18.878593 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2107/4246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:17 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:18.883477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9de65564-8a0b-47a7-95af-93ccccf52137 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:18.900894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de65564-8a0b-47a7-95af-93ccccf52137 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:18.901510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9de65564-8a0b-47a7-95af-93ccccf52137 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:18.949701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9de65564-8a0b-47a7-95af-93ccccf52137 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:09:19.012424 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9de65564-8a0b-47a7-95af-93ccccf52137 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "POST /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212/action" status: 202 len: 0 microversion: 2.1 time: 0.132300 Apr 09 21:09:19.013496 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2108/4247] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:18 2022] POST /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:19.023466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:19.025324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.035753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.036675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.038057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.043738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.048067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.053305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5ced276-a472-471b-abc8-2e48b535dcd1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.488208 Apr 09 21:09:19.065840 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2140/4248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:18 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:19.074399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:19.075310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.084154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.084882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.086076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.087333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.532557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.550073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b27719e-c43b-4670-b10d-5db7c647d331 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.524726 Apr 09 21:09:19.551283 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2109/4249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:19 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:19.564824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:19.565678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.574592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.575885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.577201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.578306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.754230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.764125 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3136d1a7-07f7-4cd7-bbce-757e6b026e5b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.695993 Apr 09 21:09:19.764803 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2141/4250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:19 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:19.782038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b3614be-cbec-4e60-a9c0-a7ffd076074e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:19.782876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b3614be-cbec-4e60-a9c0-a7ffd076074e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 3e49e77c-4459-45c4-896f-6943f7fcd582] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.790924 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5b3614be-cbec-4e60-a9c0-a7ffd076074e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 3e49e77c-4459-45c4-896f-6943f7fcd582 could not be found. Apr 09 21:09:19.791783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b3614be-cbec-4e60-a9c0-a7ffd076074e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 3e49e77c-4459-45c4-896f-6943f7fcd582 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:19.802399 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b3614be-cbec-4e60-a9c0-a7ffd076074e tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/3e49e77c-4459-45c4-896f-6943f7fcd582/action" status: 404 len: 111 microversion: 2.1 time: 0.024527 Apr 09 21:09:19.803576 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2142/4251] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:19 2022] POST /compute/v2.1/servers/3e49e77c-4459-45c4-896f-6943f7fcd582/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:09:19.811746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:19.812669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.822867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.825421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.828430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.828981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.903834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.913428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.921636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:19.927483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c7d720e-ddaf-4a39-a18b-38379e0150b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.372688 Apr 09 21:09:19.938731 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2110/4252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:19 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:19.944924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:19.945797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:19.958626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.960429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:19.962518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:19.965321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.344891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:20.359296 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d41deed-eb08-4d2c-a18a-58dc2b7d362c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.551447 Apr 09 21:09:20.359854 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2143/4253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:19 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:20.364524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f3261fae-99b6-4757-a5b0-514ecabf31f4 req-96a45500-9832-4b70-98d9-4afe4c78dfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "name": "network-vif-plugged", "status": "completed", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:20.371824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:20.383348 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c63c7a03-c92c-4a02-a236-41f2337d27db tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.443216 Apr 09 21:09:20.383965 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2111/4254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:19 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:20.398161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:20.407308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f3261fae-99b6-4757-a5b0-514ecabf31f4 req-96a45500-9832-4b70-98d9-4afe4c78dfe7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.408348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:20.408992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f3261fae-99b6-4757-a5b0-514ecabf31f4 req-96a45500-9832-4b70-98d9-4afe4c78dfe7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.426436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.427138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.428333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.433343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.461786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f3261fae-99b6-4757-a5b0-514ecabf31f4 req-96a45500-9832-4b70-98d9-4afe4c78dfe7 service nova] Creating event network-vif-plugged:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:09:20.476287 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f3261fae-99b6-4757-a5b0-514ecabf31f4 req-96a45500-9832-4b70-98d9-4afe4c78dfe7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115030 Apr 09 21:09:20.477789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2144/4255] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:20.568664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:20.569602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:20.585131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.585743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.586627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.587133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.882545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:20.890847 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-51bcf429-0ccd-41e6-a7ad-df61791b5797 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.496412 Apr 09 21:09:20.905297 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2112/4256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:20 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:20.911152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:20.912019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:20.918915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.919777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.921462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:20.922158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:20.980247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'unpause' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active Apr 09 21:09:20.980847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'unpause' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:20.981724 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1a24d50-7b28-49c5-9231-fbab87f83eae tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 145 microversion: 2.1 time: 0.074643 Apr 09 21:09:20.982289 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2113/4257] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:20 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:09:20.994944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:20.996454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:21.012007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.020371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3420aeaa-1dc0-4948-b140-bed7d4c6433f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.456108 Apr 09 21:09:21.022801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.023254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.023812 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2145/4258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:20 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:21.027199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.027642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.032902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:21.038004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:21.050729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.051621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.052723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.053583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.364761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.370041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.379045 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-09dc99aa-de11-4161-92b6-68878b7acec2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.353007 Apr 09 21:09:21.379619 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2146/4259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:21.397626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.401392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.402827 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-879b6116-d628-4d03-85d5-cbd3818b438c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1408 microversion: 2.20 time: 0.419053 Apr 09 21:09:21.403904 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2114/4260] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:20 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:21.417927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:21.419183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:21.427825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.429069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.429942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.430419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.662369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:21.673240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-201451632", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "660333df-1b10-4d62-a4d3-34a451d03428"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:21.688594 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a24529e3-5dbf-4a72-b992-e2e725f7daa2 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.281635 Apr 09 21:09:21.693717 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2115/4261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:21 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:21.710755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:21.713325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:21.724630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.725108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.746049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:21.749998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:21.777530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] validate_networks() for [('660333df-1b10-4d62-a4d3-34a451d03428', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:09:22.052580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:22.063442 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0bcd3738-031d-4b2b-af9d-cb7605f35e3a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.365483 Apr 09 21:09:22.064385 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2116/4262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:21 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:22.079837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7afc66ef-6d81-40df-a72f-de5eefad7ad9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:22.081512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7afc66ef-6d81-40df-a72f-de5eefad7ad9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: d32dde9b-40c2-4f9d-af9b-136f225d3265] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:22.087952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-7afc66ef-6d81-40df-a72f-de5eefad7ad9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance d32dde9b-40c2-4f9d-af9b-136f225d3265 could not be found. Apr 09 21:09:22.088882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7afc66ef-6d81-40df-a72f-de5eefad7ad9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance d32dde9b-40c2-4f9d-af9b-136f225d3265 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:22.090620 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7afc66ef-6d81-40df-a72f-de5eefad7ad9 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/d32dde9b-40c2-4f9d-af9b-136f225d3265/action" status: 404 len: 111 microversion: 2.1 time: 0.015833 Apr 09 21:09:22.091397 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2117/4263] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:22 2022] POST /compute/v2.1/servers/d32dde9b-40c2-4f9d-af9b-136f225d3265/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:22.100039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:22.100930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:22.108145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.109115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.110140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.110780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.437025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:22.445194 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-338521e4-ce0b-4d7d-b7e0-c1968b346a83 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.349338 Apr 09 21:09:22.445779 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2118/4264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:22 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:22.453725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:22.454334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:22.461759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.462216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.463856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.464467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.608947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:09:22.610487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:09:22.611195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:09:22.611920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:09:22.612547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:09:22.623536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.624499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.625694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.626351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.647007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Getting quotas for project 05f4a6d024fc4c758fe434c42500712f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:09:22.653340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Getting quotas for user 391775bcb52b46c58b0fb0957a4f9f40 and project 05f4a6d024fc4c758fe434c42500712f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:09:22.668479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:09:22.671350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:09:22.730318 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb14e559-b6ab-48ab-9b52-0d1be6d3a522 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346482 Apr 09 21:09:22.737560 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2147/4265] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:09:22.742665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:22.743355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:22.750574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.751422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.752430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:22.753111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:22.934375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:22.951082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1622c4e7-bd01-4080-b0b1-518cdc17c479 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.495108 Apr 09 21:09:22.961291 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2119/4266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:22 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:22.971896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6fdc88ea-151a-4448-b77d-e997bf641a9f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:22.972554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6fdc88ea-151a-4448-b77d-e997bf641a9f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.101353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6fdc88ea-151a-4448-b77d-e997bf641a9f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.108963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6fdc88ea-151a-4448-b77d-e997bf641a9f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1215 microversion: 2.1 time: 0.146312 Apr 09 21:09:23.109954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2120/4267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:22 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:23.114144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:23.114752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.116940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.126422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.132285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.133563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.134842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.135950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.136615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.137436 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a239398-2ffa-47bb-b61d-4cb4669b483e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1601 microversion: 2.20 time: 0.397520 Apr 09 21:09:23.140171 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2148/4268] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:22 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1601 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:23.147858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:23.148877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.157417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.158105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.159204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.159790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.457344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.465354 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3e8c2b3-449f-4328-a49d-17f9ae226a3f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.354695 Apr 09 21:09:23.489081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2121/4269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:23.489081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:23.489081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.503592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.504288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.507397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.509763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.525055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:23.536343 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9df38106-9324-4794-8e0a-bfdec0895197 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.393055 Apr 09 21:09:23.539537 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2149/4270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:23 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:23.544503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:23.551474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.559439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.561158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.570123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.571004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.774110 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e0663c2-2b75-4397-baf5-c26d16a09398 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.293805 Apr 09 21:09:23.783159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2122/4271] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:09:23 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-interface => generated 285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:09:23.790798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:23.791833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.807139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.808632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.809710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.813232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.868724 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Cannot 'unshelve' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active Apr 09 21:09:23.873063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 409 to user: Cannot 'unshelve' instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 while it is in vm_state active {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:23.874777 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1152f786-bbf9-41b2-a761-e4408fb8448f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action" status: 409 len: 146 microversion: 2.1 time: 0.089934 Apr 09 21:09:23.878512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2123/4272] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:23 2022] POST /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7/action => generated 146 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:09:23.889081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:23.890266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:23.914001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.914572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:23.916347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:23.916922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.001613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:24.020285 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-543ae807-931f-418a-8730-59275f7f33c1 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.479444 Apr 09 21:09:24.021241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2150/4273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:23 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:24.127471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:24.128611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:24.141867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.144498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.148034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.151106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.296264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:24.309176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:24.313689 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37ca36f8-1d88-46cb-8bab-542b6f9a53ae tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1267 microversion: 2.1 time: 0.190760 Apr 09 21:09:24.314625 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2151/4274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:24 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:24.316869 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c9919e4-1fe6-4ddc-a912-87a1b96b8606 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.431722 Apr 09 21:09:24.328325 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2124/4275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:23 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:24.346880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:24.347596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:24.355621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.357244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.358624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.359607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.556149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:24.556770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:24.590307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.594170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:24.597322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:24.602052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.650168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:25.662567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:25.665254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4bb56aad-7bd2-41f6-b3a9-209a9b41b632 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 1.113357 Apr 09 21:09:25.667324 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2125/4276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:24 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:25.673165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:25.674072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:25.675566 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-901cedbf-b4d9-42de-845d-bde706dba44f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 1.338161 Apr 09 21:09:25.676612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2152/4277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:24 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:25.681430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.682116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.682445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:25.683061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:25.683606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.684144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.696865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.698724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.700565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.704412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.885832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:25.907868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3280e549-7291-4238-8d6c-f591aff60391 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1273 microversion: 2.1 time: 0.227561 Apr 09 21:09:25.908544 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2153/4278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:25 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:25.921205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-329a5999-47de-43af-afb4-2a6a306a7f70 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2094478563_updated"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:25.922434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-329a5999-47de-43af-afb4-2a6a306a7f70 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: f224d26e-db27-43bd-aae3-dde8886ec68b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:25.934534 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-329a5999-47de-43af-afb4-2a6a306a7f70 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance f224d26e-db27-43bd-aae3-dde8886ec68b could not be found. Apr 09 21:09:25.935144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-329a5999-47de-43af-afb4-2a6a306a7f70 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance f224d26e-db27-43bd-aae3-dde8886ec68b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:25.935999 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-329a5999-47de-43af-afb4-2a6a306a7f70 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "PUT /compute/v2.1/servers/f224d26e-db27-43bd-aae3-dde8886ec68b" status: 404 len: 111 microversion: 2.1 time: 0.026472 Apr 09 21:09:25.936978 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2154/4279] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:09:25 2022] PUT /compute/v2.1/servers/f224d26e-db27-43bd-aae3-dde8886ec68b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:25.946087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:25.946700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:25.968066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.968526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:25.969357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:25.969804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:26.338785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:26.351863 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d71b8c06-8bd9-464f-8418-c7c4c10fd1e0 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.683129 Apr 09 21:09:26.352761 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2126/4280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:25 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:26.462437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:26.470350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03da8f4f-1173-446e-b4b1-0b258fbd220f tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.527998 Apr 09 21:09:26.471302 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2155/4281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:25 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:26.490366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:26.490994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:26.502761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:26.503214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:26.511447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:26.512171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:26.684391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:26.684999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:26.692333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:26.693090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:26.694043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:26.694669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.140508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:27.155926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75343548-4244-4146-8355-594b33b4168c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.671141 Apr 09 21:09:27.159549 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2127/4282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:26 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:27.173529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:27.174718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:27.192271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.194477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.196013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.197381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.255264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:27.265680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ccb236f-8047-4826-8e65-c7d916794968 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.585222 Apr 09 21:09:27.266520 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2156/4283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:26 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:27.283995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-890898a7-c81f-456c-95f8-1a4b3731fb07 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:27.287347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-890898a7-c81f-456c-95f8-1a4b3731fb07 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:27.288174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-890898a7-c81f-456c-95f8-1a4b3731fb07 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "PUT /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 400 len: 619 microversion: 2.1 time: 0.019837 Apr 09 21:09:27.288753 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2157/4284] 10.222.0.30 () {60 vars in 1256 bytes} [Sat Apr 9 21:09:27 2022] PUT /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:09:27.304949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:27.305656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:27.326892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.328081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.332145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.332884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.681644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:27.691139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8920485b-35db-4b34-96f6-9c07cb84dc99 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.396958 Apr 09 21:09:27.692495 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2158/4285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:27 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:27.708657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:27.709592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:27.716748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.717461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.718465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.719103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.789214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:27.802691 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc0cd098-6534-44ef-a37c-42296f0a298d tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.639684 Apr 09 21:09:27.803594 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2128/4286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:27 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:27.832257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:27.833913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:27.855663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.856848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:27.860194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:27.861571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:28.232214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:28.250459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9a70049-5391-4610-8de2-c8eee942df06 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.554776 Apr 09 21:09:28.264389 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2159/4287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:27 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:28.279917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-72fdb472-6687-4596-a9aa-744035c49e89 req-ba587407-7c6c-4c00-b1cc-eac9afa96ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:28.305629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-72fdb472-6687-4596-a9aa-744035c49e89 req-ba587407-7c6c-4c00-b1cc-eac9afa96ebe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:28.307381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-72fdb472-6687-4596-a9aa-744035c49e89 req-ba587407-7c6c-4c00-b1cc-eac9afa96ebe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:28.348533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-72fdb472-6687-4596-a9aa-744035c49e89 req-ba587407-7c6c-4c00-b1cc-eac9afa96ebe service nova] Creating event network-changed:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:09:28.365332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:28.369121 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-72fdb472-6687-4596-a9aa-744035c49e89 req-ba587407-7c6c-4c00-b1cc-eac9afa96ebe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093179 Apr 09 21:09:28.372433 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2160/4288] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:28.377475 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21648f97-337b-4c8b-9b82-b1367a7be232 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.561340 Apr 09 21:09:28.380152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2129/4289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:27 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:28.427143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4ccfa31-0cc7-46bc-a3d8-27ae6efbf85b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:28.427694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:28.428348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:28.430652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4ccfa31-0cc7-46bc-a3d8-27ae6efbf85b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:28.433826 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4ccfa31-0cc7-46bc-a3d8-27ae6efbf85b tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "PUT /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 400 len: 108 microversion: 2.1 time: 0.039366 Apr 09 21:09:28.439414 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2161/4290] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:09:28 2022] PUT /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:09:28.456146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:28.459600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:28.465556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:28.469557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:28.474522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:28.475789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:28.493366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:28.497609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:28.499753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:28.503360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:29.313922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:29.320504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:29.328584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72ee76e7-a0fb-4b76-a598-54c7caa67a2c tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1506 microversion: 2.1 time: 0.886081 Apr 09 21:09:29.330493 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-782f7a70-8f22-458c-821e-f718c3a408e7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.939260 Apr 09 21:09:29.331722 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2162/4291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:28 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:29.334105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2130/4292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:28 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:29.357921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:29.361995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:29.362616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:29.366419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:29.380067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:29.380520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:29.381415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:29.382837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:29.385104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:29.386416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:29.388176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:29.389251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:30.150889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:30.165141 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9924b37-c22b-4095-99d4-d5d4960ee717 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.824769 Apr 09 21:09:30.180162 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2131/4293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:29 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:30.207830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:30.221229 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6cbc1850-346b-4a8e-8f4a-a108ba19039a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.886047 Apr 09 21:09:30.222696 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2163/4294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:29 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:30.353312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:30.354277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:30.372188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:30.380136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:30.386090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:30.386641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:30.771704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-55e4fe12-d522-45cf-b92e-9dad86efd510 req-9b11c5bb-b1e4-4ca9-a4a9-41eb6ac41f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f567ca-fe77-4fda-a459-4a4378ca8cfe", "tag": "c84d0ae8-9567-4de2-a5cb-690c35219dbc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:30.790343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-55e4fe12-d522-45cf-b92e-9dad86efd510 req-9b11c5bb-b1e4-4ca9-a4a9-41eb6ac41f06 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:30.790867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-55e4fe12-d522-45cf-b92e-9dad86efd510 req-9b11c5bb-b1e4-4ca9-a4a9-41eb6ac41f06 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:30.813599 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-55e4fe12-d522-45cf-b92e-9dad86efd510 req-9b11c5bb-b1e4-4ca9-a4a9-41eb6ac41f06 service nova] Creating event network-changed:c84d0ae8-9567-4de2-a5cb-690c35219dbc for instance 26f567ca-fe77-4fda-a459-4a4378ca8cfe on nch2-master-1 Apr 09 21:09:30.826617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-55e4fe12-d522-45cf-b92e-9dad86efd510 req-9b11c5bb-b1e4-4ca9-a4a9-41eb6ac41f06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060641 Apr 09 21:09:30.828255 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2164/4295] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:30.846770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:30.858406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-86cda740-da49-4f17-89e3-054919e13997 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.513783 Apr 09 21:09:30.870162 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2132/4296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:30 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:31.184465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:31.185293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:31.198852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:31.211560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:31.212541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:31.213475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:31.239117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:31.240202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:31.252051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:31.254409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:31.269855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:31.273946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:31.935398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:31.953643 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48881b9b-df0a-4eaa-81d5-0b2e7b1da2cb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.765114 Apr 09 21:09:31.957243 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2165/4297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:31 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:31.983008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:31.988594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:31.990378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.003887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.004460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.005541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.006095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.007136 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-693b4292-c59b-4ee3-9d50-a0efe1d08c13 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.772458 Apr 09 21:09:32.016441 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2133/4298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:31 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:32.025000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:32.025800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.047731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.050413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.053136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.053757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.092221 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. Apr 09 21:09:32.093072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:32.094018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4ed60ee-e5e5-4720-8cca-b9b50ef9421a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 404 len: 111 microversion: 2.1 time: 0.076292 Apr 09 21:09:32.094852 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2134/4299] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:32 2022] DELETE /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:32.105533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:32.106154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: fe417324-1de0-45c0-876b-2032e5ce27da] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.134730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.135865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.136863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.137718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.161568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. Apr 09 21:09:32.162572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance fe417324-1de0-45c0-876b-2032e5ce27da could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:32.163608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78e7ba6a-7ba5-481b-bf01-7605e0a3cdd6 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da" status: 404 len: 111 microversion: 2.1 time: 0.064356 Apr 09 21:09:32.168142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2135/4300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:32 2022] GET /compute/v2.1/servers/fe417324-1de0-45c0-876b-2032e5ce27da => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:09:32.175016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:32.175840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.184689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.185373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.186517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.187105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.254246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:09:32.396991 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7e466bbd-89b1-4bdd-80ba-a1f6e637c7f1 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 204 len: 0 microversion: 2.1 time: 0.225695 Apr 09 21:09:32.398119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2136/4301] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:32 2022] DELETE /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:09:32.412399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:32.415041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.424535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.425238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.426345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.427919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.770992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:32.779680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b4dc88a-5de3-43eb-a391-5ea4ae36c437 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.806674 Apr 09 21:09:32.780312 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2166/4302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:31 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:32.840022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:32.864154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a20c2f8e-fe04-4df9-876b-1d4790f46578 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.460093 Apr 09 21:09:32.867371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2137/4303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:32 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:32.974568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:32.975241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:32.988485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.989464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:32.991726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:32.992185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.027002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:33.029633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:33.038199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.039490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.041378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.043164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.326967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:33.339645 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6a97f77d-72c3-4ab3-b12c-07a0041e14bf tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.369574 Apr 09 21:09:33.340242 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2167/4304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:32 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:33.423660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:33.431962 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ccc0d8f6-22d8-458b-a1d4-4312045e3c52 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.411713 Apr 09 21:09:33.450436 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2138/4305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:33 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:33.797296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:33.798172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:33.805632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.807665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.811525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.812230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.892409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:33.893825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:33.900838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.901275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:33.902970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:33.904403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:34.102557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:34.118421 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f6ca6973-5247-4186-aa36-6bfb45ce5af4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.325562 Apr 09 21:09:34.128659 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2168/4306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:33 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:34.198256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:34.208903 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c570f717-2a99-4c5e-9357-8af900cbe453 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.329718 Apr 09 21:09:34.211093 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2139/4307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:33 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:34.362136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:34.362754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:34.369393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:34.370021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:34.370802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:34.371412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:34.452286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:34.453674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:34.464792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:34.465621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:34.466800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:34.468292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:34.653018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:34.677072 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69751140-b92a-4254-a004-dbc6b5b974c3 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.322845 Apr 09 21:09:34.691653 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2169/4308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:34 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:34.783856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:34.796998 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eea7ba6e-b4ea-4ec7-be7e-27d56469f533 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.352916 Apr 09 21:09:34.810454 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2140/4309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:34 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:35.134849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:35.136000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:35.152943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.153769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.154761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.155428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.229078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:35.229734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:35.241353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.242013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.242935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.244220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.538166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:35.554552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-67dea522-f27c-4083-986b-e29a90b85756 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.423502 Apr 09 21:09:35.557283 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2170/4310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:35 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:35.611893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:35.625223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-29193809-4ffd-4777-a3fc-2b75cd495585 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.395553 Apr 09 21:09:35.626682 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2141/4311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:35 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:35.704948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:35.706874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:35.719581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.722659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.723523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.723977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.815914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:35.816681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:35.825065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.825526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:35.828427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:35.829582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:36.197705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:36.205473 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8bf0004a-8f62-4270-ad3c-5a3d895ebdf5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.393426 Apr 09 21:09:36.215850 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2142/4312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:35 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:36.226885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:36.240251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83017f9b-e15d-4230-aa9d-1f4684b64916 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.543318 Apr 09 21:09:36.252937 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2171/4313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:35 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:36.576787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:36.581668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:36.595445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:36.597904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:36.599455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:36.600945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:36.648145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:36.648777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:36.668556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:36.669013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:36.669883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:36.670325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:37.044458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:37.054648 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-afb8f4de-bdad-486b-b971-5dcba4d98b84 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.485080 Apr 09 21:09:37.057490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2143/4314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:36 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:37.112078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:37.122184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61bf0ea2-5201-47bb-99c6-6ecbdf8b2e1a tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1512 microversion: 2.1 time: 0.482984 Apr 09 21:09:37.141545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2172/4315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:36 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:37.228266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:37.229264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:37.241210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:37.242090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:37.243387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:37.244882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:37.258564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:37.259184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:37.295881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:37.296543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:37.300243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:37.301611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:37.736731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:37.749795 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e17d0dd-cb00-4f78-af79-5be75ccd534e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.525431 Apr 09 21:09:37.754655 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2144/4316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:37 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:37.772964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:37.782122 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c913323-c01a-4707-95df-7db09c504950 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.527358 Apr 09 21:09:37.782834 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2173/4317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:37 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:38.076693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:38.078115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:38.088658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.089643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.091151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.094512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.155129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:38.156200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:38.165212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.166593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.167868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.169000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.317861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdab30a578b947068144a0509c85eb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e27519c6c114724bf36126f0362a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:38.325775 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4ce36c6-718f-43f0-ad91-373d7e1125a7 tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 200 len: 1470 microversion: 2.1 time: 0.180854 Apr 09 21:09:38.329921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2174/4318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:38 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:38.351330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-69900922-45a7-46cb-9123-d27dc6bb0a34 req-b019df91-a3e5-4271-9f1c-b7eb4cb28690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2d8f3-9113-4bac-b1da-8e52381492d7", "name": "network-vif-deleted", "tag": "b89a1903-4bc6-4937-ab1c-08ead482d6d7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:38.375469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-69900922-45a7-46cb-9123-d27dc6bb0a34 req-b019df91-a3e5-4271-9f1c-b7eb4cb28690 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.375921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-69900922-45a7-46cb-9123-d27dc6bb0a34 req-b019df91-a3e5-4271-9f1c-b7eb4cb28690 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.411288 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-69900922-45a7-46cb-9123-d27dc6bb0a34 req-b019df91-a3e5-4271-9f1c-b7eb4cb28690 service nova] Creating event network-vif-deleted:b89a1903-4bc6-4937-ab1c-08ead482d6d7 for instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 on nch2-master-1 Apr 09 21:09:38.455969 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-69900922-45a7-46cb-9123-d27dc6bb0a34 req-b019df91-a3e5-4271-9f1c-b7eb4cb28690 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109930 Apr 09 21:09:38.464987 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2175/4319] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:09:38.472912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:38.485783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dab2304c-3933-40b9-bacf-7e73c324b2d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.415898 Apr 09 21:09:38.497284 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2145/4320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:38 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:38.776921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:38.789806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:38.801187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:38.801763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.801930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:38.802620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.803479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.812294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.828466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.829822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:38.834832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:38.854709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:39.265122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:39.284904 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e2f7282-3831-4f35-a9fe-b093a822ee87 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.519380 Apr 09 21:09:39.285632 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2176/4321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:38 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:39.305370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Action: 'create', calling method: .version_select at 0x7fb08ded5280>, body: {"keypair": {"name": "tempest-keypair-1908874820"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:39.332459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:39.341198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-83cbf63c-2950-4246-8f77-b73563d4d0c2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1522 microversion: 2.1 time: 0.545606 Apr 09 21:09:39.345170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2146/4322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:38 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:39.366954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:39.367653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] [instance: 66c2d8f3-9113-4bac-b1da-8e52381492d7] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:39.385473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:39.386339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:39.387322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:39.389020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:39.404590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:09:39.412089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] HTTP exception thrown: Instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 could not be found. Apr 09 21:09:39.412959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] Returning 404 to user: Instance 66c2d8f3-9113-4bac-b1da-8e52381492d7 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:39.413996 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a0a6748-e4a2-41ea-8892-e9f0bb78f20d tempest-ServersNegativeTestJSON-1285629641 tempest-ServersNegativeTestJSON-1285629641-project] 10.222.0.30 "GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7" status: 404 len: 111 microversion: 2.1 time: 0.067848 Apr 09 21:09:39.414751 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2147/4323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:39 2022] GET /compute/v2.1/servers/66c2d8f3-9113-4bac-b1da-8e52381492d7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:39.421567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for user e2b92cb8d21d42eea56146d7935a74e8 and project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:09:39.503532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:39.504458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:39.518501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:39.520678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:39.524281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:39.524908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:39.734167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:09:39.740201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for user e2b92cb8d21d42eea56146d7935a74e8 and project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:09:39.767386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a7cd8cd-f505-42b2-8fba-f454435092ae tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.471732 Apr 09 21:09:39.768183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2177/4324] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 21:09:39 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 482 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:09:40.301558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:40.302038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:40.316428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.316969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:40.317978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.318445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:40.417749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:40.439372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f25d127-e6f4-48dc-a83d-71296a78f49e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.938244 Apr 09 21:09:40.441902 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2148/4325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:39 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:40.456057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:40.457818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:40.469488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.470461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:40.473508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.475877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:40.802002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:40.813625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f066b88f-2e5f-41ce-b3d8-0b0d2c35bfd5 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.516014 Apr 09 21:09:40.814834 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2178/4326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:40 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:40.928437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:40.941591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85bae032-e1e4-4980-bd4d-8906e3abf42a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1499 microversion: 2.1 time: 0.498304 Apr 09 21:09:40.957095 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2149/4327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:40 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1499 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:40.963281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:40.966824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:40.967716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:40.974016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.974471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:40.975373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:40.975809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.079292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:41.155389 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1731023c-f192-4a46-8cdb-e597958d4b34 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.193756 Apr 09 21:09:41.161244 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2179/4328] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Apr 9 21:09:40 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:41.169400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c605f00f-9d69-4172-894e-6087da4487b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:41.178153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c605f00f-9d69-4172-894e-6087da4487b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.178542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c605f00f-9d69-4172-894e-6087da4487b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.218461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c605f00f-9d69-4172-894e-6087da4487b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Going to try to start instance {{(pid=141819) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:09:41.299661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c605f00f-9d69-4172-894e-6087da4487b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "POST /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212/action" status: 202 len: 0 microversion: 2.1 time: 0.133599 Apr 09 21:09:41.300534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2150/4329] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:41 2022] POST /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:41.309187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:41.309801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:41.318122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.319193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.320824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.321568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.460977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:41.462325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:41.471560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.472303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.473315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.473920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.721587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:41.733497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e0e3259-89bb-4d12-ba9e-df823c4b84df tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1508 microversion: 2.1 time: 0.428607 Apr 09 21:09:41.746257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2180/4330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:41 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:41.830481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:41.831111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:41.848252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.848252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.848252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:41.848252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:41.848757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:41.858451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2ea68550-e856-4694-a952-c1b6143a2626 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.402579 Apr 09 21:09:41.878740 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2151/4331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:41 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:42.190577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:42.203255 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb3aaa9a-b151-493d-a00e-b0ed8f47bfba tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.377025 Apr 09 21:09:42.204416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2181/4332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:41 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:42.247344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-609bd390-1516-4669-ba38-c8fc9cfcd278 req-9d0860cd-225a-421c-a7d2-354bc7cbf6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f567ca-fe77-4fda-a459-4a4378ca8cfe", "name": "network-vif-plugged", "status": "completed", "tag": "c84d0ae8-9567-4de2-a5cb-690c35219dbc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:42.265423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-609bd390-1516-4669-ba38-c8fc9cfcd278 req-9d0860cd-225a-421c-a7d2-354bc7cbf6e6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:42.266662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-609bd390-1516-4669-ba38-c8fc9cfcd278 req-9d0860cd-225a-421c-a7d2-354bc7cbf6e6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:42.310417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-609bd390-1516-4669-ba38-c8fc9cfcd278 req-9d0860cd-225a-421c-a7d2-354bc7cbf6e6 service nova] Creating event network-vif-plugged:c84d0ae8-9567-4de2-a5cb-690c35219dbc for instance 26f567ca-fe77-4fda-a459-4a4378ca8cfe on nch2-master-1 Apr 09 21:09:42.323056 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-609bd390-1516-4669-ba38-c8fc9cfcd278 req-9d0860cd-225a-421c-a7d2-354bc7cbf6e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080230 Apr 09 21:09:42.327190 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2152/4333] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:42.754124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:42.754977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:42.765933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:42.766616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:42.767687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:42.768634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:42.880302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:42.881012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:42.892186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:42.894520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:42.896674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:42.898846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:42.966424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:42.984509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30e3a3de-1d3f-4fa5-9d03-85dd37a5f876 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1508 microversion: 2.1 time: 0.236581 Apr 09 21:09:42.997266 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2182/4334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:42 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:43.131369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:43.140372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84e33969-b267-48b4-bd51-622443c4a7ba tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.263933 Apr 09 21:09:43.151342 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2153/4335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:42 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:43.157830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1257415908", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dafc1150-436f-41e7-82bb-1b35d2c0352e"}, {"port": "d2e847f7-3df6-4159-af29-b43d77f7ab51", "tag": "port-1"}, {"port": "a3ce64ea-7c59-485a-8f4b-e040ea24b0b0", "tag": "port-2"}, {"uuid": "92519850-eedc-4d89-a26d-ad4b1c086541", "tag": "net-1"}, {"uuid": "92519850-eedc-4d89-a26d-ad4b1c086541"}, {"uuid": "f6f98062-6e39-47e6-ab8a-083f21750bda", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f6f98062-6e39-47e6-ab8a-083f21750bda", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bbcf93e0-b776-46ad-9196-c4638c713502", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b029c091-ed41-4629-909c-273feb0867db", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "62419bbe-a53e-46ce-b201-23fb7182945c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--564426031"}], "key_name": "tempest-keypair-1908874820", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:43.283305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Calling method '.version_select at 0x7fb08e1a3550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.283774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] validate_networks() for [('dafc1150-436f-41e7-82bb-1b35d2c0352e', None, None, None, None, None), (None, None, 'd2e847f7-3df6-4159-af29-b43d77f7ab51', None, None, None), (None, None, 'a3ce64ea-7c59-485a-8f4b-e040ea24b0b0', None, None, None), ('92519850-eedc-4d89-a26d-ad4b1c086541', None, None, None, None, None), ('92519850-eedc-4d89-a26d-ad4b1c086541', None, None, None, None, None), ('f6f98062-6e39-47e6-ab8a-083f21750bda', '10.2.2.100', None, None, None, None), ('f6f98062-6e39-47e6-ab8a-083f21750bda', '10.2.2.200', None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:09:43.284259 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:09:43.284259 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:09:43.285792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:43.286472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:43.303810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:43.304267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:43.322105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:43.322602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:43.330011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-946a5837-b98f-4f2c-aaf0-034559e6e77b tempest-PortsAdminExtendedAttrsTestJSON-1196769380 tempest-PortsAdminExtendedAttrsTestJSON-1196769380-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.331397 Apr 09 21:09:43.331571 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2183/4336] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:09:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:43.337901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.338991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:43.347960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:43.348420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:43.349231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:43.349901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:43.681457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:43.694123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1315 microversion: 2.1 time: 0.360821 Apr 09 21:09:43.695109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2184/4337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:43 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:43.696615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.698014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001493 Apr 09 21:09:43.698987 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2185/4338] 10.222.0.30 () {56 vars in 885 bytes} [Sat Apr 9 21:09:43 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 09 21:09:43.708781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.712391 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002481 Apr 09 21:09:43.713143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2186/4339] 10.222.0.30 () {54 vars in 1034 bytes} [Sat Apr 9 21:09:43 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Apr 09 21:09:43.719263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.720242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001369 Apr 09 21:09:43.720791 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2187/4340] 10.222.0.30 () {54 vars in 1040 bytes} [Sat Apr 9 21:09:43 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:09:43.728773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:43.730533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8a593115-ad66-4f48-b41d-12cfbacc3f3f tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002700 Apr 09 21:09:43.731700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2188/4341] 10.222.0.30 () {56 vars in 885 bytes} [Sat Apr 9 21:09:43 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 09 21:09:44.005371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:44.006215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:44.020944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.022240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.024589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.025500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.353176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:44.360854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6dc78261-b68b-45ec-9f58-31ed711d9b12 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1512 microversion: 2.1 time: 0.359448 Apr 09 21:09:44.361473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2189/4342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:44 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:44.372539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:44.373454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:44.380485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.381016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.382104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.382636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.704756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:44.713068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31140432-0fd4-4701-9f25-33730b64bba4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.350389 Apr 09 21:09:44.713772 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2190/4343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:44 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:44.718544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:44.722612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:44.723336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.servers [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Removing options 'limit' from query {{(pid=141818) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 09 21:09:44.724206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:44.725525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.726207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.727229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.727895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.729617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1eeee7d0-215d-465e-9d69-7dd973f6446f tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.014719 Apr 09 21:09:44.730442 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2191/4344] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:09:44 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:09:44.735109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:44.735901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:44.742345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.742803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:44.743587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:44.744030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.146188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:45.155221 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7370a460-08a2-409b-ba04-53a1303b0aa6 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1503 microversion: 2.1 time: 0.423449 Apr 09 21:09:45.155884 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2192/4345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:44 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:45.160959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:45.161801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:45.172030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.172552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.173636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.174255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.532078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:45.542078 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c25f06f-5331-420f-b98c-688e4e7d336c tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1512 microversion: 2.1 time: 0.384624 Apr 09 21:09:45.542966 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2193/4346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:45 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:45.571581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:45.572154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:45.580709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.581629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.582864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.583523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.685868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01704002-3260-40d2-9ea9-f83acf70985e tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.130856 Apr 09 21:09:45.687629 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2194/4347] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Apr 9 21:09:45 2022] DELETE /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe/os-server-password => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:09:45.692765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:45.693409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:45.700315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.700886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:45.701938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:45.702433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.357957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:46.369581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a85d7fbd-cbc1-4955-841a-cab27c160e0b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1512 microversion: 2.1 time: 0.680819 Apr 09 21:09:46.370324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2195/4348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:45 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:46.377058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:46.378411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:46.387494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.388537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.389779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.390718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.425419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed2e8245-b79a-4bcd-b013-10138879aec8 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053916 Apr 09 21:09:46.426576 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2196/4349] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:09:46 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe/os-server-password => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:09:46.431354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:46.432239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:46.438385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.439148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.440268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.440980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.784301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:46.796284 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d48cf490-010b-411e-bb7f-cee9791a27b4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1521 microversion: 2.1 time: 0.368282 Apr 09 21:09:46.797538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2197/4350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:46 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:46.815283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:46.816265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:46.822872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.824063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:46.826174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:46.826679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.212695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:47.223153 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f90ffa61-edcc-45a5-8138-e9e1bfc48fcb tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1513 microversion: 2.1 time: 0.424170 Apr 09 21:09:47.223825 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2198/4351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:46 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:47.229096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:47.230843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:47.237295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.238013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.239621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.240949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.270737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:09:47.380622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7041da3-8b79-43f3-9c05-2e898809f227 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 204 len: 0 microversion: 2.1 time: 0.155078 Apr 09 21:09:47.381349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2199/4352] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:47 2022] DELETE /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:09:47.386506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:47.391068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:47.392178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:47.674110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.675086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.677670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.678360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.817515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:47.899968 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b10215f1-ce4a-4b22-adf4-2c9c690d22dc tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.517314 Apr 09 21:09:47.908046 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2200/4353] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Apr 9 21:09:47 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:47.914259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:47.915007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:47.923823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.924311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:47.925171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:47.925622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:48.426774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:48.444621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-200c3f0b-5319-4095-9b42-457c07cfcecd tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1509 microversion: 2.1 time: 0.535164 Apr 09 21:09:48.445476 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2201/4354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:47 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:48.450993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:48.451806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:48.461490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:48.462365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:48.463387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:48.463990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:48.627927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:09:48.628996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:09:48.629503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:09:48.629897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:09:48.631689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:09:48.639706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:48.640347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:48.641333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:48.641916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:48.662564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:09:48.669680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Getting quotas for user e2b92cb8d21d42eea56146d7935a74e8 and project 60eee2c55ed842f78ac0fa9e1b400fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:09:48.934842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:09:48.938556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bbcf93e0-b776-46ad-9196-c4638c713502',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b029c091-ed41-4629-909c-273feb0867db',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62419bbe-a53e-46ce-b201-23fb7182945c',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:09:49.331003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:49.338551 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b9cd37a8-6146-43e7-9a73-e8dd9b9c1cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1501 microversion: 2.1 time: 0.891812 Apr 09 21:09:49.340992 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2202/4355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:48 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1501 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:49.351608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:49.352584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:49.371218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:49.371674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:49.372474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:49.372963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:49.406603 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.253545 Apr 09 21:09:49.407833 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2154/4356] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Apr 9 21:09:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 6256 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:09:49.414957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:49.415930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:49.423435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:49.424760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:49.425827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:49.426687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.011549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.020375 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-143bee19-b4fe-4d28-9e57-7461e65b5da6 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1512 microversion: 2.1 time: 0.677467 Apr 09 21:09:50.021316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2203/4357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:49 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1512 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:50.037620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:50.038592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.083616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.102284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87167a6a-e62d-4ad9-a6f5-b4d16482619b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1517 microversion: 2.1 time: 0.691661 Apr 09 21:09:50.103336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2155/4358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:49 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1517 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:50.109700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:50.110874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.119155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.120111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.121520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.122319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.309300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.325409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.332282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.335941 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14d1d17e-3297-4c9e-8494-933836625650 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1286 microversion: 2.42 time: 0.302858 Apr 09 21:09:50.336599 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2204/4359] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:50 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1286 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:50.348383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:50.351327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.369167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.369849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.371804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.391942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.760412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.768089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad2b514f-b034-4bfc-9160-c231d3e80a10 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1509 microversion: 2.1 time: 0.663250 Apr 09 21:09:50.769879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2156/4360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:50 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1509 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:50.777846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9831ac4-d9f1-47d7-abe7-70404c088d2c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:50.779191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9831ac4-d9f1-47d7-abe7-70404c088d2c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 139b3ee7-0384-45d3-853b-2bbd3cb8b40a] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.787458 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f9831ac4-d9f1-47d7-abe7-70404c088d2c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Instance 139b3ee7-0384-45d3-853b-2bbd3cb8b40a could not be found. Apr 09 21:09:50.788112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9831ac4-d9f1-47d7-abe7-70404c088d2c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 404 to user: Instance 139b3ee7-0384-45d3-853b-2bbd3cb8b40a could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:50.788953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9831ac4-d9f1-47d7-abe7-70404c088d2c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/139b3ee7-0384-45d3-853b-2bbd3cb8b40a/action" status: 404 len: 111 microversion: 2.1 time: 0.017795 Apr 09 21:09:50.790792 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2157/4361] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:50 2022] POST /compute/v2.1/servers/139b3ee7-0384-45d3-853b-2bbd3cb8b40a/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:50.812266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:50.813211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.899309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:50.912320 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-554b9fba-63c4-4ee9-b012-ba6b0c03a87b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1512 microversion: 2.1 time: 0.573812 Apr 09 21:09:50.914173 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2205/4362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:50 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:50.936497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:50.939838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:50.951928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.955182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:50.956199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:50.956644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.179032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.179671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.180640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.181224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.255864 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3db8d1d2-cd32-4ef2-ab09-62fea4245880 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.448026 Apr 09 21:09:51.257437 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2158/4363] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:50 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:51.267593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:51.268569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:51.277991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.278894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.281577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.282174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.587283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.603075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45d7a9f8-144b-4c9a-a9f6-a7f6bbaf7825 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1513 microversion: 2.1 time: 0.675925 Apr 09 21:09:51.604138 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2206/4364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:50 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1513 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:51.611110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d6366219-344d-40c4-96e2-6ed9db011ff9 req-4e697c1b-e987-48fa-96f8-3c0a1fd6754b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f567ca-fe77-4fda-a459-4a4378ca8cfe", "name": "network-vif-deleted", "tag": "c84d0ae8-9567-4de2-a5cb-690c35219dbc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:51.622463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d6366219-344d-40c4-96e2-6ed9db011ff9 req-4e697c1b-e987-48fa-96f8-3c0a1fd6754b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.623350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d6366219-344d-40c4-96e2-6ed9db011ff9 req-4e697c1b-e987-48fa-96f8-3c0a1fd6754b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.643311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d6366219-344d-40c4-96e2-6ed9db011ff9 req-4e697c1b-e987-48fa-96f8-3c0a1fd6754b service nova] Creating event network-vif-deleted:c84d0ae8-9567-4de2-a5cb-690c35219dbc for instance 26f567ca-fe77-4fda-a459-4a4378ca8cfe on nch2-master-1 Apr 09 21:09:51.650066 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d6366219-344d-40c4-96e2-6ed9db011ff9 req-4e697c1b-e987-48fa-96f8-3c0a1fd6754b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043277 Apr 09 21:09:51.651040 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2207/4365] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:51.658145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:51.661005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:51.668851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.669726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.670719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.671482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.690695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.707778 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24df8e78-db55-44a0-a08e-bc90eb1cc518 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1522 microversion: 2.1 time: 0.445183 Apr 09 21:09:51.708378 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2159/4366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:51 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:51.724297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:51.727857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.728950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:51.745142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.745608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.746434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.746880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.784802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:51.820088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.840648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.846842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.853311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:51.855707 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59ba2a83-1d63-430c-a214-15cc0b54666f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1576 microversion: 2.42 time: 0.202096 Apr 09 21:09:51.856484 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2208/4367] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:51 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:51.868025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:51.870788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.871830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.871975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:51.908107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.909925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.912282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.915400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.975376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:51.976219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:51.978476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lazy-loading 'fault' on Instance uuid 26f567ca-fe77-4fda-a459-4a4378ca8cfe {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:52.494771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391775bcb52b46c58b0fb0957a4f9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f4a6d024fc4c758fe434c42500712f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:52.516770 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f01c55d2-d9aa-41e2-9cb8-3a8040c7f58a tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 200 len: 1305 microversion: 2.1 time: 0.657787 Apr 09 21:09:52.517883 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2209/4368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:51 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 1305 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:52.725827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:52.727157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:52.733596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:52.734297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:52.735270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:52.735877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:52.805148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05434a4e-1bf8-4c12-a030-87f460d6af3b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 1.092852 Apr 09 21:09:52.806391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2160/4369] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:09:51 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:52.831064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:52.839564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:52.840535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:53.112729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.113222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.114062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.114508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.268378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.277481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:53.278935 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-967093a3-e646-427d-b5e3-248c881f8228 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1502 microversion: 2.1 time: 0.557344 Apr 09 21:09:53.286730 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2210/4370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:52 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1502 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:53.292852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:53.293789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:53.314094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.314905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.315918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.316576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.409623 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34e8d671-bcfd-4d59-b367-e9fae5882afd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.588855 Apr 09 21:09:53.411596 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2161/4371] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Apr 9 21:09:52 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:53.417004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:53.418224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:53.426651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.427180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.428250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.428526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.485573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'flavor' on Instance uuid 5c5c2a8d-465a-4048-b5dc-68d900a9879b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:53.515381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Cannot 'rescue' instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b while it is in vm_state paused Apr 09 21:09:53.516614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 409 to user: Cannot 'rescue' instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b while it is in vm_state paused {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:53.517652 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f38264ec-f32f-4b4c-8bc9-70df41a6e80c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action" status: 409 len: 144 microversion: 2.1 time: 0.105015 Apr 09 21:09:53.522003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2162/4372] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:53 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action => generated 144 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:09:53.526885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:53.533069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.533830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:53.541208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.541763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.543588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.544073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.564548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.574138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.588621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.594622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4e33a1a-c4b2-4100-b573-8976bbe9379b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1594 microversion: 2.42 time: 0.306479 Apr 09 21:09:53.595411 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2211/4373] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:53 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1594 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:53.600606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:53.603338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:53.616716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.618808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.621940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.622571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.665643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:53.729685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e57cb1fa-2e9a-4ad2-805b-c525d23610be tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.209296 Apr 09 21:09:53.730318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2163/4374] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Apr 9 21:09:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:53.735874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:53.736572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] [instance: 26f567ca-fe77-4fda-a459-4a4378ca8cfe] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:53.743703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.744261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.745433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.745946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.762398 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1d9755d-85d4-472b-9ccc-9546858cab0c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.165541 Apr 09 21:09:53.763366 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] HTTP exception thrown: Instance 26f567ca-fe77-4fda-a459-4a4378ca8cfe could not be found. Apr 09 21:09:53.763938 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2212/4375] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:53 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:09:53.764504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] Returning 404 to user: Instance 26f567ca-fe77-4fda-a459-4a4378ca8cfe could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:09:53.766592 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4154a4bd-10ec-4288-8a1d-f76dc9704982 tempest-ServerPasswordTestJSON-1771715526 tempest-ServerPasswordTestJSON-1771715526-project] 10.222.0.30 "GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe" status: 404 len: 111 microversion: 2.1 time: 0.034769 Apr 09 21:09:53.769502 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2164/4376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:53 2022] GET /compute/v2.1/servers/26f567ca-fe77-4fda-a459-4a4378ca8cfe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:09:53.773575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:53.777691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:53.778770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:53.787916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.790066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.791204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.791479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:53.792371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:53.793095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.813626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.814819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:53.815890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:53.816567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.192196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:54.202733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea6472ba-39f0-4328-98fd-53ff785c455f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1509 microversion: 2.1 time: 0.430414 Apr 09 21:09:54.209890 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2165/4377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:53 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:54.477125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:54.567767 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e921c4ab-a755-4572-afe0-4ea230e86806 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.801834 Apr 09 21:09:54.574678 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2213/4378] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Apr 9 21:09:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:54.579321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:54.584001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:54.584249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': '-335450531', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:54.599437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.599903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.600770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.601171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.614229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:54.614965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:54.635027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.635027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.638225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.638676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.771318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:54.876416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f48445a-f4da-4efc-84fa-65f22582736b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-335450531" status: 200 len: 345 microversion: 2.1 time: 0.300900 Apr 09 21:09:54.884245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2166/4379] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Apr 9 21:09:54 2022] GET /compute/v2.1/servers?name=-335450531 => generated 345 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:54.891863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:54.896224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:54.896891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:54.902316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.902770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.903618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:54.904968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:54.987436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:55.001742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:55.003601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:55.005047 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5102844-9c0f-46ed-b278-4bbd0ae7c4e0 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1661 microversion: 2.42 time: 0.394928 Apr 09 21:09:55.006439 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2214/4380] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:54 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1661 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:09:55.016901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:55.119345 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1639c0d2-015c-445a-a429-d13ddd880866 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.233194 Apr 09 21:09:55.126421 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2167/4381] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Apr 9 21:09:54 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:55.132489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:55.138211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:55.141475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-33545053', 'deleted': False, 'project_id': '78452efb7ef143efa0123d3bc4873b53'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:09:55.155169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.156835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.159229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.160472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.227116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:55.227736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:55.236164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.236618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.237448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.237867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.348213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:09:55.487885 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93ae3de0-2099-4b4a-9b8f-4a1ccd1f3083 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-33545053" status: 200 len: 345 microversion: 2.1 time: 0.360373 Apr 09 21:09:55.490303 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2215/4382] 10.222.0.30 () {58 vars in 1225 bytes} [Sat Apr 9 21:09:55 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-33545053 => generated 345 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:09:55.502105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:55.502816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:55.517278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.517884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.519528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.522131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.571312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:09:55.740638 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da06dde7-b7ea-4395-8ff9-fa8fbe63b3da tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 204 len: 0 microversion: 2.1 time: 0.243595 Apr 09 21:09:55.741512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2216/4383] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:09:55 2022] DELETE /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:09:55.753986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:55.756740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:55.768083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.768636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:55.769856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:55.771080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:56.079913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:56.095377 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-686fb027-0a22-4d2d-ba83-7d2ee11fbe33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1517 microversion: 2.1 time: 0.869202 Apr 09 21:09:56.098080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2168/4384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:55 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1517 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:56.108835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:56.112500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:56.128623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:56.131012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:56.133885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:56.136241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:56.836141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:56.863963 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee5a592e-9ee9-4999-ac12-a6334f183c43 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1519 microversion: 2.1 time: 1.114601 Apr 09 21:09:56.865347 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2217/4385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:55 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1519 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:57.124217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:57.156284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:57.165537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:57.167187 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53302a56-1fd9-46e6-bd29-cc3f1e8cff02 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1707 microversion: 2.42 time: 1.067657 Apr 09 21:09:57.179317 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2169/4386] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:56 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1707 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:57.756572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:57.758011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:57.771117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:57.771791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:57.772786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:57.779518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:57.830885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'flavor' on Instance uuid 5c5c2a8d-465a-4048-b5dc-68d900a9879b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:57.883306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:57.883939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:57.892500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:57.896404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:57.897763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:57.898365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.028138 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0ee725d-0774-4ebf-b79c-3a70718c779a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action" status: 200 len: 32 microversion: 2.1 time: 0.275678 Apr 09 21:09:58.047839 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2218/4387] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:09:57 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action => generated 32 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:09:58.080494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:58.082149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:58.103023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:58.106240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.107881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:58.108579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.230437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:58.238328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4107077a-fcd3-4d50-bed7-1e3a11b725b9 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1519 microversion: 2.1 time: 0.358821 Apr 09 21:09:58.245403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2170/4388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:57 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:09:58.250473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:58.251099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:58.267644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:58.268104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.269148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:58.269763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.819694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:58.821715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:58.832659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:58.834238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:58.840218 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8aa2d1d5-8f72-4001-9e15-4e7d78f1d3cf tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1695 microversion: 2.42 time: 0.593629 Apr 09 21:09:58.840423 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e41556d-05a7-4c5d-8c08-cd18493623f3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.790028 Apr 09 21:09:58.842449 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2219/4389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:58 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:58.854308 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2171/4390] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:58 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1695 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:09:58.862082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-60971b65-38bc-4795-a493-2c49be3239ab req-e01b831a-939b-477e-b04d-11f223eff8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9935d3-690d-491f-bdc0-54c1af4a0627", "name": "network-vif-deleted", "tag": "d7f56580-7bb2-4c4f-8b27-f07713dc360b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:09:58.871543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-60971b65-38bc-4795-a493-2c49be3239ab req-e01b831a-939b-477e-b04d-11f223eff8ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:58.871992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-60971b65-38bc-4795-a493-2c49be3239ab req-e01b831a-939b-477e-b04d-11f223eff8ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:58.903754 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-60971b65-38bc-4795-a493-2c49be3239ab req-e01b831a-939b-477e-b04d-11f223eff8ea service nova] Creating event network-vif-deleted:d7f56580-7bb2-4c4f-8b27-f07713dc360b for instance ff9935d3-690d-491f-bdc0-54c1af4a0627 on nch2-master-1 Apr 09 21:09:58.916065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-60971b65-38bc-4795-a493-2c49be3239ab req-e01b831a-939b-477e-b04d-11f223eff8ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071399 Apr 09 21:09:58.918403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2172/4391] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:59.122655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-984efae0-100c-4d5e-beb6-ca8f57146198 tempest-ExtensionsTest-1136670964 tempest-ExtensionsTest-1136670964-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:59.130523 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-984efae0-100c-4d5e-beb6-ca8f57146198 tempest-ExtensionsTest-1136670964 tempest-ExtensionsTest-1136670964-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.270367 Apr 09 21:09:59.139376 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2220/4392] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Apr 9 21:09:58 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:09:59.145972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-19ffdd5d-dab9-4335-bc5b-0388790f341f tempest-ExtensionsTest-1136670964 tempest-ExtensionsTest-1136670964-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:59.148189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-19ffdd5d-dab9-4335-bc5b-0388790f341f tempest-ExtensionsTest-1136670964 tempest-ExtensionsTest-1136670964-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007727 Apr 09 21:09:59.148879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2173/4393] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Apr 9 21:09:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:09:59.258105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:59.258781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:59.274108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.277925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.286097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.291989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.468469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.478378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.479225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lazy-loading 'fault' on Instance uuid ff9935d3-690d-491f-bdc0-54c1af4a0627 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:09:59.878982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:59.880719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:59.888484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:09:59.901978 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-940a8d0c-a761-47d5-9380-215fe3ef86fd tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 200 len: 1311 microversion: 2.1 time: 0.648606 Apr 09 21:09:59.909993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2221/4394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:59 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 1311 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:09:59.918743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.926115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.927562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.928545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.931965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:09:59.932773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:09:59.966003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.966580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:09:59.970754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:09:59.971223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:00.461070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:00.477406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:00.478184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:00.480234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:00.486622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c907ded-bfc5-42be-8f65-885336c80fe8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1741 microversion: 2.42 time: 0.616985 Apr 09 21:10:00.489357 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2174/4395] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:09:59 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1741 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:00.503667 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-972bd434-a609-4348-87e0-9fd570d56adf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.591903 Apr 09 21:10:00.505529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2222/4396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:09:59 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:00.928889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:00.930072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: ff9935d3-690d-491f-bdc0-54c1af4a0627] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:00.949836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:00.951736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:00.953984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:00.955159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:00.990400 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] HTTP exception thrown: Instance ff9935d3-690d-491f-bdc0-54c1af4a0627 could not be found. Apr 09 21:10:00.992651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Returning 404 to user: Instance ff9935d3-690d-491f-bdc0-54c1af4a0627 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:10:01.021148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2dc7965-81e4-4caa-a5b0-dff625b7a8db tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627" status: 404 len: 111 microversion: 2.1 time: 0.070256 Apr 09 21:10:01.024560 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2175/4397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:00 2022] GET /compute/v2.1/servers/ff9935d3-690d-491f-bdc0-54c1af4a0627 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:10:01.035099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:01.036132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:01.054138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.055377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.059026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.060128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.115584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:10:01.321327 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07e589cb-040a-4fde-93ab-1d1001a6fe7d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 204 len: 0 microversion: 2.1 time: 0.292211 Apr 09 21:10:01.322656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2223/4398] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:10:01 2022] DELETE /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:10:01.330867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:01.331491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:01.342975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.343448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.350684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.351419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.714695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:01.725659 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4954c51a-4de3-40f4-9eb1-2150593cbf16 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1518 microversion: 2.1 time: 0.398958 Apr 09 21:10:01.730192 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2176/4399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:01 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1518 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:01.738663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:01.739256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:01.756414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.756870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.763340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:01.763822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:01.850373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: .version_select at 0x7fb08e47dd30>, body: {"keypair": {"name": "tempest-keypair-2083068436"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:01.882628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:01.898255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:02.197862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:02.219576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:02.222552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:02.224536 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-41d0b4bc-2dda-40dd-b85c-69b7357a2c73 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1787 microversion: 2.42 time: 0.493037 Apr 09 21:10:02.236446 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2177/4400] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:01 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1787 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:02.242156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:02.243005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:02.248453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:02.251475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:02.252200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:02.253513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:02.254436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:02.258138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:02.280329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48b740b0-a933-4e6c-bc85-07b0e03f59eb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.812210 Apr 09 21:10:02.288678 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2224/4401] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:10:01 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:02.743850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:02.745204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:02.746260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:02.756764 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4227a36f-32a9-4fa7-9d95-b14bdf83cabf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.517059 Apr 09 21:10:02.758676 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2178/4402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:02 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:02.769266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:02.770831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:02.773004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:02.775594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:03.247651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:03.249211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:03.259664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:03.261180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:03.262539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:03.263199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:03.273823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:03.286068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9fe0a9b5-13a9-4b1f-89f3-2cd629efeeed tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1518 microversion: 2.1 time: 0.547369 Apr 09 21:10:03.286682 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2225/4403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:02 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1518 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:03.778092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:03.778994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:03.788576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:03.789356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:03.790486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:03.791083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:04.218013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:04.231293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:04.234332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:04.236109 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdcb95ba-f4c1-4d0c-a9cf-65345f835af4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1833 microversion: 2.42 time: 0.995517 Apr 09 21:10:04.249327 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2179/4404] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:03 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1833 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:04.271618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:04.281700 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ce4f0ea-e03f-488f-aa3c-7825470861c9 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.508250 Apr 09 21:10:04.283475 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2226/4405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:03 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:04.304996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:04.305741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:04.323546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:04.324087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:04.324877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:04.325231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.030954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:05.039500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-879530cf-9876-409d-8851-89127496191a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 200 len: 1518 microversion: 2.1 time: 0.740005 Apr 09 21:10:05.046056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2180/4406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:04 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 1518 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:05.149227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0016203c-c6e8-4ced-8886-664698a2b56e req-a85e8690-441c-49e7-acd6-a4849b6644bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e715c6e5-ef93-4e1e-99f6-bef6977c722d", "name": "network-vif-deleted", "tag": "ac563efd-83c8-45fd-823a-435cae4d5a0d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:05.170040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0016203c-c6e8-4ced-8886-664698a2b56e req-a85e8690-441c-49e7-acd6-a4849b6644bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:05.170717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0016203c-c6e8-4ced-8886-664698a2b56e req-a85e8690-441c-49e7-acd6-a4849b6644bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.204293 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0016203c-c6e8-4ced-8886-664698a2b56e req-a85e8690-441c-49e7-acd6-a4849b6644bd service nova] Creating event network-vif-deleted:ac563efd-83c8-45fd-823a-435cae4d5a0d for instance e715c6e5-ef93-4e1e-99f6-bef6977c722d on nch1-master-1 Apr 09 21:10:05.219720 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0016203c-c6e8-4ced-8886-664698a2b56e req-a85e8690-441c-49e7-acd6-a4849b6644bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074735 Apr 09 21:10:05.220826 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2227/4407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:05.256630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:05.257396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:05.275447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:05.278669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.279993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:05.280702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.300767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:05.302338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:05.326038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:05.326933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.328047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:05.328646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:05.947571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:05.957062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:05.958317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:05.961196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:05.963814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e5a06191-abdd-4ad6-b553-d7ced816e59c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1833 microversion: 2.42 time: 0.711789 Apr 09 21:10:05.964954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2181/4408] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:05 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1833 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:05.970532 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7a3192e-7c72-401d-8c19-90b1dc936e3b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.674314 Apr 09 21:10:05.972112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2228/4409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:05 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:06.065639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:06.069626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: e715c6e5-ef93-4e1e-99f6-bef6977c722d] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:06.110291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.110833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.111741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.112249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.207523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] HTTP exception thrown: Instance e715c6e5-ef93-4e1e-99f6-bef6977c722d could not be found. Apr 09 21:10:06.209638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Returning 404 to user: Instance e715c6e5-ef93-4e1e-99f6-bef6977c722d could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:10:06.210829 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2504f21-72d9-4c14-b688-2a1991abfd15 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d" status: 404 len: 111 microversion: 2.1 time: 0.152329 Apr 09 21:10:06.215080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2182/4410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:06 2022] GET /compute/v2.1/servers/e715c6e5-ef93-4e1e-99f6-bef6977c722d => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:10:06.223717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:06.224899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:06.251912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.253130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.254322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.255246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.304783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:10:06.488173 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3599d3e-7127-42fa-89b5-3b4b96bd057b tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 204 len: 0 microversion: 2.1 time: 0.267499 Apr 09 21:10:06.491265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2229/4411] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:10:06 2022] DELETE /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:10:06.500724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:06.502176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:06.513731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.516216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.519385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:06.520783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:06.986995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:06.993820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:06.997361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:07.009508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:07.017122 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9f47677b-5c17-42f4-9caa-ea12fb195b8a tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1518 microversion: 2.1 time: 0.516886 Apr 09 21:10:07.019613 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2183/4412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:06 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1518 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:07.031090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:07.033969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:07.039562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:07.046286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:07.049803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:07.074601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:07.076771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:07.077926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:07.082989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:07.563690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:07.579661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75f0cf68-8b85-4b40-8608-bc0b7add93e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.552856 Apr 09 21:10:07.582597 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2184/4413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:07 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:07.590026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4292f1e0-a06a-4687-b636-5bf4d52ac6d8 req-53a23f4e-c129-4c27-83ad-f64b00e9bcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "da958d47-ba90-4946-a8c2-f3457704513e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:07.624975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4292f1e0-a06a-4687-b636-5bf4d52ac6d8 req-53a23f4e-c129-4c27-83ad-f64b00e9bcba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:07.625457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4292f1e0-a06a-4687-b636-5bf4d52ac6d8 req-53a23f4e-c129-4c27-83ad-f64b00e9bcba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:07.648757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:07.649381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4292f1e0-a06a-4687-b636-5bf4d52ac6d8 req-53a23f4e-c129-4c27-83ad-f64b00e9bcba service nova] Creating event network-changed:da958d47-ba90-4946-a8c2-f3457704513e for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:07.665132 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4292f1e0-a06a-4687-b636-5bf4d52ac6d8 req-53a23f4e-c129-4c27-83ad-f64b00e9bcba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080415 Apr 09 21:10:07.666061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2185/4414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:07.671847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:07.673603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:07.679975 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d294896-b7b5-4a52-84bd-8e334cab3e23 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1854 microversion: 2.42 time: 0.699725 Apr 09 21:10:07.680658 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2230/4415] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:06 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1854 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:07.931203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1170944891", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "716e02fb-2354-45aa-9b94-e82b4f941149"}], "security_groups": [{"name": "tempest-securitygroup--1123297351"}], "key_name": "tempest-keypair-2083068436", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:08.037287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:08.038396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:08.094302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:08.095021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:08.095969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:08.098095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:08.538165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] validate_networks() for [('716e02fb-2354-45aa-9b94-e82b4f941149', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:10:09.635402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:09.653699 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-21620699-cecb-418a-8527-69d4e2a9fd1d tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1518 microversion: 2.1 time: 1.621342 Apr 09 21:10:09.654986 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2231/4416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:08 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1518 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:09.660972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:09.662738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:09.684552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:09.685291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:09.686278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:09.686994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.347692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:10.356780 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5915d4aa-90c4-4bec-ac4f-acac2b41457f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.700161 Apr 09 21:10:10.365230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2232/4417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:09 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:10.391667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:10.393419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:10.406601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.416767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.418073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.428617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.641998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:10.642579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:10.642896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:10.644245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:10.644958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:10.658197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.658915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.660040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.660676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.716510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:10.730367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:10.762216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:10:10.764641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:10:10.875590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e9b64a8c-ee51-48eb-851d-abbc11044665 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.947556 Apr 09 21:10:10.879069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2186/4418] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:10:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:10:10.892996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7ca39dae-9ca8-4c29-91f1-2b770140c512 req-e708b8bb-6558-4176-87f4-61ca4d96ba57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "d2e847f7-3df6-4159-af29-b43d77f7ab51"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:10.929029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ca39dae-9ca8-4c29-91f1-2b770140c512 req-e708b8bb-6558-4176-87f4-61ca4d96ba57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.930144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ca39dae-9ca8-4c29-91f1-2b770140c512 req-e708b8bb-6558-4176-87f4-61ca4d96ba57 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.950714 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7ca39dae-9ca8-4c29-91f1-2b770140c512 req-e708b8bb-6558-4176-87f4-61ca4d96ba57 service nova] Creating event network-changed:d2e847f7-3df6-4159-af29-b43d77f7ab51 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:10.957375 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7ca39dae-9ca8-4c29-91f1-2b770140c512 req-e708b8bb-6558-4176-87f4-61ca4d96ba57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076778 Apr 09 21:10:10.958817 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2187/4419] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:10.970820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:10.972190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:10.979881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.983758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:10.985780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:10.986487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:11.379647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a340104b44ec49f98a5aec0d0ce5a015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78452efb7ef143efa0123d3bc4873b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:11.393241 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-304f7ac7-7399-486a-bafc-4b98394705f5 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 200 len: 1476 microversion: 2.1 time: 0.424923 Apr 09 21:10:11.394151 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2188/4420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:10 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:11.403545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-beb7bf50-96d5-4f68-bfb5-8f95bbb35984 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:11.413053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-beb7bf50-96d5-4f68-bfb5-8f95bbb35984 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:11.543257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-beb7bf50-96d5-4f68-bfb5-8f95bbb35984 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:11.554089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-beb7bf50-96d5-4f68-bfb5-8f95bbb35984 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1238 microversion: 2.1 time: 0.154777 Apr 09 21:10:11.555707 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2189/4421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:11 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1238 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:11.560531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:11.561111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:11.578601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:11.579055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:11.587174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:11.590252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:11.721262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:11.743413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:11.750107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:11.751548 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8390f888-7c7e-42db-a393-70c7b2dc9d22 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.381335 Apr 09 21:10:11.752497 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2233/4422] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:10 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:12.412448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:12.413517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] [instance: 1420da11-8d6c-4a24-80ae-1d15af7fd212] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:12.427692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.430629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:12.435847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.438212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:12.465108 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] HTTP exception thrown: Instance 1420da11-8d6c-4a24-80ae-1d15af7fd212 could not be found. Apr 09 21:10:12.466006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] Returning 404 to user: Instance 1420da11-8d6c-4a24-80ae-1d15af7fd212 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:10:12.467522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96f77d78-1f0c-4e40-a89c-3ab2babcade2 tempest-ListServerFiltersTestJSON-343560619 tempest-ListServerFiltersTestJSON-343560619-project] 10.222.0.30 "GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212" status: 404 len: 111 microversion: 2.1 time: 0.060872 Apr 09 21:10:12.468923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2234/4423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:12 2022] GET /compute/v2.1/servers/1420da11-8d6c-4a24-80ae-1d15af7fd212 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:10:12.505884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:12.520750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac4b87ad-4f06-4d00-b25e-120ece524cbb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.963776 Apr 09 21:10:12.521563 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2190/4424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:11 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:12.571886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:12.572877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:12.580000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.580781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:12.581854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.582497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:12.770388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:12.771015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:12.788848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.789652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:12.790346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:12.791067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:13.069123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:13.088115 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a5508c3-0da9-4495-a404-617c42874a50 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1290 microversion: 2.1 time: 0.517950 Apr 09 21:10:13.089172 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2235/4425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:12 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1290 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:13.161208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1420da11-8d6c-4a24-80ae-1d15af7fd212", "name": "network-vif-deleted", "tag": "0b5260ea-bc03-4717-8368-2372659dfd8f"}, {"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "a3ce64ea-7c59-485a-8f4b-e040ea24b0b0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:13.175855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:13.176702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:13.211403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] Creating event network-vif-deleted:0b5260ea-bc03-4717-8368-2372659dfd8f for instance 1420da11-8d6c-4a24-80ae-1d15af7fd212 on nch1-master-1 Apr 09 21:10:13.213861 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] Creating event network-changed:a3ce64ea-7c59-485a-8f4b-e040ea24b0b0 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:13.227991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-44d52a5b-c242-4827-ae7b-8ddd7ee6df7f req-c2901222-954c-4ebf-ade2-7da52f959a85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071591 Apr 09 21:10:13.228636 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2236/4426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:13.482942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:13.492018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:13.493564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:13.513738 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2d62966-1adb-4f4a-b1aa-ae200ad6a2d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.747198 Apr 09 21:10:13.524696 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2191/4427] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:12 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:13.540582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:13.541556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:13.550590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:13.551134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:13.552024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:13.552615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:14.108981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:14.109819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:14.121429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:14.121879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:14.122906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:14.123541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:14.374415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:14.384540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:14.384957 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-376ae3a3-1244-4c1a-85a8-0e607983125e tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.850197 Apr 09 21:10:14.390186 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2237/4428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:13 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:14.393194 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac7a85c9-7005-48e0-99cf-32df64586aa2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1296 microversion: 2.1 time: 0.288527 Apr 09 21:10:14.399818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2192/4429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:14 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1296 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:14.534492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:14.535407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:14.544926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:14.549535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:14.550435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:14.550887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:14.954899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:14.972302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:14.975403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:14.978971 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b234c4b-b2b9-41cc-a9c5-50adc9c5d352 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.448410 Apr 09 21:10:14.986836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2238/4430] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:14 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:15.304888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3436f73b-811b-44a2-8000-a0fdc4928f1e req-3c059e8a-588e-415f-a5fd-d43fba8f5064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "ace7507d-dd06-475c-b999-2430bd431592"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:15.342721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3436f73b-811b-44a2-8000-a0fdc4928f1e req-3c059e8a-588e-415f-a5fd-d43fba8f5064 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:15.343241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3436f73b-811b-44a2-8000-a0fdc4928f1e req-3c059e8a-588e-415f-a5fd-d43fba8f5064 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:15.389974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3436f73b-811b-44a2-8000-a0fdc4928f1e req-3c059e8a-588e-415f-a5fd-d43fba8f5064 service nova] Creating event network-changed:ace7507d-dd06-475c-b999-2430bd431592 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:15.403730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:15.404355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:15.407897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3436f73b-811b-44a2-8000-a0fdc4928f1e req-3c059e8a-588e-415f-a5fd-d43fba8f5064 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130406 Apr 09 21:10:15.408532 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2193/4431] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:15.415901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:15.416928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:15.424542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:15.425355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:15.426778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:15.427387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:15.428381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:15.428846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:15.429693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:15.430147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:15.617744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:15.631718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81ca6b92-9a5c-4490-b48f-7f23e112e9a6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1296 microversion: 2.1 time: 0.221777 Apr 09 21:10:15.633693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2194/4432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:15 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1296 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:16.006518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:16.007150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:16.016838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.017635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.018549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.018967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.065297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:16.093390 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5476018-d1e3-4649-9ee7-ac3cd66e0cd0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1503 microversion: 2.1 time: 0.689929 Apr 09 21:10:16.095004 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2239/4433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:15 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1503 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:16.120175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e25379-e4c4-487a-824c-200bb454843f"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:16.121796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:16.144240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.144921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.147025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.147472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.213338 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Cannot 'attach_volume' instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b while it is in vm_state rescued Apr 09 21:10:16.223918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 409 to user: Cannot 'attach_volume' instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b while it is in vm_state rescued {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:10:16.228981 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a64b6f55-4bac-48c7-afe1-93ecd14900c7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114203 Apr 09 21:10:16.230386 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2240/4434] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:10:16 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 09 21:10:16.239492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:16.241705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:16.254126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.256843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.257884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.258531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.379191 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1be1aed-da5b-4ba8-8ea5-b0eae75261ff tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.143783 Apr 09 21:10:16.384168 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2241/4435] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:10:16 2022] POST /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:10:16.395312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:16.397843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:16.427469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.430135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:16.439133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:16.441606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:17.409560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:17.428670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:17.432192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:17.443483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fbc76df-5aff-4dec-a677-9bc398b0d7ce tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.441766 Apr 09 21:10:17.457070 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2195/4436] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:16 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:17.462047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:17.470947 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac5b4b45-9d20-402c-a0dd-3b276b96dbe4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1511 microversion: 2.1 time: 1.085026 Apr 09 21:10:17.477969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:17.480322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:17.482960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2242/4437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:16 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1511 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:17.507492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:17.511777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:17.516130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:17.517438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:17.723671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: .version_select at 0x7fb08eb7eaf0>, body: {"keypair": {"name": "tempest-keypair-1496121688"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:17.762942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:17.771516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:18.056256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:18.064472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:18.117266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e0fbb7a-f2dd-4f66-a2e3-528650ee38d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.550622 Apr 09 21:10:18.118302 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2243/4438] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:10:17 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:18.127697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-296901a0-21c6-446d-af6b-f67f4aa8f6a2 req-cea43b52-307e-42c3-979d-b4dfb1b66048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f732d8e8-0c52-44e4-89c6-b97595485ebc", "tag": "7db0e06f-1adf-4655-97b4-f840efe455ae"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:18.150031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-296901a0-21c6-446d-af6b-f67f4aa8f6a2 req-cea43b52-307e-42c3-979d-b4dfb1b66048 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.151082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-296901a0-21c6-446d-af6b-f67f4aa8f6a2 req-cea43b52-307e-42c3-979d-b4dfb1b66048 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.175531 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-296901a0-21c6-446d-af6b-f67f4aa8f6a2 req-cea43b52-307e-42c3-979d-b4dfb1b66048 service nova] Creating event network-changed:7db0e06f-1adf-4655-97b4-f840efe455ae for instance f732d8e8-0c52-44e4-89c6-b97595485ebc on nch2-master-1 Apr 09 21:10:18.183814 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-296901a0-21c6-446d-af6b-f67f4aa8f6a2 req-cea43b52-307e-42c3-979d-b4dfb1b66048 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063797 Apr 09 21:10:18.184455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2244/4439] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:18.380359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1728162693", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:18.462746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:18.463359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:18.464843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:18.465355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:18.465776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:18.507067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.511717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.512769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.513259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.571804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Getting quotas for project dc556aaca1864bec914c801ea06a2c1c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:18.585150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Getting quotas for user e5b23242fec34285bfd83a86ae3cc847 and project dc556aaca1864bec914c801ea06a2c1c. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:18.615454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:10:18.624550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:10:18.663772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:18.675923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5062d107-d2c9-41e4-b7b1-9246cbc7f936 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 1.217299 Apr 09 21:10:18.676697 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2196/4440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:17 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:18.689264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:18.690623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:18.693730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5b75f00-80f8-4670-a560-0c19b557d67c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.507461 Apr 09 21:10:18.694920 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2245/4441] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:10:18.699816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:18.702292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:18.703115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.703573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.704363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.704797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.712468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.713569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:18.714649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:18.715613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.461097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.470889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.477904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.482305 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9214c17b-7e51-48ac-a782-be053a8c8630 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.802451 Apr 09 21:10:19.485678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2197/4442] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:18 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:19.490729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:19.497975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:19.513562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:19.514233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.515379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:19.515945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.516875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.528497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cff95e45-8080-4928-a40f-2cc3a3710850 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1511 microversion: 2.1 time: 0.832340 Apr 09 21:10:19.531719 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2246/4443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:18 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1511 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:19.642761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.665855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.668551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:19.670365 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dbfa69f-4d8c-44ea-b693-c9ae061f1688 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 200 len: 1282 microversion: 2.47 time: 0.183453 Apr 09 21:10:19.671585 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2198/4444] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:19 2022] GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:19.701450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:19.702143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:19.722051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:19.722524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.723330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:19.723775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.752721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5c6715d0-0d05-446c-ba84-4f3f0aadc19b req-60a7cfa5-78ae-425c-a21e-79b917f8aab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "3e8709fe-4ff2-4d1a-b51d-e89c7bc51920"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:19.763991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c6715d0-0d05-446c-ba84-4f3f0aadc19b req-60a7cfa5-78ae-425c-a21e-79b917f8aab0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:19.765564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c6715d0-0d05-446c-ba84-4f3f0aadc19b req-60a7cfa5-78ae-425c-a21e-79b917f8aab0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:19.786142 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5c6715d0-0d05-446c-ba84-4f3f0aadc19b req-60a7cfa5-78ae-425c-a21e-79b917f8aab0 service nova] Creating event network-changed:3e8709fe-4ff2-4d1a-b51d-e89c7bc51920 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:19.797284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5c6715d0-0d05-446c-ba84-4f3f0aadc19b req-60a7cfa5-78ae-425c-a21e-79b917f8aab0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048561 Apr 09 21:10:19.817132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2199/4445] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:10:19.929929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-824746035", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:20.031239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:20.031864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:20.034234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:20.034650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:20.035710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:20.048590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.049150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:20.050168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.050980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:20.078764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Getting quotas for project dc556aaca1864bec914c801ea06a2c1c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:20.091702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Getting quotas for user e5b23242fec34285bfd83a86ae3cc847 and project dc556aaca1864bec914c801ea06a2c1c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:20.112027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:10:20.114772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:10:20.182781 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b7e48d9-5483-4fac-9dcf-d4e1b6a1a992 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.258046 Apr 09 21:10:20.183884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2200/4446] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 09 21:10:20.197009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e896c1a-df18-445f-8293-dc5db705949c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:20.200600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e896c1a-df18-445f-8293-dc5db705949c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:20.287977 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e896c1a-df18-445f-8293-dc5db705949c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "PUT /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 991 microversion: 2.47 time: 0.097169 Apr 09 21:10:20.289085 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2201/4447] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Apr 9 21:10:20 2022] PUT /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:10:20.311479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:20.315877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:20.703828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:20.715997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-922dc19d-47ba-4f3d-87b4-17a721b922fa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 1.027382 Apr 09 21:10:20.717380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2247/4448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:19 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:20.732494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:20.736310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:20.751593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.756408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:20.766374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.767011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:20.775340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:20.794595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:20.797176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:20.799016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-942e5e25-a056-479a-b1cc-d43268273cd5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1277 microversion: 2.47 time: 0.495876 Apr 09 21:10:20.801095 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2202/4449] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:20 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1277 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:20.815127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:20.818869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:20.833638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.835042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:20.840985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:20.842345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:21.896093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:21.911365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:21.912956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:21.914288 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e417991d-b02a-4daa-bcbd-8ba1c17add46 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.193965 Apr 09 21:10:21.918755 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2248/4450] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:20 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:21.931072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:21.931946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:21.945590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:21.946273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:21.947263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:21.947957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:22.005784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:22.017315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ac335d2-4b33-4f99-a41e-ab950d1a372b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1511 microversion: 2.1 time: 1.214853 Apr 09 21:10:22.030417 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2203/4451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:20 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1511 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:22.036511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:22.037175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:22.053027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:22.053516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:22.054337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:22.054783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:22.258751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:22.274403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:22.280079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:22.283072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40286d61-3aed-43ca-8073-6247a4aaeedd tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1337 microversion: 2.47 time: 0.250397 Apr 09 21:10:22.305203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2204/4452] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:22 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1337 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:22.404977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:22.416542 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b389cbf1-c93d-49e1-9a92-6950ea1e5df1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.496481 Apr 09 21:10:22.417657 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2249/4453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:21 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:22.938392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:22.939294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:22.946782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:22.948144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:22.951155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:22.951744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:23.035101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:23.035705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:23.042441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:23.042894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:23.045072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:23.045659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:23.987535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:23.992908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.017457 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8b6374a5-a2f3-42bb-bdf6-2b2ada7701cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1511 microversion: 2.1 time: 0.983987 Apr 09 21:10:24.022560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.028697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.029301 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2250/4454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:23 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1511 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:24.030465 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f925d30a-2285-44cf-8921-1733bbe3b84a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.096451 Apr 09 21:10:24.031147 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2205/4455] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:22 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:24.035939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:24.037157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:24.041451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-82217eb6-a54e-4540-b3cf-d4471cde5d45 req-38b6322a-c4f7-4a9a-a7b0-5dcb837af67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "795eaf94-b9aa-4494-8de0-8b62eecc59b1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:24.046039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.046711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.048186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.049859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.073980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-82217eb6-a54e-4540-b3cf-d4471cde5d45 req-38b6322a-c4f7-4a9a-a7b0-5dcb837af67a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.081657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-82217eb6-a54e-4540-b3cf-d4471cde5d45 req-38b6322a-c4f7-4a9a-a7b0-5dcb837af67a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.103710 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-82217eb6-a54e-4540-b3cf-d4471cde5d45 req-38b6322a-c4f7-4a9a-a7b0-5dcb837af67a service nova] Creating event network-changed:795eaf94-b9aa-4494-8de0-8b62eecc59b1 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:24.108892 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-82217eb6-a54e-4540-b3cf-d4471cde5d45 req-38b6322a-c4f7-4a9a-a7b0-5dcb837af67a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071149 Apr 09 21:10:24.109859 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2206/4456] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:24.115390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:24.116505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:24.123219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.124124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.125235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.125901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.235058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.248717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.250392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.251572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8b4d9793-6f7a-4708-bd32-7f3c66af08b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1335 microversion: 2.47 time: 0.221056 Apr 09 21:10:24.252144 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2251/4457] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:24 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1335 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:24.334181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ca724201-1c6d-4b6f-b59b-e2e7445d4117 req-a388d353-289b-4f76-8732-5ddb882a0e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f732d8e8-0c52-44e4-89c6-b97595485ebc", "name": "network-vif-plugged", "status": "completed", "tag": "7db0e06f-1adf-4655-97b4-f840efe455ae"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:24.357210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ca724201-1c6d-4b6f-b59b-e2e7445d4117 req-a388d353-289b-4f76-8732-5ddb882a0e0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:24.362893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ca724201-1c6d-4b6f-b59b-e2e7445d4117 req-a388d353-289b-4f76-8732-5ddb882a0e0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:24.380323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ca724201-1c6d-4b6f-b59b-e2e7445d4117 req-a388d353-289b-4f76-8732-5ddb882a0e0d service nova] Creating event network-vif-plugged:7db0e06f-1adf-4655-97b4-f840efe455ae for instance f732d8e8-0c52-44e4-89c6-b97595485ebc on nch2-master-1 Apr 09 21:10:24.386845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ca724201-1c6d-4b6f-b59b-e2e7445d4117 req-a388d353-289b-4f76-8732-5ddb882a0e0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060550 Apr 09 21:10:24.388123 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2252/4458] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:10:24.711960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:24.729301 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-30640709-ad44-4002-bdec-0e427121c7a0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.616973 Apr 09 21:10:24.733633 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2207/4459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:24 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:25.038583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:25.039303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:25.051940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:25.056154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:25.073458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.076486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.077389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.079068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.082965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.083358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.088177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.088901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.516122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.540003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eecac324-5cd3-4653-b8b3-93fd2490b59c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1517 microversion: 2.1 time: 0.508412 Apr 09 21:10:25.545026 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2253/4460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:25 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1517 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:25.545792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.563507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.568030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.572946 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-62bd1333-38e4-4684-8a73-081eef08b1d5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.525283 Apr 09 21:10:25.574027 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2208/4461] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:25 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:25.586405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:25.589735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:25.595342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2125378393", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7"}], "security_groups": [{"name": "tempest-securitygroup--2094984161"}], "key_name": "tempest-keypair-1496121688", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:25.601050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.609927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.614477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.615204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.824104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.834814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.840240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:25.845925 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-012a3e75-7dbb-4bf8-ac84-3da474b67ea9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1335 microversion: 2.47 time: 0.265848 Apr 09 21:10:25.848456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2209/4462] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:25 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1335 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:25.853547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:25.867781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:25.881842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.882294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:25.883263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:25.883993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:26.129290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] validate_networks() for [('f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:10:26.565668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:26.578748 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d9712db4-7e7c-461c-93fe-fecb22c54ef6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.728853 Apr 09 21:10:26.581686 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2210/4463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:25 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:26.596476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a8c12666-4883-4ed7-b7f2-1e3f590aa56c req-24587601-133e-4571-a796-49d0cd9ef310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:26.624567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a8c12666-4883-4ed7-b7f2-1e3f590aa56c req-24587601-133e-4571-a796-49d0cd9ef310 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:26.625625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a8c12666-4883-4ed7-b7f2-1e3f590aa56c req-24587601-133e-4571-a796-49d0cd9ef310 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:26.642216 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a8c12666-4883-4ed7-b7f2-1e3f590aa56c req-24587601-133e-4571-a796-49d0cd9ef310 service nova] Creating event network-changed:1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:26.648484 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a8c12666-4883-4ed7-b7f2-1e3f590aa56c req-24587601-133e-4571-a796-49d0cd9ef310 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064383 Apr 09 21:10:26.649924 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2211/4464] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:26.656534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:26.657623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:26.667214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:26.668086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:26.669995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:26.670801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.128883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.141263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.143523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.146321 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ee4ce69-6bca-470b-a3b1-3c56b8a5f2bc tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.494597 Apr 09 21:10:27.147527 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2212/4465] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:26 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:27.153796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:27.154665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:27.164389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.165467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.166422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.167005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.612363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.620793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.633527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:27.634817 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4be764f4-468e-4379-9010-16d16ea99292 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1335 microversion: 2.47 time: 0.486268 Apr 09 21:10:27.635761 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2213/4466] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:27 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1335 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:27.640769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: .version_select at 0x7fb08e0b33a0>, body: {"keypair": {"name": "tempest-keypair-2132376533"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:27.670679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:27.680187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for user 2abb09d2f7844f3ba0f7a20787d73e4b and project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:27.752450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:27.753232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:27.753818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:27.754321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:27.754828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:27.788848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.789632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.797006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.800317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.852980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:27.859751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:27.897663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:10:27.900320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:10:27.911051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:27.919804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for user 2abb09d2f7844f3ba0f7a20787d73e4b and project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:27.957648 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d85913c2-4940-4be4-8b45-a9af8a6e706b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.320714 Apr 09 21:10:27.958878 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2214/4467] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:10:27 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:27.963886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:27.964451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:27.970945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.971654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.972973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:27.973600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:27.985801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c02a4f1-9492-4c5b-8cbe-bf0ad7005631 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.438720 Apr 09 21:10:27.986803 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2254/4468] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:10:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:10:28.000518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b4b3d2e-8ff3-4d4d-ae9e-62b2cc871613 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:28.005069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b4b3d2e-8ff3-4d4d-ae9e-62b2cc871613 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:28.126921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b4b3d2e-8ff3-4d4d-ae9e-62b2cc871613 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.140820 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b4b3d2e-8ff3-4d4d-ae9e-62b2cc871613 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1242 microversion: 2.1 time: 0.146551 Apr 09 21:10:28.149373 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2255/4469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:27 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:28.170002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:28.171043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:28.181442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:28.182412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:28.183893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:28.184837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:28.496984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.510604 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-442335a2-525d-4449-9a17-664e5d880449 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.550353 Apr 09 21:10:28.511207 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2215/4470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:27 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:28.659104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:28.659775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:28.670916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:28.671990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:28.673132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:28.673743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:28.843108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.872261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.877377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.880480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65383639-2e35-4d05-a3e6-3d72e0ecad98 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1335 microversion: 2.47 time: 0.225811 Apr 09 21:10:28.881118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2216/4471] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:28 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:28.905948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.919958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.922478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:28.923891 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97fc170b-3ceb-4588-88c2-0b6a3233e28b tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.762200 Apr 09 21:10:28.924990 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2256/4472] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:28 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:29.158756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:29.159392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:29.165931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.166378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:29.167340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.167774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:29.285713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:29.315662 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73d061d5-f578-4794-a0ee-8708cdb26313 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1294 microversion: 2.1 time: 0.161453 Apr 09 21:10:29.316413 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2217/4473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:29 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:29.529620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:29.530299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:29.537998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.538714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:29.539681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.540294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:29.899247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:29.900181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:29.908692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.909787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:29.910705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:29.911416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:30.043777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.051888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e59fc1d-9fce-4ee9-9a90-50548b20ab2f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.527323 Apr 09 21:10:30.052473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2257/4474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:29 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:30.057632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:30.058444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:30.065829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:30.066615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:30.067407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:30.067885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:30.098247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.107910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.109826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.111198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2e7bf758-3080-4b4e-95ec-c854d1dcde58 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1335 microversion: 2.47 time: 0.216436 Apr 09 21:10:30.111994 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2218/4475] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:29 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1335 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:30.335952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:30.336971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:30.361092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:30.361787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:30.363147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:30.364945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:30.534904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.548538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-505ec606-18f1-4c59-a148-8ad3b9a542a3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1300 microversion: 2.1 time: 0.217732 Apr 09 21:10:30.549615 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2219/4476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:30 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1300 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:30.645261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.659614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.662190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:30.663621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30028375-8f40-4749-bd40-89b23b37e55e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.609919 Apr 09 21:10:30.666486 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2258/4477] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:30 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:31.070665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:31.072109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.079647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.080374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.081846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.082467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.133405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:31.135646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.144956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.146029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.147127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.148074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.294159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.305485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.307285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.308739 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b6985804-ba69-498b-851b-a60d9d19d789 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1356 microversion: 2.47 time: 0.181813 Apr 09 21:10:31.321208 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2259/4478] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:31 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:31.327629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:31.330123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.338126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.339098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.340629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.341620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.441100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:31.441968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:31.442627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:31.443879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:31.444313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:31.524256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.541148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.541883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.542935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.544025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.572873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.579463 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d778bed-1e35-4abf-97b4-c02b1ad7c6b5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "POST /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74/action" status: 202 len: 1078 microversion: 2.47 time: 0.256082 Apr 09 21:10:31.580847 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2260/4479] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:10:31 2022] POST /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74/action => generated 1078 bytes in 258 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 09 21:10:31.585986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:31.586820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.595422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.596253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.597632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.598271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.608469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-083f1021-b3a6-4df0-bb60-7fdc8b3eb8d2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1364 microversion: 2.1 time: 0.540290 Apr 09 21:10:31.611202 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2220/4480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:31 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1364 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:31.629397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:31.631640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.655229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.655874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.656723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.660650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.851457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.865582 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-540c6165-7f73-4ccc-93d5-f436755feb45 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1300 microversion: 2.1 time: 0.282874 Apr 09 21:10:31.867996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2261/4481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:31 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1300 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:31.884509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:31.885628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:31.893277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.894137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.895757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:31.896277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:31.979545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.990898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.994388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:31.996832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28446ed5-0e29-4fdd-b185-84e16f2cbe7a tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.378688 Apr 09 21:10:31.998136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2221/4482] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:31 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:32.004548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-294207241", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ba3f1cd-154a-468d-adbc-6dec47d2b32d"}], "security_groups": [{"name": "tempest-securitygroup--1049565655"}], "key_name": "tempest-keypair-2132376533", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:32.503430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] validate_networks() for [('6ba3f1cd-154a-468d-adbc-6dec47d2b32d', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:10:32.547588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:32.565173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:32.568184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:32.569493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8378429-ff33-4147-8cbb-a8dc78cdc7d7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.700414 Apr 09 21:10:32.570127 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2262/4483] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:31 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:32.626425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:32.627219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:32.644278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:32.646985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:32.647930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:32.651983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:33.390281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:33.401392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-337f55d7-cbe4-429c-8246-f6f6bf9768f7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1550 microversion: 2.1 time: 0.779041 Apr 09 21:10:33.402564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2263/4484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:32 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1550 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:33.409022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:33.409997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:33.416767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:33.417378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:33.418389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:33.418931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:33.950294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:33.958660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c8a45206-5c30-49d4-acda-3bbac74ac639 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.553641 Apr 09 21:10:33.959255 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2264/4485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:33 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:33.964396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:33.965007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:33.971348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:33.971808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:33.972924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:33.973549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.120504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:34.129978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:34.131704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:34.133029 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73700502-198e-4769-8654-59b66c725d5d tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.172669 Apr 09 21:10:34.146069 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2265/4486] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:33 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:34.146069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:34.146069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:34.149170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.149690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.150539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.151046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.320849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:10:34.323644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:10:34.324292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:10:34.325494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:10:34.326510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:10:34.342915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.343737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.345636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.346399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.349495 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e131ab3-e759-4f7b-a01f-08bdf5d9c69f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213348 Apr 09 21:10:34.350353 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2266/4487] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:10:34 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:34.355488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:34.358262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:34.368485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.369374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.377214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.378130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.410211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:10:34.418179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Getting quotas for user 2abb09d2f7844f3ba0f7a20787d73e4b and project d475c8fbc1f74285a1c98fd75bd109f2. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:10:34.433294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:10:34.436383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:10:34.508376 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-848e8f83-24c1-439f-891e-4a68ed90d104 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.508862 Apr 09 21:10:34.509743 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2222/4488] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:10:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:10:34.525524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78f35baa-a4df-4402-b626-1edf82205e1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:34.526333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78f35baa-a4df-4402-b626-1edf82205e1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:34.932239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78f35baa-a4df-4402-b626-1edf82205e1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:34.941760 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78f35baa-a4df-4402-b626-1edf82205e1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1245 microversion: 2.1 time: 0.426123 Apr 09 21:10:34.942795 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2223/4489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:34 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1245 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:34.978742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:34.979646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:34.991569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.992221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:34.993266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:34.994225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:35.724236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:35.754297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:35.761168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:35.763243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1edb57f-d06a-4882-857a-bbac76570077 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.411918 Apr 09 21:10:35.764437 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2267/4490] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:34 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:35.770413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:35.771480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:35.779408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:35.780403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:35.781446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:35.782385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:36.037125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:36.047059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:36.048671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:36.050265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a3ea6d4a-44b2-46cb-8460-ce28c799bc23 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.284581 Apr 09 21:10:36.062311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2268/4491] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:35 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:36.069001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:36.070515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:36.074045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:36.077385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:36.077917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:36.079306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:36.079811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:36.083032 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36a75b60-4c36-4922-b760-b356e436a0f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 1.111128 Apr 09 21:10:36.105262 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2224/4492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:34 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:36.203642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:36.212030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b41004c-42e5-4df8-bd63-9c6f8e09c1e1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1303 microversion: 2.1 time: 0.148566 Apr 09 21:10:36.212857 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2269/4493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:36 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:36.694251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-db790dea-6ab1-4891-82f9-0347d4ac7dfe req-1f1b4732-00f0-4680-bd47-f60cf8df59f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8926ba-de0b-42ed-9343-4f06f614270f", "tag": "fb082d76-dfa5-400a-8a59-2c435b48cf05"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:36.724303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db790dea-6ab1-4891-82f9-0347d4ac7dfe req-1f1b4732-00f0-4680-bd47-f60cf8df59f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:36.725671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-db790dea-6ab1-4891-82f9-0347d4ac7dfe req-1f1b4732-00f0-4680-bd47-f60cf8df59f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:36.748441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-db790dea-6ab1-4891-82f9-0347d4ac7dfe req-1f1b4732-00f0-4680-bd47-f60cf8df59f6 service nova] Creating event network-changed:fb082d76-dfa5-400a-8a59-2c435b48cf05 for instance 0f8926ba-de0b-42ed-9343-4f06f614270f on nch1-master-1 Apr 09 21:10:36.754809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-db790dea-6ab1-4891-82f9-0347d4ac7dfe req-1f1b4732-00f0-4680-bd47-f60cf8df59f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067008 Apr 09 21:10:36.755482 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2225/4494] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:36.789857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:36.798608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:36.808124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:36.810610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:36.811506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:36.812133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.071271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:37.072071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:37.078989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.079740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.080490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.081074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.475521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.487455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.489455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.490966 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ba90d5c-6d96-44f2-8809-9b0b2d8fe8b1 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.424521 Apr 09 21:10:37.503176 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2226/4495] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:37 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:37.508546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:37.509418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:37.518296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.518760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.519965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.519965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.663930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.679588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.682986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.685507 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bade3e2c-a517-4dbb-83db-68790d1323d6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.905943 Apr 09 21:10:37.686888 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2270/4496] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:36 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:37.695486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:37.696701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:37.707983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.708763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.710157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:37.710809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:37.847457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:37.868224 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61be8b98-930f-4220-9b1e-5962f74b6062 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1303 microversion: 2.1 time: 0.178971 Apr 09 21:10:37.870557 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2271/4497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:37 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:38.012248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:38.027505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a9fc02b-b3bd-4082-9f27-7c118fd4a91c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.522851 Apr 09 21:10:38.028447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2227/4498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:37 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:38.510570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:38.511196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:38.540404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.541065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.551695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.552479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.707621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:38.709026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:38.714042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:38.727615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.728421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.730419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.731908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.735238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:38.736987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:38.743451 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a94eba2f-ebe0-47e2-8e52-4a59fbbec839 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.237129 Apr 09 21:10:38.746925 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2272/4499] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:38 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:38.798542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-61a212c2-1439-45f9-82b1-e56e64339fd7 req-d873ddf2-7e19-417e-adb5-65ba1c61f04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f732d8e8-0c52-44e4-89c6-b97595485ebc", "tag": "7db0e06f-1adf-4655-97b4-f840efe455ae"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:38.813468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-61a212c2-1439-45f9-82b1-e56e64339fd7 req-d873ddf2-7e19-417e-adb5-65ba1c61f04d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.814791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-61a212c2-1439-45f9-82b1-e56e64339fd7 req-d873ddf2-7e19-417e-adb5-65ba1c61f04d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.847791 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-61a212c2-1439-45f9-82b1-e56e64339fd7 req-d873ddf2-7e19-417e-adb5-65ba1c61f04d service nova] Creating event network-changed:7db0e06f-1adf-4655-97b4-f840efe455ae for instance f732d8e8-0c52-44e4-89c6-b97595485ebc on nch2-master-1 Apr 09 21:10:38.874535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-61a212c2-1439-45f9-82b1-e56e64339fd7 req-d873ddf2-7e19-417e-adb5-65ba1c61f04d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074291 Apr 09 21:10:38.878633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2273/4500] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:10:38.891582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:38.892563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:38.902093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.902863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:38.904193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:38.907777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:39.799334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:39.816985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:39.821752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:39.826271 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d315ad3-fb00-4d19-85c9-48a2decb8ee7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 1.125139 Apr 09 21:10:39.827729 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2228/4501] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:38 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:39.856299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:39.863146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:39.867947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:39.878633 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ee276a5-e95b-4b0f-8a21-b1e013b7c61c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.995903 Apr 09 21:10:39.884890 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2274/4502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:38 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:39.900811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:39.903421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:39.905059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:39.908938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:39.909420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:39.910232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:39.928688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:39.930266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:39.931269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:39.940896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:40.151351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:40.162922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:40.165950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:40.167504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9c1bc850-3f62-4522-970d-f29f60248bf3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.280359 Apr 09 21:10:40.168983 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2275/4503] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:39 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:40.312235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:40.324382 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d019521c-c0e2-4c03-94f5-d654347f8d1b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.494122 Apr 09 21:10:40.326785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2229/4504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:39 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:40.866032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:40.867480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:40.881265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:40.882031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:40.883078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:40.883686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:40.905875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:40.907816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:40.933564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:40.934266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:40.941387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:40.942118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.507966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.519865 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5ae81a6-c25a-42de-9d9d-be47dffdc50a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.621348 Apr 09 21:10:41.530533 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2230/4505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:40 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:41.550801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a03a5e5f-a3bf-4bc8-8a62-0bb56b451684 req-a4e5f9d1-b96d-44a6-b75c-294ce8de1e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:41.559483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.560377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a03a5e5f-a3bf-4bc8-8a62-0bb56b451684 req-a4e5f9d1-b96d-44a6-b75c-294ce8de1e82 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.562068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a03a5e5f-a3bf-4bc8-8a62-0bb56b451684 req-a4e5f9d1-b96d-44a6-b75c-294ce8de1e82 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.578491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.579948 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a03a5e5f-a3bf-4bc8-8a62-0bb56b451684 req-a4e5f9d1-b96d-44a6-b75c-294ce8de1e82 service nova] Creating event network-changed:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:10:41.582189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.584610 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-063153a9-0319-4451-bcee-b68cc6dfb9a4 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.741159 Apr 09 21:10:41.595815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a03a5e5f-a3bf-4bc8-8a62-0bb56b451684 req-a4e5f9d1-b96d-44a6-b75c-294ce8de1e82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053976 Apr 09 21:10:41.595815 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2231/4506] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:41.596527 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2276/4507] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:40 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:41.600337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:41.601317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:41.608477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.609021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:41.609560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:41.609825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.610852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.611490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.623496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.624945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.625831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.626275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.650736 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a78b5821-ebab-4ece-8705-02d214ab4d16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/ips" status: 200 len: 153 microversion: 2.20 time: 0.054217 Apr 09 21:10:41.661058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2277/4508] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Apr 9 21:10:41 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/ips => generated 153 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:10:41.669263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:41.669881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:41.676722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.686830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.687954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:41.688555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:41.729024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.743146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.746650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.748114 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d972e16e-2d81-44ef-a71f-43401e74f36c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.156255 Apr 09 21:10:41.748693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2232/4509] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:41 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:41.935385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:41.947678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f1e274e-584f-43d2-b688-e97e4702d7fb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.284622 Apr 09 21:10:41.958961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2278/4510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:41 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:42.539646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:42.540356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:42.560592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:42.564458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:42.565659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:42.566117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:42.604744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:42.605867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:42.618673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:42.619146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:42.619942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:42.620388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:43.524291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.540380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f2a0390-e10d-4434-8af6-39e56f1ba3d7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 1.007393 Apr 09 21:10:43.543402 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2233/4511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:42 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:43.555732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.562803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:43.563677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:43.572098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.575549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.576518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:43.578158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:43.580023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:43.580690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:43.587472 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20d31294-8b9e-4501-892a-d4126d4be260 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.978248 Apr 09 21:10:43.600183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2279/4512] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:42 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:43.623695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:43.624397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:43.644308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:43.644996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:43.645981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:43.646591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:43.717209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.729870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.740102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.743975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fa4afac-e2a7-4f6e-9b8e-7b774c1bead2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.198405 Apr 09 21:10:43.746496 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2234/4513] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:43 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:43.898475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:43.907085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4d834b5c-91b8-4013-bbbb-1ca5f4706ba6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.305397 Apr 09 21:10:43.908044 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2280/4514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:43 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:44.063065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:44.064345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:44.079370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.080630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:44.081840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.082552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:44.136947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lazy-loading 'flavor' on Instance uuid a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:10:44.471582 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efb3808c-181c-498d-bc35-3c68e6fa8d04 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/action" status: 202 len: 0 microversion: 2.20 time: 0.417227 Apr 09 21:10:44.472885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2235/4515] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:10:44 2022] POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:10:44.481407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:44.482471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:44.489639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.490524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:44.491637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.492318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:44.562397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:44.563290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:44.571550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.572188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:44.573245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:44.573792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.177273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.185864 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5670aa37-d8a8-460f-83de-0aee62876507 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.628995 Apr 09 21:10:45.186430 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2236/4516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:44 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:45.200626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:45.201527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:45.208514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.209253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.210264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.210865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.223380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.248928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.250800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.252028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5233470b-b212-4b68-90df-4284c2b1c2fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.775051 Apr 09 21:10:45.256171 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2281/4517] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:44 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:45.270899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:45.271297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:45.289485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.289949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.290758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.291209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.419810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.429731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.431175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.432364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91c303fb-a78a-45fd-8d70-9eb9e38c4526 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.173853 Apr 09 21:10:45.432946 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2282/4518] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:45 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:45.438418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:45.439280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:45.448759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.449318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.450177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:45.450679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:45.716700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.727001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.728726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.730034 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a03e032a-13f4-41c9-93f9-c046ed108176 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.533625 Apr 09 21:10:45.730937 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2237/4519] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:45 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:45.775959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:45.784095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc4438ec-e617-423a-bcbb-516935ee167b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.349905 Apr 09 21:10:45.784728 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2283/4520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:45 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:46.203376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:46.204570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:46.211461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.212275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.213324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.213986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.280164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:46.280712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:46.288052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.288513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.289355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.289791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.504914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.519481 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3543e1b-9273-4862-a124-a719ce3c8c98 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.320197 Apr 09 21:10:46.525163 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2238/4521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:46 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:46.533513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:46.534092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:46.545174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.550144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.554542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.555405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.555847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.558806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.560579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.561942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97c560a5-5bca-4b21-9cc7-4d8d898dc6f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.286427 Apr 09 21:10:46.565237 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2284/4522] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:46 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:46.652538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.662069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.663818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:46.665462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c928490-8bc6-4b21-8a64-eae4272833b3 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.138946 Apr 09 21:10:46.666203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2239/4523] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:46 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:46.748423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:46.749321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:46.756488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.756944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.758390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.758866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.802101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:46.802740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:46.809676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.810349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:46.811306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:46.811896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.051658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.063479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.065296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.066760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b499a09f-824f-450b-852c-b5d922df9d57 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.322711 Apr 09 21:10:47.067861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2285/4524] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:46 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:47.074648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.083464 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18bf770f-c51c-464c-8bcf-8f3592a03fb8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.286009 Apr 09 21:10:47.084503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2240/4525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:46 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:47.535839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:47.536996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:47.544360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.544951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.545944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.546464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.582311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:47.583308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:47.596680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.598017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.599140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.599818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.786866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.798529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f90a6bed-3181-4280-bd11-af891e80394a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.266450 Apr 09 21:10:47.808885 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2286/4526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:47 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:47.815470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:47.827748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:47.828147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.837016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.838572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.839132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.839584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.839953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ba03e90-b566-41a1-92d2-8127ea4a4b0f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.263834 Apr 09 21:10:47.844171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:47.844621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:47.852783 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2241/4527] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:47 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:47.964989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.975775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.977453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:47.978718 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23007599-7a48-48dd-841c-5263ca0b0af8 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.168652 Apr 09 21:10:47.979690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2287/4528] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:47 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:48.092064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:48.093094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:48.100089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:48.100616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.100880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:48.101432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.102387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.102992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.110927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.115747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.116669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.117224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.424089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:48.440395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:48.448093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:48.449707 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efa3411a-d40b-4491-a033-81122496ae48 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.363890 Apr 09 21:10:48.465253 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2242/4529] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:48 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:48.511110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:48.522908 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08322a41-27f4-4db6-b617-dd6c0e26b6a6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.425557 Apr 09 21:10:48.524157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2288/4530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:48 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:48.687736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-73bfe4d1-0318-40f9-8aed-978b94c3b0ae req-d4dbc9a9-12c3-465d-943c-e86112b529d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "3e8709fe-4ff2-4d1a-b51d-e89c7bc51920"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:48.698961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-73bfe4d1-0318-40f9-8aed-978b94c3b0ae req-d4dbc9a9-12c3-465d-943c-e86112b529d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.700577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-73bfe4d1-0318-40f9-8aed-978b94c3b0ae req-d4dbc9a9-12c3-465d-943c-e86112b529d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.713978 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-73bfe4d1-0318-40f9-8aed-978b94c3b0ae req-d4dbc9a9-12c3-465d-943c-e86112b529d3 service nova] Creating event network-vif-plugged:3e8709fe-4ff2-4d1a-b51d-e89c7bc51920 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:48.734313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-73bfe4d1-0318-40f9-8aed-978b94c3b0ae req-d4dbc9a9-12c3-465d-943c-e86112b529d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265728 Apr 09 21:10:48.736131 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2243/4531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:48.816041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:48.816778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:48.827110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.830778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.831952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.832574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.860497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:48.861403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:48.872443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.875182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:48.878317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:48.881375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.220554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.225406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.229868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.231451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.232761 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-31163616-7015-49f9-809f-05d4a9836724 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.377314 Apr 09 21:10:49.233343 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f8feeb6-035c-4b90-8951-e8fe2d973fb6 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.421439 Apr 09 21:10:49.233741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2244/4532] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:48 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:49.234891 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2289/4533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:48 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:49.238988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:49.239601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:49.245922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.246568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.247349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.247787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.322739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.331045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.332557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:49.333762 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a1d8efc-161e-4e9f-914b-058d992b203e tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.098879 Apr 09 21:10:49.334386 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2245/4534] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:49 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:49.470115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:49.470680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:49.477457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.477921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.478679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.479150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.539805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:49.543548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:49.547076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.547541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:49.548339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:49.548782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.120278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.133849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.135849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.139985 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac8c11ac-d1a6-4b93-b380-a17911f8ad2d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.674199 Apr 09 21:10:50.140657 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2290/4535] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:49 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:50.142938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.160177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28a7b9b5-2ace-469a-9988-00f898327e1c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.623563 Apr 09 21:10:50.160814 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2246/4536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:49 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:50.261232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:50.262146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:50.262989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:50.263695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:50.269822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.270323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.271323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.271961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.276334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.280318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.281256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.281907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.507468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.516047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.518182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.519816 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68112000-7ce7-404d-8803-75c36a40b6b0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.262317 Apr 09 21:10:50.531037 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2247/4537] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:50 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:50.536174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:50.536798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:50.543246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.543711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.544793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.545271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.561710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.574293 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29e600ba-de4d-4919-8416-d87bd6749a04 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.322218 Apr 09 21:10:50.583829 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2291/4538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:50 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:50.655006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.665997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.667483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:50.677752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f14c0860-183d-42b4-a83f-5114debd0e5f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.136425 Apr 09 21:10:50.678775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2248/4539] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:50 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:50.753793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5a117308-1635-4671-aa2f-862c4633a1b5 req-b0dc4867-d07a-43ee-856d-87983f612594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "a3ce64ea-7c59-485a-8f4b-e040ea24b0b0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:50.764785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5a117308-1635-4671-aa2f-862c4633a1b5 req-b0dc4867-d07a-43ee-856d-87983f612594 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:50.765325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5a117308-1635-4671-aa2f-862c4633a1b5 req-b0dc4867-d07a-43ee-856d-87983f612594 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:50.780373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5a117308-1635-4671-aa2f-862c4633a1b5 req-b0dc4867-d07a-43ee-856d-87983f612594 service nova] Creating event network-vif-plugged:a3ce64ea-7c59-485a-8f4b-e040ea24b0b0 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:50.786493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5a117308-1635-4671-aa2f-862c4633a1b5 req-b0dc4867-d07a-43ee-856d-87983f612594 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Apr 09 21:10:50.788499 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2292/4540] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:51.159643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:51.160368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:51.166589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.167132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.168018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.168530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.178916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:51.180569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:51.187224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.187937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.188687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.189340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.422046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.424961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.431820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.432629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e815b780-f963-4d8e-89d8-b828d80acc22 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.258921 Apr 09 21:10:51.436944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.437177 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2293/4541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:51 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:51.437295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85e28c92-aa9b-4269-b359-5992e149d240 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.279232 Apr 09 21:10:51.437295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2249/4542] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:51 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:51.547968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:51.548707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:51.558759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.559312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.560173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.560663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.599038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:51.600891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:51.609328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.610320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.612420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.613212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.827367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.833807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.843623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.843623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.843623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-24a33450-b667-4321-b27c-3b362d9fa549 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.296797 Apr 09 21:10:51.853749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3aa74054-1ebe-4341-bd30-8f57adb3af48 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.265168 Apr 09 21:10:51.861214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2294/4543] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:51 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:51.864953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2250/4544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:51 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:51.867781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:51.868460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:51.875422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.876339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.877208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:51.877625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:51.956670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.966820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.968934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:51.970225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3033532b-81d3-41a6-af0d-8fc4f88b0d71 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.107764 Apr 09 21:10:51.970810 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2295/4545] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:51 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:52.453261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:52.453931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:52.454979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:52.456852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:52.461469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.462161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.463428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.464029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.465205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.466436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.467394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.468384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.794917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:52.803049 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-362f59fa-59c5-49c8-a6e3-298a4123088f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.356742 Apr 09 21:10:52.803653 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2251/4546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:52 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:52.808651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5dfdaa94-d90e-41ef-a33f-a72031923c2d req-bcd1e8a2-3b01-4c3a-ac21-31b3f6962321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "da958d47-ba90-4946-a8c2-f3457704513e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:52.817495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5dfdaa94-d90e-41ef-a33f-a72031923c2d req-bcd1e8a2-3b01-4c3a-ac21-31b3f6962321 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.817946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5dfdaa94-d90e-41ef-a33f-a72031923c2d req-bcd1e8a2-3b01-4c3a-ac21-31b3f6962321 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.833206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:52.833408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5dfdaa94-d90e-41ef-a33f-a72031923c2d req-bcd1e8a2-3b01-4c3a-ac21-31b3f6962321 service nova] Creating event network-vif-plugged:da958d47-ba90-4946-a8c2-f3457704513e for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:52.838864 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5dfdaa94-d90e-41ef-a33f-a72031923c2d req-bcd1e8a2-3b01-4c3a-ac21-31b3f6962321 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Apr 09 21:10:52.839907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2252/4547] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:52.849651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:52.851411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:52.852948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-42652e42-dff9-4db7-89f0-7c07390ae62e tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.403781 Apr 09 21:10:52.853777 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2296/4548] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:52 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:52.874535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:52.878739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:52.879425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:52.880528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:52.890784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.891437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.892411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.893005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.893578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.894049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:52.894845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:52.895290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.200869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.209059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.210584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.211784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea94f5e3-5640-4c03-a0d9-a62b5600e796 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.352260 Apr 09 21:10:53.212371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2253/4549] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:52 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:53.225723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:53.226380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:53.244123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.244577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.245611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.246056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.265073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.286172 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-05939312-42aa-4094-b816-86398b3a96e5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.418789 Apr 09 21:10:53.288563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2297/4550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:52 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:53.360885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.371535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.373535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:53.374823 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3623715c-d55d-4e0b-9c51-49a8be807997 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.161515 Apr 09 21:10:53.376125 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2254/4551] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:53 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:53.819994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:53.820615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:53.829878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.830596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.831398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.831837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.873546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:53.874737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:53.881566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.882337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:53.883306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:53.883875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.309063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.317348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b014c2d3-3081-4be2-a7c3-06a310cfbb91 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.501307 Apr 09 21:10:54.317530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.318712 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2298/4552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:53 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:54.327248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.329009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.330387 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2208ff29-ba1e-4b6f-91cd-e88b82dce5fd tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.461914 Apr 09 21:10:54.331979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:54.332789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:54.339611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.340292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.341314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.341789 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2255/4553] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:53 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:54.342004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.347923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:54.348898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:54.361817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.362502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.363685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.364284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.630448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.638658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.640388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.641664 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60618201-7ad5-42aa-b685-daeb0a5edf16 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.321524 Apr 09 21:10:54.642321 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2299/4554] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:54 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:54.646843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:54.647756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:54.650033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.655025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.655550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.656582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.657131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.664033 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6e87008-cf2e-444e-a749-3e3907abd2ac tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.320705 Apr 09 21:10:54.664941 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2256/4555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:54 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:54.729920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.738404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.739906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:54.741070 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b350407c-6c70-4848-967a-f808e129bf7f tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.097811 Apr 09 21:10:54.741680 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2300/4556] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:54 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:54.865773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "795eaf94-b9aa-4494-8de0-8b62eecc59b1"}, {"server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "name": "network-vif-plugged", "status": "completed", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "ace7507d-dd06-475c-b999-2430bd431592"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "d2e847f7-3df6-4159-af29-b43d77f7ab51"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-plugged", "status": "completed", "tag": "1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7"}, {"server_uuid": "0f8926ba-de0b-42ed-9343-4f06f614270f", "name": "network-vif-plugged", "status": "completed", "tag": "fb082d76-dfa5-400a-8a59-2c435b48cf05"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:54.876954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:54.878171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:54.894868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:795eaf94-b9aa-4494-8de0-8b62eecc59b1 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:54.895524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:10:54.896170 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:ace7507d-dd06-475c-b999-2430bd431592 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:54.896687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:d2e847f7-3df6-4159-af29-b43d77f7ab51 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:54.897509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:10:54.898011 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] Creating event network-vif-plugged:fb082d76-dfa5-400a-8a59-2c435b48cf05 for instance 0f8926ba-de0b-42ed-9343-4f06f614270f on nch1-master-1 Apr 09 21:10:54.907867 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-12c59c21-c080-4031-90c5-fe640e6cee2b req-ef6992ad-3a5c-46c7-bce3-921bdbdde6fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.046210 Apr 09 21:10:54.909198 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2257/4557] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:55.334599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:55.335211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:55.342253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.342710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.343516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.344165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.350917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:55.351990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:55.358704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.359208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.360037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.360467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.608440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.616897 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e16749c-a131-4eca-91fa-7a2013d5f7b0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.286216 Apr 09 21:10:55.617796 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2301/4558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:55 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:55.633515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.642726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.644209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.645403 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a60aa580-03a4-48e5-9ef2-49beeb4373cb tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.299691 Apr 09 21:10:55.646299 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2258/4559] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:55 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:55.660293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:55.660946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:55.667380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.668050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.669095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.669536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.682704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:55.683759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:55.694630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.695946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.696903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.697756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.884754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.895432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.898718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.900192 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ebcc1f9d-01f4-4809-aa52-9d30e4efdbb5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.243811 Apr 09 21:10:55.911237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:55.911237 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e28972a8-2969-4944-9cb8-84468b5a73dd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1371 microversion: 2.1 time: 0.232530 Apr 09 21:10:55.913675 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2302/4560] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:55 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:55.919391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:55.920509 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2259/4561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:55 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:10:55.920929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:55.928049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.928505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:55.929328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:55.929827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.009528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.019561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.021177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.022721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5c3ce55-6a90-40ad-9328-cdacd9227d69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.107768 Apr 09 21:10:56.023460 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2303/4562] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:55 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:56.636055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:56.636607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:56.644018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.644449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.645510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.645955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.664762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:56.665692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:56.672835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.673334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.674115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.674551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.871980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.880927 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45467b11-8096-4bd3-b271-4f85e7ca943a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1368 microversion: 2.1 time: 0.249739 Apr 09 21:10:56.881550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2260/4563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:56 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:56.909488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.922150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.924672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:56.925321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:56.928677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:56.931740 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa6499c4-754b-493d-8a8a-5269e40d676f tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1875 microversion: 2.42 time: 0.271763 Apr 09 21:10:56.932504 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2304/4564] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:56 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1875 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:10:56.936566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.937365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.937853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:56.938568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:56.938916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.939521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.945770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.946554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:56.947592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:56.948046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.152913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.155572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.163277 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-16a99439-cf56-4aa4-af88-06525d81c496 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1566 microversion: 2.1 time: 0.229456 Apr 09 21:10:57.164488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.165974 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2305/4565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:56 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:57.166558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.168035 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c2dabc3-9d56-4ac7-8e29-520413c2c072 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.251741 Apr 09 21:10:57.168760 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2261/4566] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:56 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:57.175602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:57.176478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:57.184108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:57.184630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:57.187664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.188396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.189464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.190153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.190926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.191387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.192173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.192611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.299589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.310933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.313490 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0e67dbd-faa4-44bc-a3ff-304dec8fc3d0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133856 Apr 09 21:10:57.317129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:57.321753 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a01283f-7ee9-451e-8af7-29e481648018 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.153792 Apr 09 21:10:57.323107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2262/4567] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:10:57 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:57.330629 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2306/4568] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:57 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:57.899283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:57.899928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:57.906410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.906958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.907791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.908229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.951006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:57.951673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:57.958850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.959307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:57.960152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:57.960494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.127429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.135894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d60bf7b-a90b-41a1-8039-f547255e6472 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1557 microversion: 2.1 time: 0.241136 Apr 09 21:10:58.136477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2263/4569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:10:57 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:10:58.153399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:58.154312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:58.160964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.161724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.162611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.163116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.178267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.189255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.191014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.192450 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-048758e6-272d-4521-9cf9-40d64bb4fb31 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2830 microversion: 2.42 time: 0.245455 Apr 09 21:10:58.200854 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2307/4570] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:57 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2830 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:58.200854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:58.200854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:58.205794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.206245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.207035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.207474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.266636 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-637aaac0-4232-46fe-8f09-1a4b511b8012 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117451 Apr 09 21:10:58.267543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2264/4571] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:10:58 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:10:58.272231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:58.273278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:58.282264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.283238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.284989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.284989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.516801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-058bcdac-5d57-42c1-b7c8-fd4266c0e5c7 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.248302 Apr 09 21:10:58.517975 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2265/4572] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:10:58 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16/os-interface => generated 1828 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:58.523456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:58.524194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:58.531596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.532339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.533419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:58.534083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:58.579940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.596485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.598383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.599769 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c923a116-f9bf-43fb-ae0e-9fa59cf60fd1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.404994 Apr 09 21:10:58.600512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2308/4573] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:58 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:58.703030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.716850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.718669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:58.720181 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e715879b-96a3-42dd-9402-2996096660f4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.201027 Apr 09 21:10:58.721402 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2266/4574] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:58 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:59.618371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:59.619011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:59.626529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:59.626980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:59.627767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:59.628206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:59.741339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:10:59.742432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:10:59.751109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:59.751827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:59.753065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:59.754004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:59.916639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:59.925509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:59.934372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:10:59.938008 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-702cb86b-1337-475f-83d2-3f1a911f9f93 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.200386 Apr 09 21:10:59.943100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2267/4575] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:59 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:10:59.948382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2e666f6e-4e99-4a78-9598-c81c2cc0e974 req-e5bea65b-4411-4005-9603-7b9041d059fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:10:59.970786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2e666f6e-4e99-4a78-9598-c81c2cc0e974 req-e5bea65b-4411-4005-9603-7b9041d059fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:10:59.971547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2e666f6e-4e99-4a78-9598-c81c2cc0e974 req-e5bea65b-4411-4005-9603-7b9041d059fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:10:59.990689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2e666f6e-4e99-4a78-9598-c81c2cc0e974 req-e5bea65b-4411-4005-9603-7b9041d059fd service nova] Creating event network-changed:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:11:00.010931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2e666f6e-4e99-4a78-9598-c81c2cc0e974 req-e5bea65b-4411-4005-9603-7b9041d059fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066091 Apr 09 21:11:00.011848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2268/4576] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:00.071630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:00.085583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:00.087619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:00.089661 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a37a84e9-0fc2-4cfc-8baa-c2668435b544 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.475213 Apr 09 21:11:00.102743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2309/4577] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:10:59 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:00.544403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e15e8fd9-086e-4dd2-bfe6-6b7d6695d425 req-051daeba-e6f2-4b3a-a151-82efa65ce059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8926ba-de0b-42ed-9343-4f06f614270f", "tag": "fb082d76-dfa5-400a-8a59-2c435b48cf05"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:00.554463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e15e8fd9-086e-4dd2-bfe6-6b7d6695d425 req-051daeba-e6f2-4b3a-a151-82efa65ce059 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:00.554918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e15e8fd9-086e-4dd2-bfe6-6b7d6695d425 req-051daeba-e6f2-4b3a-a151-82efa65ce059 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:00.571352 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e15e8fd9-086e-4dd2-bfe6-6b7d6695d425 req-051daeba-e6f2-4b3a-a151-82efa65ce059 service nova] Creating event network-changed:fb082d76-dfa5-400a-8a59-2c435b48cf05 for instance 0f8926ba-de0b-42ed-9343-4f06f614270f on nch1-master-1 Apr 09 21:11:00.586814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e15e8fd9-086e-4dd2-bfe6-6b7d6695d425 req-051daeba-e6f2-4b3a-a151-82efa65ce059 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151748 Apr 09 21:11:00.594210 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2269/4578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:00.958667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:00.959413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:00.990212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:00.990984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:00.993261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:00.997544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:01.111821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:01.114387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:01.131213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:01.131983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:01.133779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:01.136106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:01.232580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.251363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.266198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.278905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5574e524-4e4f-42ef-88a6-b2766dc0038b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.324347 Apr 09 21:11:01.279809 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2310/4579] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:00 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:01.666278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.679988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.684074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:01.685940 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9cd8bdc-a6f7-446f-9dc8-12dae3593232 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.580112 Apr 09 21:11:01.686790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2270/4580] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:01 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:02.055381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-fd9b0391-6360-4cbc-9e3b-ffd2194cb969 req-09287afc-b245-4c4c-ab3e-aa2a8254596e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "tag": "da958d47-ba90-4946-a8c2-f3457704513e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:02.064722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fd9b0391-6360-4cbc-9e3b-ffd2194cb969 req-09287afc-b245-4c4c-ab3e-aa2a8254596e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:02.065202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-fd9b0391-6360-4cbc-9e3b-ffd2194cb969 req-09287afc-b245-4c4c-ab3e-aa2a8254596e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:02.077216 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-fd9b0391-6360-4cbc-9e3b-ffd2194cb969 req-09287afc-b245-4c4c-ab3e-aa2a8254596e service nova] Creating event network-changed:da958d47-ba90-4946-a8c2-f3457704513e for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:11:02.082974 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-fd9b0391-6360-4cbc-9e3b-ffd2194cb969 req-09287afc-b245-4c4c-ab3e-aa2a8254596e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031397 Apr 09 21:11:02.083762 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2311/4581] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:02.298281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:02.298904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:02.308116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:02.308567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:02.309388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:02.310755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:02.516878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.527576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.529488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.531721 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ebda8647-72df-46fb-b345-faada92e33ef tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.236621 Apr 09 21:11:02.532967 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2271/4582] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:02 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:02.708080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:02.708795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:02.721139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:02.725784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:02.727162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:02.727939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:02.946819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.955633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.958113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:02.959498 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6110d4fd-0bb3-4e60-947d-0d5048506e90 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.256828 Apr 09 21:11:02.960249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2312/4583] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:02 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:03.551481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:03.552307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:03.559528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:03.560157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:03.561067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:03.561638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:03.637134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:03.649433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:03.652351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:03.653783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f93785c6-88f4-47d3-a9dc-1f3569f11053 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1365 microversion: 2.47 time: 0.106689 Apr 09 21:11:03.655040 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2272/4584] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:03 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:03.978960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:03.979573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:03.986842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:03.987300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:03.988079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:03.988520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:04.323902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-968a667f-193d-4bda-911f-8eb920d4a5be req-2c032d3a-7ddc-45fb-9287-6c661e5e0fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "name": "network-vif-plugged", "status": "completed", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:04.339177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-968a667f-193d-4bda-911f-8eb920d4a5be req-2c032d3a-7ddc-45fb-9287-6c661e5e0fdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:04.340191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-968a667f-193d-4bda-911f-8eb920d4a5be req-2c032d3a-7ddc-45fb-9287-6c661e5e0fdb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:04.355516 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-968a667f-193d-4bda-911f-8eb920d4a5be req-2c032d3a-7ddc-45fb-9287-6c661e5e0fdb service nova] Creating event network-vif-plugged:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:11:04.362809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-968a667f-193d-4bda-911f-8eb920d4a5be req-2c032d3a-7ddc-45fb-9287-6c661e5e0fdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047642 Apr 09 21:11:04.363986 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2273/4585] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:04.425090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.433230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.436635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.438163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a56c9dd8-ffb4-416e-a8ed-8befef2d2d99 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.463289 Apr 09 21:11:04.438945 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2313/4586] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:03 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:04.674778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:04.675447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:04.682754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:04.683208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:04.684010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:04.684703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:04.754625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.763166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.764747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:04.765990 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81834d88-607c-4a7a-8be3-896a586e6c69 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1371 microversion: 2.47 time: 0.097575 Apr 09 21:11:04.766535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2274/4587] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:04 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:05.457122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:05.458349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:05.465140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:05.465816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:05.466824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:05.467224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:05.608827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.619227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.620728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.622136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-376312c8-b076-4fb6-9b40-0c5b169405bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.169973 Apr 09 21:11:05.622700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2314/4588] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:05 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:05.785593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:05.786238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:05.792692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:05.793169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:05.793950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:05.794388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:05.869737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.879434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.880948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:05.892939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f4d7c53-1538-4d8a-b147-cd4a9b47f1d6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1371 microversion: 2.47 time: 0.100624 Apr 09 21:11:05.892939 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2275/4589] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:05 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:06.641756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:06.642994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:06.650471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:06.651874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:06.653082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:06.653690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:06.801489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.809463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.810983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.812261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f99a6fdc-1ae5-4183-996c-e8a7bdf76a6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.175268 Apr 09 21:11:06.812838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2315/4590] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:06 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:06.900602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:06.901209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:06.908302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:06.908480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:06.909261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:06.909699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:06.973848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.983251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.984761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:06.986107 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff167174-3be0-4305-bf32-0d7ff8eb1fb6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1371 microversion: 2.47 time: 0.089493 Apr 09 21:11:06.986685 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2276/4591] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:06 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:07.832492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:07.833380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:07.840511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:07.840953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:07.842031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:07.842485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:07.983921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:07.992542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:07.994069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:07.995217 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf2694b8-7e29-4b56-aba4-a3c4b2cf8cae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1747 microversion: 2.20 time: 0.167968 Apr 09 21:11:07.995836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2316/4592] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:07 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:08.003966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:08.004804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:08.011612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:08.012208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:08.012990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:08.013459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:08.083651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:08.093388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:08.099903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:08.101223 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-50360db4-01a5-4d00-a704-6cf7c502eed5 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1371 microversion: 2.47 time: 0.101336 Apr 09 21:11:08.101809 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2277/4593] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:07 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:09.014705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:09.016104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:09.026595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.029134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.044081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.045139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.124628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:09.125498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:09.138800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.139567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.140466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.141338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.254583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.264573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.270977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.272222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b8e04ec-5f76-4645-9a3c-ab099a16e142 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1356 microversion: 2.47 time: 0.154069 Apr 09 21:11:09.276804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2278/4594] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:09 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:09.290953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.296175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:09.302021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.303063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Searching by: {'deleted': False, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c'} {{(pid=141819) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:11:09.304778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.306824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.308630 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e16acc8a-c5e4-4796-825f-46066477db08 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.298225 Apr 09 21:11:09.309344 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2317/4595] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:09 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:09.311605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.312439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.313428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.314042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.496070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.multi_cell_list [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:11:09.593609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.603173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.604827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.617073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.618635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:09.675745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef8ec2e7-d734-4621-a491-b5c5add9c9c6 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.387350 Apr 09 21:11:09.676503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2279/4596] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Apr 9 21:11:09 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:09.704728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:09.707389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:09.725185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.725723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.726579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.727333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.757937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:11:09.911655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d0ba6403-af97-43c8-b12c-cf802065726c tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 204 len: 0 microversion: 2.47 time: 0.212662 Apr 09 21:11:09.916925 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2318/4597] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:11:09 2022] DELETE /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:11:09.924467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:09.925169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:09.939917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.941408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:09.944114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:09.944637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:10.051896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.069937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.071960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.073682 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-60937bfc-d0d9-46ef-964e-e518d9a43e9b tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1362 microversion: 2.47 time: 0.155069 Apr 09 21:11:10.082610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2280/4598] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:09 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:10.329352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:10.330736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:10.339427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:10.340199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:10.341246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:10.342159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:10.560360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.570381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.571886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:10.573134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-115a1f2a-b06a-45b2-a767-c7e28261deb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.248619 Apr 09 21:11:10.573712 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2319/4599] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:10 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:11.094450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:11.095178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:11.117963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:11.118430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:11.127651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:11.129615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:11.227094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.236468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.238331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.239711 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-944b45ca-393d-4fc3-9dff-57b823d073a4 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1362 microversion: 2.47 time: 0.150977 Apr 09 21:11:11.240746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2281/4600] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:11 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:11.592673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:11.593403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:11.616721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:11.617220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:11.618179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:11.618929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:11.844101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.860005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.864022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:11.866674 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b4e97430-58c6-4b94-ac5a-fbe7ea9ac2b8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.278036 Apr 09 21:11:11.880494 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2320/4601] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:11 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:12.258312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:12.258942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:12.267691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:12.268409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:12.269235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:12.269665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:12.304568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:12.305321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:12.306145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lazy-loading 'fault' on Instance uuid f76c4dc0-e509-48a8-ba4e-b686e299fa74 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:11:12.368239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:12.386418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:12.388226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:12.393359 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd10b860-0e2a-4f8c-ab08-cc91b3b5a2da tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 200 len: 1367 microversion: 2.47 time: 0.138849 Apr 09 21:11:12.395443 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2282/4602] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:12 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 1367 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:12.889084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:12.889084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:12.896418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:12.896876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:12.897717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:12.898158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.124202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.135241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.142721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.147535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7276d71-d68a-4778-b40f-0bf1cf736c12 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.264056 Apr 09 21:11:13.148859 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2321/4603] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:12 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:13.422669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:13.429282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: f76c4dc0-e509-48a8-ba4e-b686e299fa74] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:13.447030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.447739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.449007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.449614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.479421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] HTTP exception thrown: Instance f76c4dc0-e509-48a8-ba4e-b686e299fa74 could not be found. Apr 09 21:11:13.480220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Returning 404 to user: Instance f76c4dc0-e509-48a8-ba4e-b686e299fa74 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:13.482241 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1826f28-65ef-4139-9409-16edf7a29363 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74" status: 404 len: 111 microversion: 2.47 time: 0.073446 Apr 09 21:11:13.490206 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2283/4604] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:13 2022] GET /compute/v2.1/servers/f76c4dc0-e509-48a8-ba4e-b686e299fa74 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:11:13.495129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:13.495761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:13.507959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.511101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.512044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.512619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.569368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:11:13.750138 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c24143cb-8346-427d-8728-5685330bd7b2 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "DELETE /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 204 len: 0 microversion: 2.47 time: 0.259211 Apr 09 21:11:13.750957 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2322/4605] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:11:13 2022] DELETE /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:11:13.763025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:13.764291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:13.774528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.780627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.781802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:13.782409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:13.888980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.899699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.912898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:13.914182 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e1dee85-9249-40de-aba9-5a8114123bca tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 200 len: 1363 microversion: 2.47 time: 0.158851 Apr 09 21:11:13.914756 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2284/4606] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:13 2022] GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:14.168204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:14.169342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:14.181763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:14.186309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:14.187531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:14.188222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:14.525947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:14.542169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:14.544210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:14.545873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f27e4ff5-89ed-466f-ac0d-3ae181c482f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.382412 Apr 09 21:11:14.550358 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2323/4607] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:14 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:14.933856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:14.935085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:14.945367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:14.946120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:14.947105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:14.947700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:15.058465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.067938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.069938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.071338 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-531c3056-faf8-4016-87e0-e9aea62b54e9 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 200 len: 1363 microversion: 2.47 time: 0.143049 Apr 09 21:11:15.072427 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2285/4608] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:14 2022] GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:15.572876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:15.573520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:15.580779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:15.583992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:15.585305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:15.599041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:15.887735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.898647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.900567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:15.902249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-63416ba3-4dc0-4f31-b017-3bb61c9b6371 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.337877 Apr 09 21:11:15.904315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2324/4609] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:15 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:16.089483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:16.090345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:16.104555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:16.107074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:16.108113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:16.113803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:16.179221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:16.180752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:16.183741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lazy-loading 'fault' on Instance uuid 25ae3d49-bdcd-436b-9b63-0dc338f7964e {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:11:16.353140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:16.365532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:16.367282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b23242fec34285bfd83a86ae3cc847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc556aaca1864bec914c801ea06a2c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:16.376961 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16ab1f42-faee-4bee-aee1-28a7e1dda080 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 200 len: 1368 microversion: 2.47 time: 0.291569 Apr 09 21:11:16.377651 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2286/4610] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:16 2022] GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:16.924012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:16.924975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:16.948005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:16.949304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:16.950536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:16.951339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:17.204989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:17.213870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:17.215395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:17.216812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ad1d50d-1676-425c-96cd-2b7071c3a7a1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.298222 Apr 09 21:11:17.218041 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2325/4611] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:16 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:17.397331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:17.398153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] [instance: 25ae3d49-bdcd-436b-9b63-0dc338f7964e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:17.405398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:17.406164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:17.407168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:17.407794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:17.422996 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] HTTP exception thrown: Instance 25ae3d49-bdcd-436b-9b63-0dc338f7964e could not be found. Apr 09 21:11:17.424016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] Returning 404 to user: Instance 25ae3d49-bdcd-436b-9b63-0dc338f7964e could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:17.425029 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-912c1a7e-5eef-4341-badb-9a75e4adf6d7 tempest-ServerShowV247Test-2059157528 tempest-ServerShowV247Test-2059157528-project] 10.222.0.30 "GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e" status: 404 len: 111 microversion: 2.47 time: 0.031798 Apr 09 21:11:17.425785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2287/4612] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:17 2022] GET /compute/v2.1/servers/25ae3d49-bdcd-436b-9b63-0dc338f7964e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:11:18.237958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:18.238593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:18.252622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:18.253380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:18.256550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:18.257005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:18.490275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:18.505985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:18.507865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:18.510163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c8047c5-c5d9-475c-8d6e-268cd47c1d5e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.277348 Apr 09 21:11:18.511326 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2326/4613] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:18 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:19.531773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:19.532428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:19.547059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:19.547511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:19.548305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:19.548737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:19.840915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:19.860642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:19.863282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:19.870628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-874befe5-f82f-4c2a-a689-6b8e6020d9e2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.337026 Apr 09 21:11:19.892575 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2288/4614] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:19 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:20.491027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Action: 'create', calling method: .version_select at 0x7fb08ee62550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-422299635"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:20.896689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:20.898244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:20.915408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:20.915779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:20.917901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:20.920746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:21.082765 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.943230 Apr 09 21:11:21.083407 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2327/4615] 10.222.0.30 () {60 vars in 1154 bytes} [Sat Apr 9 21:11:20 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 945 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 09 21:11:21.094993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2774b83f-af17-48cc-a38b-98ae3ff465e4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08ec54940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:21.218262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2774b83f-af17-48cc-a38b-98ae3ff465e4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 200 len: 337 microversion: 2.1 time: 0.127036 Apr 09 21:11:21.219136 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2328/4616] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:11:21 2022] GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 337 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:11:21.243555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:21.261014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:21.262526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:21.263707 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c36f668-864d-499b-a5bd-359559536fb0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.371347 Apr 09 21:11:21.269819 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2289/4617] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:20 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:22.231778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9cd4923-f98a-43e1-aee9-d9ac2a6ea1a2 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08ec4e940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:22.286853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:22.288666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:22.324640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:22.329272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:22.332636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:22.333608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:22.364766 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9cd4923-f98a-43e1-aee9-d9ac2a6ea1a2 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 200 len: 338 microversion: 2.1 time: 0.137946 Apr 09 21:11:22.371692 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2329/4618] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:11:22 2022] GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:22.377108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff953875-3901-41e3-8038-088d8146c55c tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Action: 'create', calling method: .version_select at 0x7fb08edde9d0>, body: {"snapshot": {"volume_id": "6763abd8-48b1-498b-a4db-0761a497ffe0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1408789563"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:22.642862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:22.660558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:22.666051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:22.667607 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1101b6c-7a18-48e7-854a-35a95bdda1bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.386424 Apr 09 21:11:22.700071 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2290/4619] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:22 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:22.763760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff953875-3901-41e3-8038-088d8146c55c tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.390740 Apr 09 21:11:22.764967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2330/4620] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Apr 9 21:11:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:22.775989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6fd061be-b03f-4d49-b51e-05ea84136819 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08efc2700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:22.862868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6fd061be-b03f-4d49-b51e-05ea84136819 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 200 len: 287 microversion: 2.1 time: 0.091385 Apr 09 21:11:22.864882 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2291/4621] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:11:22 2022] GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:22.878337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad21ff0d-07e0-4b91-a105-5b42e48a119f tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08edde3a0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:22.950333 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad21ff0d-07e0-4b91-a105-5b42e48a119f tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.077418 Apr 09 21:11:22.952265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2331/4622] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:11:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:23.098572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c62cd8f-f516-4c6b-8f56-bdc9e9962f17 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f5aa280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:23.195893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c62cd8f-f516-4c6b-8f56-bdc9e9962f17 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 200 len: 287 microversion: 2.1 time: 0.110662 Apr 09 21:11:23.202052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2292/4623] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:11:23 2022] GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:23.689322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:23.690638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:23.723956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:23.724656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:23.725497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:23.725940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:23.927155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:23.941918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:23.950972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:23.952608 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2a574c8-4626-41c3-8c7f-fd08b749118d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1742 microversion: 2.20 time: 0.267055 Apr 09 21:11:23.957167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2332/4624] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:23 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1742 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:24.209538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-66fc0e3f-525a-44e5-9d45-a6c4a010b2aa tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f161550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:24.244508 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-66fc0e3f-525a-44e5-9d45-a6c4a010b2aa tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 200 len: 288 microversion: 2.1 time: 0.039807 Apr 09 21:11:24.245313 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2293/4625] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:11:24 2022] GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:24.255867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08edde700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:24.326729 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 202 len: 0 microversion: 2.1 time: 0.074552 Apr 09 21:11:24.331492 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2333/4626] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:11:24 2022] DELETE /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:11:24.340228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-846c62c3-df9a-4705-82e2-f6e8811ca8df tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f5aa310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:24.376716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-846c62c3-df9a-4705-82e2-f6e8811ca8df tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 200 len: 287 microversion: 2.1 time: 0.044714 Apr 09 21:11:24.377516 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2294/4627] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:11:24 2022] GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:24.983611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:24.985009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:25.006315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:25.006990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:25.008108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:25.008719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:25.226049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:25.235722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:25.241012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:25.242794 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c4a98b8d-dc25-4ed6-a65a-3c8fa18e607c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1724 microversion: 2.20 time: 0.273945 Apr 09 21:11:25.253703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2334/4628] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:24 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:25.392565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-91dc3b13-b77a-472d-b264-8b640eb7abd4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f0f0550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:25.423621 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-91dc3b13-b77a-472d-b264-8b640eb7abd4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] HTTP exception thrown: Snapshot 13f5ae3d-c0d2-4bc5-80d5-d02601875e88 could not be found. Apr 09 21:11:25.424465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-91dc3b13-b77a-472d-b264-8b640eb7abd4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Returning 404 to user: Snapshot 13f5ae3d-c0d2-4bc5-80d5-d02601875e88 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:25.426158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-91dc3b13-b77a-472d-b264-8b640eb7abd4 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88" status: 404 len: 111 microversion: 2.1 time: 0.039255 Apr 09 21:11:25.430059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2295/4629] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:11:25 2022] GET /compute/v2.1/os-snapshots/13f5ae3d-c0d2-4bc5-80d5-d02601875e88 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:11:25.437976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0b2b78b6-47ee-48a6-909b-846e7a22db98 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08edde940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:25.544660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0b2b78b6-47ee-48a6-909b-846e7a22db98 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 202 len: 0 microversion: 2.1 time: 0.111429 Apr 09 21:11:25.557656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2335/4630] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:11:25 2022] DELETE /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:11:25.558496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c22a8c42-1e37-4e3a-af6f-75b843625704 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f0f0790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:25.665254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c22a8c42-1e37-4e3a-af6f-75b843625704 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 200 len: 337 microversion: 2.1 time: 0.113397 Apr 09 21:11:25.671245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2296/4631] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:11:25 2022] GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:26.280298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:26.281066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:26.293613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:26.294114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:26.294924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:26.295401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:26.487055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:26.497538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:26.499512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:26.501350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9367ea50-3992-4b99-b03f-9d11c664b1d1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1724 microversion: 2.20 time: 0.238375 Apr 09 21:11:26.502538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2336/4632] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:26 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:26.679802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a6d7c63-f357-45c7-a4c7-8432a075aa4d tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08ec020d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:26.713304 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8a6d7c63-f357-45c7-a4c7-8432a075aa4d tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] HTTP exception thrown: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. Apr 09 21:11:26.713943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a6d7c63-f357-45c7-a4c7-8432a075aa4d tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Returning 404 to user: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:26.715025 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a6d7c63-f357-45c7-a4c7-8432a075aa4d tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 404 len: 109 microversion: 2.1 time: 0.040170 Apr 09 21:11:26.716071 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2297/4633] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:11:26 2022] GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:11:26.729128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01b4f094-621c-4a6d-a0f7-ab35fc736978 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08eabb550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:26.761449 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-01b4f094-621c-4a6d-a0f7-ab35fc736978 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] HTTP exception thrown: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. Apr 09 21:11:26.762544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01b4f094-621c-4a6d-a0f7-ab35fc736978 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Returning 404 to user: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:26.765733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01b4f094-621c-4a6d-a0f7-ab35fc736978 tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 404 len: 109 microversion: 2.1 time: 0.040499 Apr 09 21:11:26.773020 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2337/4634] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:11:26 2022] DELETE /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:11:26.778954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b642083e-17f7-4e04-8ed1-8d6391f491af tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Calling method '.version_select at 0x7fb08f2960d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:26.816695 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b642083e-17f7-4e04-8ed1-8d6391f491af tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] HTTP exception thrown: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. Apr 09 21:11:26.817960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b642083e-17f7-4e04-8ed1-8d6391f491af tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] Returning 404 to user: Volume 6763abd8-48b1-498b-a4db-0761a497ffe0 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:26.818955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b642083e-17f7-4e04-8ed1-8d6391f491af tempest-VolumesSnapshotsTestJSON-718841488 tempest-VolumesSnapshotsTestJSON-718841488-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0" status: 404 len: 109 microversion: 2.1 time: 0.044778 Apr 09 21:11:26.819596 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2298/4635] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:11:26 2022] GET /compute/v2.1/os-volumes/6763abd8-48b1-498b-a4db-0761a497ffe0 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:11:27.528303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:27.529940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:27.540894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:27.541983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:27.543258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:27.543911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:27.795983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:27.809340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:27.811229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:27.812574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff2fa9aa-44e9-43b4-a3eb-0b05a15c4707 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1727 microversion: 2.20 time: 0.296052 Apr 09 21:11:27.813161 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2338/4636] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:27 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1727 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:27.833079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c7031ef-4247-461a-a5ca-e53470449307"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:27.834916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:27.851613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:27.852153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:27.853011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:27.853720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:28.379417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b92d60b-1531-44b2-b68d-4c5ff2a07b0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.548141 Apr 09 21:11:28.404750 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2299/4637] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Apr 9 21:11:27 2022] POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments => generated 188 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:11:28.621665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:28.626369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:28.681848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:28.685002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:28.686016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:28.686785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:28.998338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9d62c796-b638-4206-a698-168c1069e5ce req-9ca78a8c-962a-444a-9003-c4d248fcb252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "name": "network-vif-unplugged", "status": "completed", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:29.020770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9d62c796-b638-4206-a698-168c1069e5ce req-9ca78a8c-962a-444a-9003-c4d248fcb252 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:29.021333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9d62c796-b638-4206-a698-168c1069e5ce req-9ca78a8c-962a-444a-9003-c4d248fcb252 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:29.036261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.server_external_events [req-9d62c796-b638-4206-a698-168c1069e5ce req-9ca78a8c-962a-444a-9003-c4d248fcb252 service nova] Unable to find a host for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3. Dropping event network-vif-unplugged {{(pid=141819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 09 21:11:29.037716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9d62c796-b638-4206-a698-168c1069e5ce req-9ca78a8c-962a-444a-9003-c4d248fcb252 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048228 Apr 09 21:11:29.038927 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2300/4638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 21:11:29.157867 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/action" status: 202 len: 0 microversion: 2.20 time: 0.552441 Apr 09 21:11:29.177701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2339/4639] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:11:28 2022] POST /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:11:29.186791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:29.187556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:29.207984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:29.211798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:29.224719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:29.226233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:29.576832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:29.614392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:29.616166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:29.625374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0309cf9e-c53c-4b67-a32a-98490b1c251b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1753 microversion: 2.20 time: 0.441188 Apr 09 21:11:29.628130 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2301/4640] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:29 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:30.647674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:30.648448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:30.656899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:30.661781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:30.664455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:30.665773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:31.608979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:31.625293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:31.628697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:31.637595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b56bcec7-3b8b-4c2d-8951-ab11fa836060 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1755 microversion: 2.20 time: 0.991885 Apr 09 21:11:31.638671 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2340/4641] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:30 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1755 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:32.662852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:32.663753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:32.687474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:32.688731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:32.691441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:32.693960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:32.888681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:32.903747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:32.906490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:32.912092 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da5fe49d-acfe-4765-8356-f4298abcde9e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.254426 Apr 09 21:11:32.914016 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2302/4642] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:32 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:33.939532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:33.941524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:33.950355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:33.953509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:33.954915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:33.955602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:34.225099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:34.242665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:34.244825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:34.246657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ab374f3-14fa-4b82-aa5c-98e549eeb6bb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.317781 Apr 09 21:11:34.261638 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2341/4643] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:33 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:35.268978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:35.270420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:35.280722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:35.290021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:35.291324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:35.292008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:35.699496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:35.713872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:35.717808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:35.720410 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c4b3e02-0a4a-41f8-aa4f-4d2460ca4b18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.455378 Apr 09 21:11:35.721481 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2303/4644] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:35 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:36.522804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b07460f-352b-42de-aaa6-13f4befc338a"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:36.525961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:36.562816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:36.563592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:36.566923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:36.567654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:36.748421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:36.749905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:36.773681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:36.775637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:36.778801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:36.781016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:37.116640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600506 Apr 09 21:11:37.118142 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2342/4645] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:11:36 2022] POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:37.140135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:37.146512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:37.151462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:37.158376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:37.159705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:37.160405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:37.198050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:37.225474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:37.237263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:37.240572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8854b2c5-5e8a-4998-890f-780ed7bf2d00 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/ips" status: 200 len: 149 microversion: 2.1 time: 0.104981 Apr 09 21:11:37.244549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-baa27352-133e-4ec7-91b9-001c5d176f1e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.504566 Apr 09 21:11:37.246320 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2304/4646] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:36 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:37.250911 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2343/4647] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:11:37 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:38.268523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:38.274399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:38.302427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:38.309133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:38.317287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:38.319570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:38.988495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:39.010230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:39.018272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:39.025212 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dc9fb6e-7df4-4609-bdfc-f212721c74fc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.764411 Apr 09 21:11:39.039845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2305/4648] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:38 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:39.371266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfadbca7-6ec2-4a80-84f2-c2e391afc3f4"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:39.373186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:39.403394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:39.404151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:39.404909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:39.409146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:40.047844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:40.048502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:40.073236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:40.079408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:40.090187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:40.093291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:40.100460 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b63b969-856c-4c88-938c-1a83c642ab5b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733182 Apr 09 21:11:40.106342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2344/4649] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:11:39 2022] POST /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:11:40.460146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:40.487296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:40.490548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:40.494147 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-83ff27ad-582e-4ebb-a7b0-8e635eebd8f5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.450649 Apr 09 21:11:40.499407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2306/4650] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:40 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:40.916701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:40.918839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:40.946523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:40.951439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:40.955753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:40.957311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:41.034250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'flavor' on Instance uuid 9fbe99a0-a85a-4094-9a27-86d412fa4620 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:11:41.382193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6c50048-8825-4472-9a7f-cd28ab78bb1d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/action" status: 200 len: 32 microversion: 2.1 time: 0.470713 Apr 09 21:11:41.383728 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2345/4651] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:11:40 2022] POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:11:41.393616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:41.396057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:41.412842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:41.413878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:41.418932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:41.421072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:41.518512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:41.519528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:41.530150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:41.530876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:41.532008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:41.532618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:42.356063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:42.379053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:42.384841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:42.389323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1eef9ed-e301-402c-85d0-1f565cc483cf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.875104 Apr 09 21:11:42.390507 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2346/4652] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:41 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:42.496689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:42.513997 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4e3a458-eb8e-429e-b0a7-919b239216be tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 1.120992 Apr 09 21:11:42.515359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2307/4653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:41 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:43.414324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:43.416283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:43.444449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:43.446674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:43.449408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:43.450221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:43.538804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:43.539441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:43.573441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:43.577653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:43.580553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:43.583604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:44.542716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:44.555902 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ef6d430-fdb1-46bb-89f7-d3f40e6527d2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 1.026165 Apr 09 21:11:44.557435 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2308/4654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:43 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:44.632045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:44.643330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:44.647289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:44.656602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-716543f8-73d7-424b-a3ad-468b21de980e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 1.252119 Apr 09 21:11:44.657753 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2347/4655] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:43 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:44.884876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: .version_select at 0x7fb08e2628b0>, body: {"keypair": {"name": "tempest-keypair-595748399"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:44.915435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:11:44.924584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:11:45.132037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:11:45.139585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:11:45.160441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7820899-502d-4512-bced-c0a06fe17b23 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.279745 Apr 09 21:11:45.161712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2309/4656] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:11:44 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:45.576118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:45.576837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:45.595858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:45.596571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:45.597888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:45.611847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:45.677464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:45.678865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:45.690004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:45.696360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:45.702677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:45.703518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:46.486606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:46.499798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:46.504010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:46.506338 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db23b199-c39a-4c59-b430-fc6320d1a123 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.833635 Apr 09 21:11:46.510582 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2310/4657] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:45 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:46.576545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:46.603125 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1042a9e-1e75-49a8-b4c9-b7fb936c803b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 1.027836 Apr 09 21:11:46.618934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2348/4658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:45 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:47.528835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:47.530264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:47.544511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:47.548519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:47.551072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:47.551713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:47.621337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:47.621990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:47.639682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:47.641598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:47.643119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:47.644131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:47.992520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:48.011151 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fd9ddde-927b-4327-8530-127ca6fc4f67 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.393711 Apr 09 21:11:48.012547 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2349/4659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:47 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:11:48.139748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:48.155824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:48.161711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:48.163953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1aa415f5-c14e-4673-a68e-5ea836a51376 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.639823 Apr 09 21:11:48.164772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2311/4660] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:47 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:49.031964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:49.032496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:49.042460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:49.043316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:49.063702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:49.064480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:49.186726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:49.189164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:49.198965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:49.205807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:49.206915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:49.207367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:49.319996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:49.331143 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d5b0943-079f-4c12-a8c8-7137fcbe463c tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.303367 Apr 09 21:11:49.337497 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2350/4661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:49 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:49.386722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-764055057", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7"}], "security_groups": [{"name": "tempest-securitygroup--1826637446"}], "key_name": "tempest-keypair-595748399", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:49.426664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:49.436005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:49.442917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:49.444232 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb0ff3cf-023e-423d-a977-c693fe9b24a7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.265265 Apr 09 21:11:49.446379 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2312/4662] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:49 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:49.516016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] validate_networks() for [('f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:11:50.036102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:11:50.036695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:11:50.037300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:11:50.037936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:11:50.038498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:11:50.051466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.051923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.052783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.053351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.074723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:11:50.080540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:11:50.094502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:11:50.096891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:11:50.178402 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f939821-c177-4564-a7d7-29379e72fa83 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.797334 Apr 09 21:11:50.183069 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2351/4663] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:11:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:11:50.195816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c0bfb11f-dae8-4cd7-9a1c-3dd1c4f67a76 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:50.196758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c0bfb11f-dae8-4cd7-9a1c-3dd1c4f67a76 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:50.311019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c0bfb11f-dae8-4cd7-9a1c-3dd1c4f67a76 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:50.318707 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c0bfb11f-dae8-4cd7-9a1c-3dd1c4f67a76 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1240 microversion: 2.1 time: 0.127828 Apr 09 21:11:50.320460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2313/4664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:50 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:50.355894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:50.356519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:50.366515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.367110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.367761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.368208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.463902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:50.464719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:50.476803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.477648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.478725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:50.479557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:50.733302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:50.751897 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f91a8fe-3f74-46bb-8590-56c2fc43003b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.400383 Apr 09 21:11:50.753178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2352/4665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:50 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:50.772320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:50.783782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:50.785616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:50.787004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75e20735-b30c-4736-a5ad-be5f6db501b9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.328154 Apr 09 21:11:50.805003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2314/4666] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:50 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:51.337336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:51.337960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:51.354480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.355393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:51.356385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.357058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:51.433112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:51.443075 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4c12aa59-f7ba-4809-a35f-484eba884979 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1244 microversion: 2.1 time: 0.110315 Apr 09 21:11:51.447079 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2353/4667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:51 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:51.771565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:51.772209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:51.780764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.781497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:51.782478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.783270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:51.811321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:51.812187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:51.820467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.820914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:51.821985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:51.823031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:52.062445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:52.072766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-677cc235-836a-4f7b-bea3-1dc7e58bd698 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.305744 Apr 09 21:11:52.073925 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2315/4668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:51 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:11:52.141429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:52.160156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:52.168027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:52.170452 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc0a2ef6-3c9f-48b5-845b-917675dbe9b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.367259 Apr 09 21:11:52.173478 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2354/4669] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:51 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:52.464166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:52.464717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:52.472750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:52.473875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:52.475648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:52.476534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:52.578146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:52.587256 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3f210ef-7def-483a-9a1b-24de2b447694 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1292 microversion: 2.1 time: 0.127003 Apr 09 21:11:52.590336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2316/4670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:52 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:53.091438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:53.092804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:53.100830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.101309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.102346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.102785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.189901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:53.191184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:53.206316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.207923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.209497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.209992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.370628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:53.383261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8c4e35bf-c41d-4925-9050-3b4679c458ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.296486 Apr 09 21:11:53.384183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2355/4671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:53 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:53.529095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:53.541093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:53.544447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:53.546328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c45ab57-ec37-45a2-a74b-ef725cc6d7b7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.360667 Apr 09 21:11:53.547283 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2317/4672] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:53 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:53.611695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:53.614311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:53.632210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.632906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.634238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:53.635013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:53.888564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:53.906558 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e469f2b-b6d3-44d2-9149-45d8ada66a0f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1300 microversion: 2.1 time: 0.302180 Apr 09 21:11:53.907590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2356/4673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:53 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1300 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:54.212382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:54.215341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:54.229270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.230129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.232000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.232821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.278248 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ed9fc71-5ddd-470b-a40b-47f895eb93fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/ips" status: 200 len: 144 microversion: 2.1 time: 0.072768 Apr 09 21:11:54.280336 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2318/4674] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:11:54 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/ips => generated 144 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:54.402038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:54.402732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:54.412879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.413521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.414464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.415053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.580903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:54.582564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:54.599476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.603492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.606383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.607081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.745074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:54.753731 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac79f80f-7d9f-41fe-96e9-fbffb4f38885 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.356319 Apr 09 21:11:54.763703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2357/4675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:54 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:54.877610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:54.893947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:54.896298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:54.897749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d7e97eb-9ca5-47f0-9e25-8f308b53e985 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.333970 Apr 09 21:11:54.898446 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2319/4676] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:54 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:54.930014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:54.930999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:54.959997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.961780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:54.965025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:54.967207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:55.655293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:55.672627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e238bca3-ed75-4e9a-bfbb-db013c67a16c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.747497 Apr 09 21:11:55.684569 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2358/4677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:54 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:55.771177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:55.771856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:55.786464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:55.787777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:55.789022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:55.789856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:55.917892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:55.918840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:55.926804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:55.927593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:55.928683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:55.929395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:56.126467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:56.143765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f7610b5-ad69-4cb5-a1a3-221535039539 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.376380 Apr 09 21:11:56.147611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2320/4678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:55 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:56.300157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:56.331280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:56.334108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:56.339066 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e07b7172-73ce-45ff-b385-187c65d61fd9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.424048 Apr 09 21:11:56.343021 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2359/4679] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:55 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:56.690824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:56.691696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:56.702106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:56.702599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:56.703513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:56.703960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.134295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:57.142926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-220ef6ae-2828-4df1-bc44-5262c15b31d8 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.456207 Apr 09 21:11:57.146139 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2321/4680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:56 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:57.164612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:57.165378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:57.177810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:57.179748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.181600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:57.182119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.367094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:57.368114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:57.387196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:57.388271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.390706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:57.392460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.862111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:57.897068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d8be0f2-bdba-4162-8fe6-369ccaa698cb tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1737 microversion: 2.1 time: 0.722342 Apr 09 21:11:57.899841 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2360/4681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:57 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1737 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:57.914189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7a62ae9a-2f11-4823-9e07-5b344045f8ff req-d6bbdca7-d2fe-478d-8e23-f2faf6326bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b53be2-baae-4a03-89e1-7c4b2637308b", "tag": "bc957e5e-3d07-4968-a48d-c19afe1b8457"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:57.923947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:57.940481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:57.946439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7a62ae9a-2f11-4823-9e07-5b344045f8ff req-d6bbdca7-d2fe-478d-8e23-f2faf6326bf3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:57.947764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:57.949431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7a62ae9a-2f11-4823-9e07-5b344045f8ff req-d6bbdca7-d2fe-478d-8e23-f2faf6326bf3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:57.952246 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-37dc9dd9-6442-4dcb-a56d-21b4c9751c93 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.591831 Apr 09 21:11:57.955401 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2322/4682] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:57 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:11:57.984627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7a62ae9a-2f11-4823-9e07-5b344045f8ff req-d6bbdca7-d2fe-478d-8e23-f2faf6326bf3 service nova] Creating event network-changed:bc957e5e-3d07-4968-a48d-c19afe1b8457 for instance a4b53be2-baae-4a03-89e1-7c4b2637308b on nch2-master-1 Apr 09 21:11:57.997351 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7a62ae9a-2f11-4823-9e07-5b344045f8ff req-d6bbdca7-d2fe-478d-8e23-f2faf6326bf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094556 Apr 09 21:11:57.999394 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2361/4683] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:58.074630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a4f83a5-a376-4491-abce-9211e77574a6"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:58.076518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:58.086908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.088195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.089808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.090779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.164607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:58.165528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:58.180050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.180946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.182868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.184580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.424186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:58.436834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-164434be-c423-47b3-9c9d-29da2911ff9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.277177 Apr 09 21:11:58.449206 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2362/4684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:58 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:58.565678 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2e317500-e657-4f74-a4e0-62cb759dbc8f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496670 Apr 09 21:11:58.567141 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2323/4685] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:11:58 2022] POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:58.916446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:58.917327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:58.924304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.926595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.927887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.928568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.979112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:58.980070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:58.991554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:58.993877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:58.996362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.000880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.327754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:59.340094 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a3d68119-7e4f-4654-ac1b-0b9e2af029f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1717 microversion: 2.1 time: 0.428211 Apr 09 21:11:59.341370 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2363/4686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:58 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1717 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:11:59.455904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:59.456636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:59.472869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.473765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.474759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.475370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.485165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:59.497762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:59.501861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:59.503103 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef3b793a-89c6-4464-ae19-f94ba6ea3ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.534059 Apr 09 21:11:59.503723 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2324/4687] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:11:58 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:11:59.518058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:59.518851 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:59.533574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.534243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.536847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.547000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.697811 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Cannot 'detach_volume' instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 while it is in vm_state rescued Apr 09 21:11:59.698653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 409 to user: Cannot 'detach_volume' instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 while it is in vm_state rescued {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:11:59.699269 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc275d79-d360-4b79-adc3-c04fac729bc7 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments/4b07460f-352b-42de-aaa6-13f4befc338a" status: 409 len: 152 microversion: 2.1 time: 0.191351 Apr 09 21:11:59.703494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2325/4688] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:11:59 2022] DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments/4b07460f-352b-42de-aaa6-13f4befc338a => generated 152 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:11:59.709169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8eac7b0b-094a-4a4c-9999-51e3c985c08c req-a1da6303-6075-4d48-a2c7-9f2f3ef283c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "name": "network-vif-plugged", "status": "completed", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:59.734589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8eac7b0b-094a-4a4c-9999-51e3c985c08c req-a1da6303-6075-4d48-a2c7-9f2f3ef283c0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.735242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8eac7b0b-094a-4a4c-9999-51e3c985c08c req-a1da6303-6075-4d48-a2c7-9f2f3ef283c0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.755726 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8eac7b0b-094a-4a4c-9999-51e3c985c08c req-a1da6303-6075-4d48-a2c7-9f2f3ef283c0 service nova] Creating event network-vif-plugged:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:11:59.774569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8eac7b0b-094a-4a4c-9999-51e3c985c08c req-a1da6303-6075-4d48-a2c7-9f2f3ef283c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069724 Apr 09 21:11:59.775774 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2326/4689] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:11:59.781583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:11:59.790565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:11:59.805379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.806341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.807573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:11:59.810078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:11:59.937786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:11:59.951376 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac81c2ea-081e-41f2-9b3f-264970367deb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.500595 Apr 09 21:11:59.955422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2364/4690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:59 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:11:59.977129 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94c717f2-57f8-4c36-800c-e31dd543d891 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/action" status: 202 len: 0 microversion: 2.1 time: 0.199892 Apr 09 21:11:59.978152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2327/4691] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:11:59 2022] POST /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:11:59.994460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:11:59.995839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:00.015677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:00.029978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:00.038582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:00.039515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:00.522901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:00.523806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:00.542894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:00.543353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:00.544160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:00.544605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:01.079198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:01.109211 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9eb3bf4b-d11a-4b45-b04b-59e39ef16211 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1725 microversion: 2.1 time: 1.124455 Apr 09 21:12:01.123215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2365/4692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:11:59 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1725 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:01.130177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:01.131132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:01.153913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:01.154479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:01.157898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:01.158907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:01.542794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:01.554885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:01.562181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:01.563734 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba8dcdef-0790-4c06-b383-04569f3b2ad1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 1.045403 Apr 09 21:12:01.574127 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2328/4693] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:12:00 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:12:01.672344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:01.684684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-111c1ac7-c33a-4411-bd0f-5dde0e9aff7c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.559936 Apr 09 21:12:01.686417 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2366/4694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:01 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:02.127792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:02.128417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:02.135444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.135901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:02.136690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.137163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:02.494646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:02.506407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f6c56ab5-8348-4a78-a12d-e6e768b23cdd tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1725 microversion: 2.1 time: 0.382312 Apr 09 21:12:02.516906 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2329/4695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:02 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:02.591440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:02.592101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:02.602903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.605964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:02.606836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.607319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:02.703431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:02.704065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:02.710360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.711000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:02.711987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:02.712600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:03.003495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:03.013028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:03.014613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:03.026598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9e3c648-1e30-469f-913e-8396273e796b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1811 microversion: 2.20 time: 0.438797 Apr 09 21:12:03.029696 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2367/4696] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:12:02 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1811 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:12:03.156129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:03.167836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a87e091-45e0-4c11-ab4e-ea4b0550af9c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.465869 Apr 09 21:12:03.177643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2330/4697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:02 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:03.361876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-144cac15-3df8-4f7d-97f1-1c2c76fa1031 req-b12c449a-7a0f-42e6-b955-ae47ce2e9090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b53be2-baae-4a03-89e1-7c4b2637308b", "name": "network-vif-plugged", "status": "completed", "tag": "bc957e5e-3d07-4968-a48d-c19afe1b8457"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:03.396468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-144cac15-3df8-4f7d-97f1-1c2c76fa1031 req-b12c449a-7a0f-42e6-b955-ae47ce2e9090 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:03.400890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-144cac15-3df8-4f7d-97f1-1c2c76fa1031 req-b12c449a-7a0f-42e6-b955-ae47ce2e9090 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:03.433513 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-144cac15-3df8-4f7d-97f1-1c2c76fa1031 req-b12c449a-7a0f-42e6-b955-ae47ce2e9090 service nova] Creating event network-vif-plugged:bc957e5e-3d07-4968-a48d-c19afe1b8457 for instance a4b53be2-baae-4a03-89e1-7c4b2637308b on nch2-master-1 Apr 09 21:12:03.468000 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-144cac15-3df8-4f7d-97f1-1c2c76fa1031 req-b12c449a-7a0f-42e6-b955-ae47ce2e9090 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110101 Apr 09 21:12:03.469162 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2368/4698] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:03.524931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:03.526344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:03.540497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:03.540993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:03.542313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:03.542816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:03.769717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:03.781255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a1f5ded2-8424-4904-b465-f08c488d42ef tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1725 microversion: 2.1 time: 0.260913 Apr 09 21:12:03.784655 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2331/4699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:03 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:04.051213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:04.052799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:04.068899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.069662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.070618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.071358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.187520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:04.188657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:04.205143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.208279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.224556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.225198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.326643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.343686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.349813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.355193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4981a10-87d4-4133-885d-e36d38df83e0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1798 microversion: 2.20 time: 0.312028 Apr 09 21:12:04.358177 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2369/4700] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:12:04 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1798 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:12:04.364795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d55b486-5a6a-4a02-8289-47203d62d9ce tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:04.374611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d55b486-5a6a-4a02-8289-47203d62d9ce tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.375796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d55b486-5a6a-4a02-8289-47203d62d9ce tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.404908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d55b486-5a6a-4a02-8289-47203d62d9ce tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Going to try to stop instance {{(pid=141818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:12:04.488979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.493704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d55b486-5a6a-4a02-8289-47203d62d9ce tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action" status: 202 len: 0 microversion: 2.1 time: 0.133581 Apr 09 21:12:04.497157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2370/4701] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:12:04 2022] POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:12:04.505071 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b44317ef-478a-4280-8a71-754d2c14a40c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1366 microversion: 2.1 time: 0.324855 Apr 09 21:12:04.514953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2332/4702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:04 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:04.520627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:04.522169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:04.531895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.532384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.533183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.533599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.694022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.709161 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d02dcfff-3081-4169-98e3-22d5474cedaa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.210097 Apr 09 21:12:04.710754 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2371/4703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:04 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:04.801937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:04.803210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:04.810108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.810562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.811327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:04.811839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:04.972147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:04.982300 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e4f77dab-7f20-4310-b340-34c0d4e80005 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1731 microversion: 2.1 time: 0.184115 Apr 09 21:12:04.984044 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2333/4704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:04 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:05.000767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:05.001358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:05.009690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.014547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.016307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.018321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.132845 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f9e31d5-fb84-46f4-a070-15cacefe3414 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136692 Apr 09 21:12:05.134036 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2372/4705] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:12:04 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:05.523290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:05.525302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:05.533365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.534259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.535483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.536599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.728341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:05.729220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:05.749124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.749394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.750206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.750739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.841076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:05.852502 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd1e99fb-681e-4506-a6f5-03c8db6f793d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1555 microversion: 2.1 time: 0.333548 Apr 09 21:12:05.855256 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2334/4706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:05 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:05.870696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:05.871502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:05.878363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.880121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:05.891911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:05.892624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:06.078138 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ca0211a-4157-4b02-bdf3-94d073246fb7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211634 Apr 09 21:12:06.079104 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2335/4707] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:12:05 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:12:06.102497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:06.115774 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f419f90-8f83-44c4-b756-a9fd7ec9233c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.391361 Apr 09 21:12:06.122687 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2373/4708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:05 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:07.141168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:07.142538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:07.149554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:07.150869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:07.155525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:07.157256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:07.330600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-88b368be-5b23-4580-9b20-c1c5d98a9a16 req-0292f1ab-f6d6-4e53-81d4-c0f5ae227084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:07.360286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-88b368be-5b23-4580-9b20-c1c5d98a9a16 req-0292f1ab-f6d6-4e53-81d4-c0f5ae227084 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:07.360752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-88b368be-5b23-4580-9b20-c1c5d98a9a16 req-0292f1ab-f6d6-4e53-81d4-c0f5ae227084 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:07.405419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-88b368be-5b23-4580-9b20-c1c5d98a9a16 req-0292f1ab-f6d6-4e53-81d4-c0f5ae227084 service nova] Creating event network-changed:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:12:07.415053 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-88b368be-5b23-4580-9b20-c1c5d98a9a16 req-0292f1ab-f6d6-4e53-81d4-c0f5ae227084 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090125 Apr 09 21:12:07.418367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2374/4709] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:07.436762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:07.457579 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c764648-62c3-4bbc-ae58-a81dd17d55c0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.311529 Apr 09 21:12:07.458537 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2336/4710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:07 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:08.476052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:08.477571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:08.499392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:08.511964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:08.516493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:08.517349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:08.709650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-40b55216-77b8-4c92-9d60-ad4c5ce6a512 req-f3009377-a7bf-4c62-9ac4-2a5d1c69acd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b53be2-baae-4a03-89e1-7c4b2637308b", "tag": "bc957e5e-3d07-4968-a48d-c19afe1b8457"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:08.721196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-40b55216-77b8-4c92-9d60-ad4c5ce6a512 req-f3009377-a7bf-4c62-9ac4-2a5d1c69acd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:08.721882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-40b55216-77b8-4c92-9d60-ad4c5ce6a512 req-f3009377-a7bf-4c62-9ac4-2a5d1c69acd6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:08.767016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-40b55216-77b8-4c92-9d60-ad4c5ce6a512 req-f3009377-a7bf-4c62-9ac4-2a5d1c69acd6 service nova] Creating event network-changed:bc957e5e-3d07-4968-a48d-c19afe1b8457 for instance a4b53be2-baae-4a03-89e1-7c4b2637308b on nch2-master-1 Apr 09 21:12:08.783071 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-40b55216-77b8-4c92-9d60-ad4c5ce6a512 req-f3009377-a7bf-4c62-9ac4-2a5d1c69acd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436172 Apr 09 21:12:08.786080 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2375/4711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:08.911497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:08.923937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc49c5ed-d73b-46c3-b2df-e84dff1e015b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.449194 Apr 09 21:12:08.936147 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2337/4712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:08 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:09.457216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1a35d725-c9db-448e-ad79-bd0294ef15ae req-232ae814-c961-4a7b-9f30-761cd9559f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:09.486627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1a35d725-c9db-448e-ad79-bd0294ef15ae req-232ae814-c961-4a7b-9f30-761cd9559f4d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:09.487613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1a35d725-c9db-448e-ad79-bd0294ef15ae req-232ae814-c961-4a7b-9f30-761cd9559f4d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:09.524823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1a35d725-c9db-448e-ad79-bd0294ef15ae req-232ae814-c961-4a7b-9f30-761cd9559f4d service nova] Creating event network-changed:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:12:09.537961 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1a35d725-c9db-448e-ad79-bd0294ef15ae req-232ae814-c961-4a7b-9f30-761cd9559f4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086069 Apr 09 21:12:09.541069 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2376/4713] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:09.945477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:09.946731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:09.966574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:09.967630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:09.968560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:09.969054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:10.392614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:10.404053 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-261c8545-87bc-49d2-889b-cd270b4a35d0 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.464971 Apr 09 21:12:10.409027 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2338/4714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:09 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:11.427945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:11.428682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:11.437177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:11.438013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:11.440017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:11.440669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:11.699553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:11.719392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9606fd50-ecbf-4177-a413-5bf671b1d2fc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.296083 Apr 09 21:12:11.724140 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2377/4715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:11 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:12.750929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:12.751570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:12.768286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:12.768778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:12.770021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:12.770471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:13.124171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:13.135694 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b20d892-9203-4d06-a2bd-8310a970af9b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.391668 Apr 09 21:12:13.137365 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2339/4716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:12 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:14.153964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:14.154718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:14.165581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:14.166071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:14.166918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:14.168629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:14.390819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:14.400803 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60b15c22-91a5-4570-86cc-ef20603ce118 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1723 microversion: 2.1 time: 0.250930 Apr 09 21:12:14.403436 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2378/4717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:14 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:15.423706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:15.425108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:15.456568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:15.458418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:15.462075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:15.465121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:15.715731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:15.727784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0368be8-0c84-4e4a-a912-8a0229f58125 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1700 microversion: 2.1 time: 0.312496 Apr 09 21:12:15.728765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2340/4718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:15 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1700 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:15.745620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5bc2f71b-5a2f-483a-8c53-602177dbcaae tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:15.753787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bc2f71b-5a2f-483a-8c53-602177dbcaae tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:15.754514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5bc2f71b-5a2f-483a-8c53-602177dbcaae tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:15.783867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5bc2f71b-5a2f-483a-8c53-602177dbcaae tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Going to try to start instance {{(pid=141818) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:12:15.865244 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5bc2f71b-5a2f-483a-8c53-602177dbcaae tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action" status: 202 len: 0 microversion: 2.1 time: 0.121241 Apr 09 21:12:15.878617 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2379/4719] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:12:15 2022] POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:12:15.890247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:15.890859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:15.913018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:15.913902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:15.916247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:15.917450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:16.291090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:16.299881 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-32064bfe-ab6b-4a3c-a6a0-f1e9af2a305d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1709 microversion: 2.1 time: 0.416855 Apr 09 21:12:16.300719 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2341/4720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:15 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1709 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:17.318634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:17.319481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:17.326604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:17.327162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:17.328065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:17.328601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:17.528957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:17.537471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65eb4ba7-b6fe-4b45-9efb-891faf0a6535 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1709 microversion: 2.1 time: 0.223327 Apr 09 21:12:17.538059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2380/4721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:17 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:18.555385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:18.556845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:18.565744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:18.566785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:18.568281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:18.569056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:18.790176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:18.798939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-069e41c7-5304-42fd-8ccd-8599d366fac6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1713 microversion: 2.1 time: 0.247038 Apr 09 21:12:18.799845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2342/4722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:18 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:30.334807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1097097442", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:30.393847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:12:30.875108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:12:30.875482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:12:30.876302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:12:30.877167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:12:30.877746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:12:30.888645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:30.889448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:30.890658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:30.891199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:30.915071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Getting quotas for project 9bd28da6b23940dc816d678fc6f2b9db. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:12:30.925299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Getting quotas for user 74311b56951549df8388565bff4a5499 and project 9bd28da6b23940dc816d678fc6f2b9db. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:12:30.940398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:12:30.942987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:12:31.012757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5939f108-7a47-413f-9165-6c769c24c6c9 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682549 Apr 09 21:12:31.014044 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2381/4723] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:12:31.024207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e62e5eec-b4fb-4da8-a910-4dee85dd42a8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:31.024839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e62e5eec-b4fb-4da8-a910-4dee85dd42a8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:31.133187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e62e5eec-b4fb-4da8-a910-4dee85dd42a8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:31.140670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e62e5eec-b4fb-4da8-a910-4dee85dd42a8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1214 microversion: 2.1 time: 0.120313 Apr 09 21:12:31.150567 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2343/4724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:31 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:31.613346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:31.614139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:31.620928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:31.621753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:31.623691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:31.625267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:31.957927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:31.968249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:31.970331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:31.972627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b16d36c-a5b1-4fb9-a4a3-4a343bf88322 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2949 microversion: 2.42 time: 0.366658 Apr 09 21:12:31.974018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2382/4725] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:12:31 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2949 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:12:32.008329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:32.009800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:32.017822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:32.018681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:32.019618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:32.020710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:32.165574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:32.167846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:32.189100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:32.189583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:32.190995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:32.191445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:32.290050 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7c7a3ac-7954-4276-8781-8f53f06c4fe5 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.287131 Apr 09 21:12:32.291371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2344/4726] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:12:32 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16/os-interface => generated 1828 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:12:32.399266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:32.411721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5e26cba-75b1-4e9a-bcd8-f72859136a93 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1274 microversion: 2.1 time: 0.255636 Apr 09 21:12:32.413053 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2383/4727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:32 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:33.431552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:33.432177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:33.456005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:33.457348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:33.458325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:33.459439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:34.237061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:34.246184 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd211b2a-7868-4577-86f7-a5813ba0b1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.820069 Apr 09 21:12:34.247660 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2345/4728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:33 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:34.962396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-473cf0d8-27b5-42a5-911c-3b69cbf3ec6a req-af081ed1-a4e5-449d-9830-ef0d697e65be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b72fd6-848b-4ccf-b1b7-c28104be9ed0", "tag": "7d7256ef-c33b-449a-b04a-24ae7d6ac8e5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:34.980532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-473cf0d8-27b5-42a5-911c-3b69cbf3ec6a req-af081ed1-a4e5-449d-9830-ef0d697e65be service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:34.981272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-473cf0d8-27b5-42a5-911c-3b69cbf3ec6a req-af081ed1-a4e5-449d-9830-ef0d697e65be service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:35.012273 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-473cf0d8-27b5-42a5-911c-3b69cbf3ec6a req-af081ed1-a4e5-449d-9830-ef0d697e65be service nova] Creating event network-changed:7d7256ef-c33b-449a-b04a-24ae7d6ac8e5 for instance 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 on nch2-master-1 Apr 09 21:12:35.047700 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-473cf0d8-27b5-42a5-911c-3b69cbf3ec6a req-af081ed1-a4e5-449d-9830-ef0d697e65be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090690 Apr 09 21:12:35.049100 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2384/4729] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:35.263884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:35.264871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:35.277821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:35.280005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:35.280933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:35.281493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:35.575721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:35.587395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7dbd6377-d478-4db5-8a74-b86e065fd180 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.327512 Apr 09 21:12:35.588001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2346/4730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:35 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:36.605293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:36.606046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:36.612946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:36.613329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:36.614136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:36.614574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:36.749594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:36.757209 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0745ee58-82c4-4c13-b295-e6a75e1700ae tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.156471 Apr 09 21:12:36.757934 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2385/4731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:36 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:37.774294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:37.774963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:37.782417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:37.783099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:37.784086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:37.784683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:38.024266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:38.033205 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5b65f582-562b-40d8-b879-a6af46b2ce82 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.262481 Apr 09 21:12:38.034021 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2347/4732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:37 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:39.050769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:39.052249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:39.060677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.061519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.062591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.063359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.238672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:39.247951 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e10351d9-f44a-4f17-90fd-01484cd4fa8b tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.200992 Apr 09 21:12:39.249157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2386/4733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:39 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:39.662415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:39.663748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:39.670589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.671047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.671825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.672268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.760665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'services' on Instance uuid 9fbe99a0-a85a-4094-9a27-86d412fa4620 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:12:39.834142 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c032a6dc-5203-4006-b3be-44278a3252fe tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments/4b07460f-352b-42de-aaa6-13f4befc338a" status: 202 len: 0 microversion: 2.1 time: 0.175623 Apr 09 21:12:39.835713 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2348/4734] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:12:39 2022] DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments/4b07460f-352b-42de-aaa6-13f4befc338a => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:12:39.844597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:39.845575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:39.853491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.854299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.855100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:39.855538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:39.889677 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17cf50f8-4af6-40d3-a17e-d452d013978b tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049190 Apr 09 21:12:39.890323 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2387/4735] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:12:39 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:40.265803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:40.266495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:40.272564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:40.273002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:40.273807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:40.274234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:40.424509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:40.436212 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6f2ef675-32d2-46ad-882b-13cc57f264bb tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.174671 Apr 09 21:12:40.436816 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2349/4736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:40 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:40.906899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:40.910048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:40.922459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:40.923879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:40.925185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:40.925839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:40.966825 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1c52d95-12a6-4196-83c9-555d4224c3f4 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068507 Apr 09 21:12:40.967808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2388/4737] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:12:40 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:12:41.046981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:41.048651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:41.055537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.056348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.057162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.057596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.085147 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Cannot 'reboot' instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 while it is in vm_state rescued Apr 09 21:12:41.085744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 409 to user: Cannot 'reboot' instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 while it is in vm_state rescued {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:12:41.086583 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b519f46-4e39-4116-97c9-222fc1320e33 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action" status: 409 len: 145 microversion: 2.1 time: 0.044507 Apr 09 21:12:41.087284 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2350/4738] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:12:41 2022] POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:12:41.099921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:41.101821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:41.108599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.109549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.110738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.111357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.140582 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Cannot 'rebuild' instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 while it is in vm_state rescued Apr 09 21:12:41.141441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 409 to user: Cannot 'rebuild' instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 while it is in vm_state rescued {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:12:41.142461 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b4d92f6-e83c-4691-be31-5912f2f0ceb2 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action" status: 409 len: 146 microversion: 2.1 time: 0.047705 Apr 09 21:12:41.148811 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2389/4739] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:12:41 2022] POST /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9/action => generated 146 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:12:41.153534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:41.154246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:41.161718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.162496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.163425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.163865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.192240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:12:41.307281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce50b6be-bfee-4128-a9fd-50d80805381a tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 204 len: 0 microversion: 2.1 time: 0.157344 Apr 09 21:12:41.308791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2351/4740] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:12:41 2022] DELETE /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:12:41.322725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:41.323702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:41.330986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.331960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.333219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.334168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.455464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:41.456478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:41.471214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.471667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.478260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.478726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.559553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:41.569156 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3f9daee1-2dd9-46ff-b8f7-ab74665cb967 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1691 microversion: 2.1 time: 0.254690 Apr 09 21:12:41.571387 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2390/4741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:41 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:41.585334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f59ba720-48ba-4fb9-987e-9e12027e7bac req-d0508a1f-ad15-42da-b208-25dab2a9f366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b72fd6-848b-4ccf-b1b7-c28104be9ed0", "name": "network-vif-plugged", "status": "completed", "tag": "7d7256ef-c33b-449a-b04a-24ae7d6ac8e5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:41.614937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f59ba720-48ba-4fb9-987e-9e12027e7bac req-d0508a1f-ad15-42da-b208-25dab2a9f366 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:41.615887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f59ba720-48ba-4fb9-987e-9e12027e7bac req-d0508a1f-ad15-42da-b208-25dab2a9f366 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:41.630944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f59ba720-48ba-4fb9-987e-9e12027e7bac req-d0508a1f-ad15-42da-b208-25dab2a9f366 service nova] Creating event network-vif-plugged:7d7256ef-c33b-449a-b04a-24ae7d6ac8e5 for instance 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 on nch2-master-1 Apr 09 21:12:41.637806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f59ba720-48ba-4fb9-987e-9e12027e7bac req-d0508a1f-ad15-42da-b208-25dab2a9f366 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064653 Apr 09 21:12:41.638893 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2391/4742] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:41.747945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:41.759415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4900746-30e6-4707-bf2a-b183fb75c3ee tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.309696 Apr 09 21:12:41.766757 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2352/4743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:41 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:42.592423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:42.593265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:42.602128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:42.603000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:42.604181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:42.604796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:42.779015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:42.780206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:42.788787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:42.789600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:42.790859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:42.791283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:42.932031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:42.951287 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c834e0c9-8d77-448e-b28c-76cad6a152b3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1691 microversion: 2.1 time: 0.366671 Apr 09 21:12:42.961463 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2392/4744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:42 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1691 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:43.040892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:43.051305 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ffd0b11-315d-41c4-9f9f-673d230fb1c7 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1314 microversion: 2.1 time: 0.277281 Apr 09 21:12:43.052371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2353/4745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:42 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:43.968171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:43.968784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:43.976172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:43.976623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:43.977438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:43.977877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:44.068664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:44.070040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:44.081274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:44.081952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:44.082854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:44.083743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:44.150699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:44.161202 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7cfe75d-c76b-4c08-8d48-c31ca74dfa97 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1691 microversion: 2.1 time: 0.196941 Apr 09 21:12:44.161806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2393/4746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:43 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:44.262356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:44.274116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-819edf83-1688-46dc-b7bd-b4680df801b1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1463 microversion: 2.1 time: 0.209192 Apr 09 21:12:44.278456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2354/4747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:44 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:44.296178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5d2f8ab-7872-4061-be6c-5b1930fc0017", "device": "/dev/sdb"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:44.297697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:44.311165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:44.312865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:44.317287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:44.320001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:44.728886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-15678c64-8206-4db1-92f3-b93e76431bf5 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "POST /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436564 Apr 09 21:12:44.730255 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2394/4748] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:12:44 2022] POST /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:12:45.177801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:45.179079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:45.191126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:45.208299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:45.211507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:45.213505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:46.208349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:46.221983 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae9c606d-9a7e-4356-b33a-cd391859d4e0 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1691 microversion: 2.1 time: 1.047952 Apr 09 21:12:46.233371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2355/4749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:45 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1691 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:47.250289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:47.251001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:47.265281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:47.265745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:47.266554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:47.266990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:47.406894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:47.410407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-bb4132bf-bfa1-46fc-8e53-d01f54528034 req-e0ee4eb1-afaf-456b-9023-4a06bc71a141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbe99a0-a85a-4094-9a27-86d412fa4620", "name": "network-vif-deleted", "tag": "92818e3d-053c-4742-bf9a-5d9ff3ccdf98"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:47.414792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4dde1f20-459b-4214-bc8c-bd53eff84b16 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 200 len: 1623 microversion: 2.1 time: 0.168816 Apr 09 21:12:47.417752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2395/4750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:47 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 1623 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:47.431792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bb4132bf-bfa1-46fc-8e53-d01f54528034 req-e0ee4eb1-afaf-456b-9023-4a06bc71a141 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:47.433229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bb4132bf-bfa1-46fc-8e53-d01f54528034 req-e0ee4eb1-afaf-456b-9023-4a06bc71a141 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:47.452964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bb4132bf-bfa1-46fc-8e53-d01f54528034 req-e0ee4eb1-afaf-456b-9023-4a06bc71a141 service nova] Creating event network-vif-deleted:92818e3d-053c-4742-bf9a-5d9ff3ccdf98 for instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 on nch1-master-1 Apr 09 21:12:47.462847 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-bb4132bf-bfa1-46fc-8e53-d01f54528034 req-e0ee4eb1-afaf-456b-9023-4a06bc71a141 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054835 Apr 09 21:12:47.464186 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2356/4751] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:12:48.433577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:48.435473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 9fbe99a0-a85a-4094-9a27-86d412fa4620] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:48.453706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:48.454172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:48.454979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:48.455422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:48.483129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 could not be found. Apr 09 21:12:48.483925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 404 to user: Instance 9fbe99a0-a85a-4094-9a27-86d412fa4620 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:12:48.485020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65ebfb98-3f7d-4479-ae3f-ee5be8e706d5 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620" status: 404 len: 111 microversion: 2.1 time: 0.055344 Apr 09 21:12:48.489711 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2396/4752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:48 2022] GET /compute/v2.1/servers/9fbe99a0-a85a-4094-9a27-86d412fa4620 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:12:48.494997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24188523-0fc3-46c0-a0d6-e405a0d3c22f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '.version_select at 0x7fb08efc2790>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:48.527277 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24188523-0fc3-46c0-a0d6-e405a0d3c22f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132376533" status: 202 len: 0 microversion: 2.1 time: 0.036590 Apr 09 21:12:48.528180 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2357/4753] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132376533 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:12:52.020116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:52.021401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:52.034287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:52.035076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:52.036168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:52.036929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:52.081313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:12:52.222490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b62992e0-fe24-4f66-aed3-9f16150d93ee tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 204 len: 0 microversion: 2.1 time: 0.206334 Apr 09 21:12:52.224012 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2397/4754] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:12:52 2022] DELETE /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:12:52.232838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:52.234286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:52.249925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:52.250455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:52.253490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:52.254333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:52.485587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:52.505850 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2ff16b8-af18-4b57-b0ea-8c34aad2d9c3 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1507 microversion: 2.1 time: 0.272011 Apr 09 21:12:52.516191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2358/4755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:52 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:53.527278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:53.528101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:53.537460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:53.538066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:53.539215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:53.539857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:53.898467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:53.908015 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-130d9aac-b5eb-4b9c-8151-b527544a7169 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1507 microversion: 2.1 time: 0.387993 Apr 09 21:12:53.909212 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2398/4756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:53 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:54.935263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:54.939000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:54.962598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:54.963366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:54.969584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:54.970295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:55.180868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-869c102b-08f6-4af2-a7e9-d03457710ee7 req-39d53ca9-2ead-44b8-b515-1d37eea7da0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e8348e-3b60-4836-b44b-12cb6b2094e9", "name": "network-vif-deleted", "tag": "36fd7931-5c26-4cf6-ba41-57e00cc54451"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:55.187727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:55.198023 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6234d326-63a2-4b58-bab1-f12497192c1f tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 200 len: 1465 microversion: 2.1 time: 0.275872 Apr 09 21:12:55.214473 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2359/4757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:54 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 1465 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:55.221934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-869c102b-08f6-4af2-a7e9-d03457710ee7 req-39d53ca9-2ead-44b8-b515-1d37eea7da0e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:55.222399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-869c102b-08f6-4af2-a7e9-d03457710ee7 req-39d53ca9-2ead-44b8-b515-1d37eea7da0e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:55.249405 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-869c102b-08f6-4af2-a7e9-d03457710ee7 req-39d53ca9-2ead-44b8-b515-1d37eea7da0e service nova] Creating event network-vif-deleted:36fd7931-5c26-4cf6-ba41-57e00cc54451 for instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 on nch1-master-1 Apr 09 21:12:55.259090 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-869c102b-08f6-4af2-a7e9-d03457710ee7 req-39d53ca9-2ead-44b8-b515-1d37eea7da0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085287 Apr 09 21:12:55.269118 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2399/4758] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:12:56.225842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:56.227040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: b1e8348e-3b60-4836-b44b-12cb6b2094e9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:56.236718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.237662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.239993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.241473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.297127 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 could not be found. Apr 09 21:12:56.298060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 404 to user: Instance b1e8348e-3b60-4836-b44b-12cb6b2094e9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:12:56.299100 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f394e962-e9ff-4e2b-bf54-53cdb605f9a1 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9" status: 404 len: 111 microversion: 2.1 time: 0.080070 Apr 09 21:12:56.303165 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2360/4759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:56 2022] GET /compute/v2.1/servers/b1e8348e-3b60-4836-b44b-12cb6b2094e9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:12:56.314212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:56.316348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:56.330277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.330742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.331556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.332053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.373789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:12:56.566503 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e09dc243-da35-4f3c-9ebb-ed0608a63342 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 204 len: 0 microversion: 2.1 time: 0.256922 Apr 09 21:12:56.570929 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2400/4760] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:12:56 2022] DELETE /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:12:56.578139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:56.578815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:56.590469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.597273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.598976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:56.599453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:56.850435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:56.861143 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0008e9f-f856-4fe5-b17c-653f406eec2d tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.288946 Apr 09 21:12:56.861748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2361/4761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:56 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:12:57.878813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:57.879519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:57.887226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:57.887745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:57.889194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:57.889766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:58.064030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:58.072091 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-912a44f2-d564-4998-b976-18c3c2964b26 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.197684 Apr 09 21:12:58.072684 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2401/4762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:57 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:58.180316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: .version_select at 0x7fb08edc4a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-683740399"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:12:58.202105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:12:58.208812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:12:58.520253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:12:58.526036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:12:58.541711 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9c1c98c-40b8-4e5e-983d-9c2f5e4fe8d8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.581261 Apr 09 21:12:58.542409 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2362/4763] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:12:57 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:12:59.102944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:12:59.105649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:12:59.124944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:59.125440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:59.126299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:12:59.126744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:12:59.408706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:12:59.416789 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-82303beb-46c5-48e1-8f22-d4323a332263 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.331071 Apr 09 21:12:59.426537 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2402/4764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:12:59 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:00.441054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:00.443138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:00.465698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:00.471384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:00.472639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:00.473573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:00.764277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:00.781364 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c26dc9d4-05ca-4c80-9a8f-f93debf91917 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1523 microversion: 2.1 time: 0.351255 Apr 09 21:13:00.782316 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2363/4765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:00 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:01.653861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5e4e76c7-490a-4e24-83f4-83afe0877264 req-999b47c8-6227-41d9-9f03-b87d163a1693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5c2a8d-465a-4048-b5dc-68d900a9879b", "name": "network-vif-deleted", "tag": "26dc0e8e-93b6-4aae-af6f-97e1d095b96f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:01.666719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5e4e76c7-490a-4e24-83f4-83afe0877264 req-999b47c8-6227-41d9-9f03-b87d163a1693 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:01.667875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5e4e76c7-490a-4e24-83f4-83afe0877264 req-999b47c8-6227-41d9-9f03-b87d163a1693 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:01.682180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5e4e76c7-490a-4e24-83f4-83afe0877264 req-999b47c8-6227-41d9-9f03-b87d163a1693 service nova] Creating event network-vif-deleted:26dc0e8e-93b6-4aae-af6f-97e1d095b96f for instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b on nch2-master-1 Apr 09 21:13:01.688888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5e4e76c7-490a-4e24-83f4-83afe0877264 req-999b47c8-6227-41d9-9f03-b87d163a1693 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040917 Apr 09 21:13:01.689911 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2403/4766] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:01.801770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:01.802419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:01.810242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:01.811135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:01.812133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:01.812766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:01.847334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:01.847805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:01.848266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lazy-loading 'fault' on Instance uuid 5c5c2a8d-465a-4048-b5dc-68d900a9879b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:01.900056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2abb09d2f7844f3ba0f7a20787d73e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd475c8fbc1f74285a1c98fd75bd109f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:01.912963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e99414fa-37c4-4011-aa28-857184346aaf tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 200 len: 1312 microversion: 2.1 time: 0.117634 Apr 09 21:13:01.913969 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2364/4767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:01 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:02.931607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:02.932429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] [instance: 5c5c2a8d-465a-4048-b5dc-68d900a9879b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:02.939421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:02.939973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:02.940834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:02.941391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:02.955373 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] HTTP exception thrown: Instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b could not be found. Apr 09 21:13:02.956070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] Returning 404 to user: Instance 5c5c2a8d-465a-4048-b5dc-68d900a9879b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:02.957159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07a53895-8a76-410e-a91c-1a4155cbf443 tempest-ServerRescueNegativeTestJSON-1017505455 tempest-ServerRescueNegativeTestJSON-1017505455-project] 10.222.0.30 "GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b" status: 404 len: 111 microversion: 2.1 time: 0.031362 Apr 09 21:13:02.962309 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2404/4768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:02 2022] GET /compute/v2.1/servers/5c5c2a8d-465a-4048-b5dc-68d900a9879b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:13:03.256800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:03.258176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:03.267648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:03.271345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:03.272363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:03.272963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:03.410886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lazy-loading 'services' on Instance uuid 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:03.533838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8b14caf-e180-4965-9613-c76e9b0b2546 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0/os-volume_attachments/c5d2f8ab-7872-4061-be6c-5b1930fc0017" status: 202 len: 0 microversion: 2.1 time: 0.281828 Apr 09 21:13:03.578083 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2365/4769] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:13:03 2022] DELETE /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0/os-volume_attachments/c5d2f8ab-7872-4061-be6c-5b1930fc0017 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:04.775710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:04.776209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:04.789130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:04.789581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:04.797495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:04.798194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:04.850560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:13:04.975225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-755b79c3-4478-409f-800d-a74487244ba8 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 204 len: 0 microversion: 2.1 time: 0.204000 Apr 09 21:13:04.977238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2405/4770] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:13:04 2022] DELETE /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:13:04.989434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:04.991437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:05.001907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:05.002650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:05.004202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:05.004664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:05.669420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:05.678012 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-641b53b6-fd88-48b2-99f8-31797e10388c tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1469 microversion: 2.1 time: 0.696245 Apr 09 21:13:05.684872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2366/4771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:04 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:06.717271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:06.718030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:06.738232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:06.738982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:06.739788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:06.740232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:07.311520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:07.327295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ea1e970-25f7-487d-805b-ad3bc9d4d4d0 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1469 microversion: 2.1 time: 0.617543 Apr 09 21:13:07.328933 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2406/4772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:06 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:08.345715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:08.347258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:08.360423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:08.365583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:08.366705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:08.367138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:08.867057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74311b56951549df8388565bff4a5499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd28da6b23940dc816d678fc6f2b9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:08.879000 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1444830-adae-4c99-990f-dab6365dc1d1 tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 200 len: 1469 microversion: 2.1 time: 0.538358 Apr 09 21:13:08.879999 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2367/4773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:08 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 1469 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:09.129352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-98f5c3cf-1091-4ff1-b7c3-20c4b96fc316 req-c9565790-2c43-4374-9a2c-ad698fc8ea39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b72fd6-848b-4ccf-b1b7-c28104be9ed0", "name": "network-vif-deleted", "tag": "7d7256ef-c33b-449a-b04a-24ae7d6ac8e5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:09.157960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-98f5c3cf-1091-4ff1-b7c3-20c4b96fc316 req-c9565790-2c43-4374-9a2c-ad698fc8ea39 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:09.158889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-98f5c3cf-1091-4ff1-b7c3-20c4b96fc316 req-c9565790-2c43-4374-9a2c-ad698fc8ea39 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:09.180433 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-98f5c3cf-1091-4ff1-b7c3-20c4b96fc316 req-c9565790-2c43-4374-9a2c-ad698fc8ea39 service nova] Creating event network-vif-deleted:7d7256ef-c33b-449a-b04a-24ae7d6ac8e5 for instance 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 on nch2-master-1 Apr 09 21:13:09.195085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-98f5c3cf-1091-4ff1-b7c3-20c4b96fc316 req-c9565790-2c43-4374-9a2c-ad698fc8ea39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069482 Apr 09 21:13:09.196122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2407/4774] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:13:09.901477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:09.902558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] [instance: 32b72fd6-848b-4ccf-b1b7-c28104be9ed0] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:09.918274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:09.922161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:09.923677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:09.924635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:09.996236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] HTTP exception thrown: Instance 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 could not be found. Apr 09 21:13:10.000674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] Returning 404 to user: Instance 32b72fd6-848b-4ccf-b1b7-c28104be9ed0 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:10.002666 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd84600d-c68b-4602-b8ca-db8877497bde tempest-VolumesBackupsTest-1881101193 tempest-VolumesBackupsTest-1881101193-project] 10.222.0.30 "GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0" status: 404 len: 111 microversion: 2.1 time: 0.107574 Apr 09 21:13:10.009079 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2368/4775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:09 2022] GET /compute/v2.1/servers/32b72fd6-848b-4ccf-b1b7-c28104be9ed0 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:13:10.080414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-592968366", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "d3c2438b-d822-41fc-bb91-5e702496b45f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-683740399", "security_groups": [{"name": "tempest-secgroup-smoke-88650111"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:10.558563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] validate_networks() for [('d3c2438b-d822-41fc-bb91-5e702496b45f', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:13:11.225557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:11.226764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:11.233243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.234057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.235115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.235818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.277867 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed52d6d0-5299-4ab6-93c2-fd844bb75872 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments/2c7031ef-4247-461a-a5ca-e53470449307" status: 200 len: 194 microversion: 2.20 time: 0.057489 Apr 09 21:13:11.285523 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2369/4776] 10.222.0.30 () {60 vars in 1453 bytes} [Sat Apr 9 21:13:11 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments/2c7031ef-4247-461a-a5ca-e53470449307 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:13:11.363853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:13:11.364860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:13:11.366705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:13:11.367379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:13:11.367793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:13:11.376875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:11.377816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:11.385203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.386016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.387160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.387834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.388768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.389292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.390683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.391327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.430977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:11.439808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:11.460492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:13:11.463619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:13:11.538350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc9925b5-4556-41f7-9d80-edb037a598bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.462032 Apr 09 21:13:11.539745 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2408/4777] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:13:10 2022] POST /compute/v2.1/servers => generated 404 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:13:11.542281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lazy-loading 'services' on Instance uuid a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:11.550746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:11.551366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:11.642255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b1db7b1-7df9-4a29-9c63-d80332119cfe tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments/2c7031ef-4247-461a-a5ca-e53470449307" status: 202 len: 0 microversion: 2.20 time: 0.269406 Apr 09 21:13:11.646583 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2370/4778] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Apr 9 21:13:11 2022] DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments/2c7031ef-4247-461a-a5ca-e53470449307 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:13:11.657976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:11.663326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:11.679281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.680839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.688432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:11.689312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:11.715370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:11.730056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1265 microversion: 2.1 time: 0.183608 Apr 09 21:13:11.740126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2409/4779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:11 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:11.746736 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e753f154-1417-49fb-a94c-fbeab7d0d6b1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098451 Apr 09 21:13:11.747603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2371/4780] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 21:13:11 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:13:12.075795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:12.077134 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46611414-dec7-4fde-9ff2-e5494fe9e912 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001717 Apr 09 21:13:12.077662 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2410/4781] 10.222.0.30 () {56 vars in 885 bytes} [Sat Apr 9 21:13:12 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 09 21:13:12.754284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:12.755094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:12.762802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:12.764561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:12.781606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:12.783466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:12.786442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:12.787526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:12.789688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:12.790374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:12.792069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:12.795317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:12.880374 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f867e28-3bf0-4033-98f8-c1c678b875b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.122587 Apr 09 21:13:12.881651 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2411/4782] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 21:13:12 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:12.992489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:12.993321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:13.009208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:13.010062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:13.011647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:13.015184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:13.030603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:13.041146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89379860-1a85-40e1-a5f9-6be7f37763e0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1317 microversion: 2.1 time: 0.290962 Apr 09 21:13:13.042855 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2372/4783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:12 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:13.073457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:13:13.227356 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-771938ef-3333-49e1-bcb6-3f7e0b62ca36 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 204 len: 0 microversion: 2.20 time: 0.240879 Apr 09 21:13:13.235751 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2412/4784] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:13:12 2022] DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:13:13.243785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:13.244403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:13.255816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:13.256280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:13.257098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:13.257536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:13.878125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:13.891753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:13.895080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:13.901378 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8e9f1fdf-0305-46e9-8ca5-6991d628025e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.661300 Apr 09 21:13:13.902172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2373/4785] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:13 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:14.063351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:14.065359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:14.075644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:14.077613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:14.080172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:14.081828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:14.288046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:14.314255 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd0f49cf-9b14-4876-b241-2f895add5635 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1323 microversion: 2.1 time: 0.256455 Apr 09 21:13:14.323838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2413/4786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:14 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:14.920553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:14.921669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:14.935976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:14.943018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:14.944028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:14.944466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:15.340254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:15.340840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:15.362517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:15.362993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:15.363820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:15.364260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:15.622456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:15.649119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:15.651771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:15.659244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e6b7e59d-caed-4443-83a2-d5b34517eecd tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 0.743194 Apr 09 21:13:15.663746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2374/4787] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:14 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:16.274184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:16.284118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81fa4ad8-685e-4a98-8a5b-69b04b9fa759 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.947676 Apr 09 21:13:16.294821 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2414/4788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:15 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:16.680147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:16.681450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:16.701392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:16.702179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:16.705985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:16.710145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:17.311608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:17.312894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:17.334572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:17.335299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:17.337268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:17.338145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:17.815542 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:13:17.816512 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 (ip 10.222.0.30) !!! Apr 09 21:13:17.940562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:17.956359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:17.968053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:17.970495 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8baf17a-540f-431f-8dbf-fa02efce544f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1726 microversion: 2.20 time: 1.294712 Apr 09 21:13:17.973468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2375/4789] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:16 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1726 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:18.193750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:18.204107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c481dee-aa79-4b66-9a23-8e648b951034 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.896827 Apr 09 21:13:18.205331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2415/4790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:17 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:18.678430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a7c1610b-3573-4116-a60d-6729d620be40 req-77bd5bae-cbe2-4657-8e78-cadc3d63d9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:18.705693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a7c1610b-3573-4116-a60d-6729d620be40 req-77bd5bae-cbe2-4657-8e78-cadc3d63d9e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:18.706649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a7c1610b-3573-4116-a60d-6729d620be40 req-77bd5bae-cbe2-4657-8e78-cadc3d63d9e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:18.758827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a7c1610b-3573-4116-a60d-6729d620be40 req-77bd5bae-cbe2-4657-8e78-cadc3d63d9e9 service nova] Creating event network-changed:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch1-master-1 Apr 09 21:13:18.760609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ed77bf4-f3e5-4439-89ca-6dd0621fa9de tempest-ComputeTenantNetworksTest-208815262 tempest-ComputeTenantNetworksTest-208815262-project] Calling method '.version_select at 0x7fb08edc4e50>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:18.765020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a7c1610b-3573-4116-a60d-6729d620be40 req-77bd5bae-cbe2-4657-8e78-cadc3d63d9e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096747 Apr 09 21:13:18.766170 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2416/4791] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:19.001494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:19.002350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:19.025959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:19.027260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:19.028594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:19.029239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:19.218580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:19.229768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:19.232023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:19.237487 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa86de31-f24a-4919-a609-35979c9e6ced tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 200 len: 1658 microversion: 2.20 time: 0.244266 Apr 09 21:13:19.238770 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2417/4792] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:18 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 1658 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:13:19.256474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:19.257408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:19.265115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:19.266870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:19.268381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:19.269181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:19.364865 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ed77bf4-f3e5-4439-89ca-6dd0621fa9de tempest-ComputeTenantNetworksTest-208815262 tempest-ComputeTenantNetworksTest-208815262-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.820287 Apr 09 21:13:19.366110 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2376/4793] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Apr 9 21:13:18 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:19.388874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0ce8806-7ac7-4ef1-b2be-b949e0959a3e tempest-ComputeTenantNetworksTest-208815262 tempest-ComputeTenantNetworksTest-208815262-project] Calling method '.version_select at 0x7fb08f25fd30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:19.784130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0ce8806-7ac7-4ef1-b2be-b949e0959a3e tempest-ComputeTenantNetworksTest-208815262 tempest-ComputeTenantNetworksTest-208815262-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/fecb26a9-fc2e-43e8-aee4-ba08b6df9001" status: 200 len: 139 microversion: 2.1 time: 0.411570 Apr 09 21:13:19.784736 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2377/4794] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:13:19 2022] GET /compute/v2.1/os-tenant-networks/fecb26a9-fc2e-43e8-aee4-ba08b6df9001 => generated 139 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:13:20.065640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:20.074409 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-026b9799-0df2-400f-a92f-e2c4766ed420 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.822335 Apr 09 21:13:20.088528 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2418/4795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:19 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:20.260063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:20.260688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:20.275614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:20.276092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:20.282801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:20.283583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:20.330155 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. Apr 09 21:13:20.331752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:20.333161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a13b1f61-941a-4883-abba-660435e2cc27 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 404 len: 111 microversion: 2.20 time: 0.077073 Apr 09 21:13:20.340787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2378/4796] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:20 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:13:20.345325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2cbd1ea7-8233-49d3-9494-18a8f3ef6bd8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '.version_select at 0x7fb08eaa8ee0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:20.351522 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2cbd1ea7-8233-49d3-9494-18a8f3ef6bd8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 21:13:20.835838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a677cb57-f74f-4602-9c17-2e153a762329 req-00cbdd57-b3cc-4deb-a92d-8a5fb7397bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3", "name": "network-vif-deleted", "tag": "c10a4086-9086-4ac2-81ba-c750c7eaea1d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:20.860281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a677cb57-f74f-4602-9c17-2e153a762329 req-00cbdd57-b3cc-4deb-a92d-8a5fb7397bc3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:20.870219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a677cb57-f74f-4602-9c17-2e153a762329 req-00cbdd57-b3cc-4deb-a92d-8a5fb7397bc3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:20.885107 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a677cb57-f74f-4602-9c17-2e153a762329 req-00cbdd57-b3cc-4deb-a92d-8a5fb7397bc3 service nova] Creating event network-vif-deleted:c10a4086-9086-4ac2-81ba-c750c7eaea1d for instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 on nch2-master-1 Apr 09 21:13:20.901769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a677cb57-f74f-4602-9c17-2e153a762329 req-00cbdd57-b3cc-4deb-a92d-8a5fb7397bc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077617 Apr 09 21:13:20.905903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2379/4797] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:21.115512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:21.118012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:21.134997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:21.137296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:21.141184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:21.142291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:21.368672 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [None req-2cbd1ea7-8233-49d3-9494-18a8f3ef6bd8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 48300. Apr 09 21:13:21.405381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2cbd1ea7-8233-49d3-9494-18a8f3ef6bd8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219254406" status: 204 len: 0 microversion: 2.20 time: 1.066351 Apr 09 21:13:21.407106 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2419/4798] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 21:13:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219254406 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:13:21.582641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:21.599573 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-34f11fed-47b0-4434-95c1-f7485a64dfc4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.505304 Apr 09 21:13:21.600558 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2380/4799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:21 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:22.618801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:22.619873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:22.627166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:22.627757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:22.628685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:22.629231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:22.647687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:22.648367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:22.662536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:22.663002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:22.667084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:22.667774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:22.843583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lazy-loading 'services' on Instance uuid f732d8e8-0c52-44e4-89c6-b97595485ebc {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:22.916338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:22.924834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18b8ab5b-95fc-4535-b2d4-f05a7ce76364 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.311129 Apr 09 21:13:22.933450 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2420/4800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:22 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:22.984504 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-67763275-e8ff-4c3b-955e-1157b3180dda tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments/1a4f83a5-a376-4491-abce-9211e77574a6" status: 202 len: 0 microversion: 2.1 time: 0.346321 Apr 09 21:13:23.006945 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2381/4801] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:13:22 2022] DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments/1a4f83a5-a376-4491-abce-9211e77574a6 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:23.403715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: .version_select at 0x7fb08ea8eaf0>, body: {"keypair": {"name": "tempest-keypair-1766988564"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:23.421019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:23.436004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:23.702669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:23.714273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:23.766456 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-901141ab-0b18-471d-8ba4-8048f10736ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.365993 Apr 09 21:13:23.766908 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2421/4802] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Apr 9 21:13:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 368 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:13:23.944564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:23.945622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:23.961676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:23.962474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:23.963504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:23.964333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:23.968946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70d7fbc6-1d9f-4c8a-bbd1-ebfcc2bfb7a4 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Action: 'create', calling method: .version_select at 0x7fb08f1615e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1668370120", "metadata": {"Type": "work"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:24.017791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70d7fbc6-1d9f-4c8a-bbd1-ebfcc2bfb7a4 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.022641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70d7fbc6-1d9f-4c8a-bbd1-ebfcc2bfb7a4 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.366926 Apr 09 21:13:24.023645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2382/4803] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:13:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:13:24.041327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2e053eaa-897f-49f0-84c9-2edcaf678992 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Action: 'create', calling method: .version_select at 0x7fb08edde3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327937922", "metadata": {"Type": "work"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:24.046476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2e053eaa-897f-49f0-84c9-2edcaf678992 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.047965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2e053eaa-897f-49f0-84c9-2edcaf678992 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016811 Apr 09 21:13:24.049880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2383/4804] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:13:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:13:24.063788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2427f9d9-a4c9-4ed8-8bde-ed0302912069 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Action: 'create', calling method: .version_select at 0x7fb08ee45af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1587665087", "metadata": {"Type": "work"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:24.065394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2427f9d9-a4c9-4ed8-8bde-ed0302912069 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.066587 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2427f9d9-a4c9-4ed8-8bde-ed0302912069 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008306 Apr 09 21:13:24.067823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2384/4805] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:13:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:13:24.111688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93683ef2-05f4-44c0-bbf1-52dcd4bf4a19 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Calling method '.version_select at 0x7fb08ed96d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:24.236146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-93683ef2-05f4-44c0-bbf1-52dcd4bf4a19 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] HTTP exception thrown: Volume tempest-invalid-1247389346 could not be found. Apr 09 21:13:24.237703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93683ef2-05f4-44c0-bbf1-52dcd4bf4a19 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 404 to user: Volume tempest-invalid-1247389346 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.239359 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93683ef2-05f4-44c0-bbf1-52dcd4bf4a19 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1247389346" status: 404 len: 99 microversion: 2.1 time: 0.164261 Apr 09 21:13:24.246337 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2385/4806] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:13:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1247389346 => generated 99 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:13:24.256859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:24.258158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:24.268894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.269805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.270883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.271613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.335158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fab62541-a2cb-49aa-b368-a2b0c40f8464 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/ips" status: 200 len: 148 microversion: 2.1 time: 0.085151 Apr 09 21:13:24.335158 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2386/4807] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:13:24 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/ips => generated 148 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:24.344400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:24.360207 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-316d7ac9-fd7d-43a7-ba45-b1d7a2344b94 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.418256 Apr 09 21:13:24.361941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2422/4808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:23 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:24.372254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02dd4118-2d3e-459e-946e-601ffd20fa83 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:24.384198 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb9d20c1-749b-4ad0-b520-445e7866967f tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008007 Apr 09 21:13:24.386901 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2423/4809] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Apr 9 21:13:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 21:13:24.389056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02dd4118-2d3e-459e-946e-601ffd20fa83 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.389577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02dd4118-2d3e-459e-946e-601ffd20fa83 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.394995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfadbca7-6ec2-4a80-84f2-c2e391afc3f4"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:24.398076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:24.418287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.420872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.424732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.425758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.449753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02dd4118-2d3e-459e-946e-601ffd20fa83 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:13:24.576842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02dd4118-2d3e-459e-946e-601ffd20fa83 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action" status: 202 len: 0 microversion: 2.1 time: 0.241145 Apr 09 21:13:24.583901 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2387/4810] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:13:24 2022] POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:24.593120 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-08d9a108-db14-4ab7-8e41-91d14de88105 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005858 Apr 09 21:13:24.602724 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2388/4811] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Apr 9 21:13:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 21:13:24.616054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:24.619351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:24.627769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.646221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.650418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.651452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.661216 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Invalid volume: volume bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 is already attached to instances: 0f8926ba-de0b-42ed-9343-4f06f614270f Apr 09 21:13:24.671134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 400 to user: Invalid volume: volume bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 is already attached to instances: 0f8926ba-de0b-42ed-9343-4f06f614270f {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.672681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e71bacd1-9ec5-4eec-9ddf-1e811b90ebc5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.284408 Apr 09 21:13:24.674059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2424/4812] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:13:24 2022] POST /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b/os-volume_attachments => generated 174 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:13:24.683296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71231f06-a376-43c1-8d21-d375a28189b5 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Calling method '.version_select at 0x7fb08eaa8670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:24.736789 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-71231f06-a376-43c1-8d21-d375a28189b5 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] HTTP exception thrown: Volume 90875c91-9df5-4530-9dba-740a681cc2ab could not be found. Apr 09 21:13:24.739307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71231f06-a376-43c1-8d21-d375a28189b5 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 404 to user: Volume 90875c91-9df5-4530-9dba-740a681cc2ab could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:24.740575 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71231f06-a376-43c1-8d21-d375a28189b5 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/90875c91-9df5-4530-9dba-740a681cc2ab" status: 404 len: 109 microversion: 2.1 time: 0.061651 Apr 09 21:13:24.741428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2425/4813] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:13:24 2022] DELETE /compute/v2.1/os-volumes/90875c91-9df5-4530-9dba-740a681cc2ab => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:13:24.752380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:24.753098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:24.764620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.767610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.768848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:24.769728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:24.853652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:13:25.009309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:25.019688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7caf3964-e11c-4335-8b9e-e03d82bbe199 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.413646 Apr 09 21:13:25.023857 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2389/4814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:24 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:25.039941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16c63c1a-5b67-4fdc-b35d-a45d016138d2 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Calling method '.version_select at 0x7fb08ee45700>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:25.079756 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b422ddc3-3309-4149-bfd0-02c2b98cb9da tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 204 len: 0 microversion: 2.1 time: 0.336708 Apr 09 21:13:25.080363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2426/4815] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:13:24 2022] DELETE /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:13:25.092757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:25.093959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:25.108618 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-16c63c1a-5b67-4fdc-b35d-a45d016138d2 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] HTTP exception thrown: Volume ef918838-a311-4eac-b4ad-331351c95bc7 could not be found. Apr 09 21:13:25.110163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:25.110281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:25.111069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:25.111615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:25.112613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16c63c1a-5b67-4fdc-b35d-a45d016138d2 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] Returning 404 to user: Volume ef918838-a311-4eac-b4ad-331351c95bc7 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:25.114210 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16c63c1a-5b67-4fdc-b35d-a45d016138d2 tempest-VolumesNegativeTest-1497202616 tempest-VolumesNegativeTest-1497202616-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ef918838-a311-4eac-b4ad-331351c95bc7" status: 404 len: 109 microversion: 2.1 time: 0.087943 Apr 09 21:13:25.114865 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2390/4816] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:13:25 2022] GET /compute/v2.1/os-volumes/ef918838-a311-4eac-b4ad-331351c95bc7 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:13:25.354063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:25.363998 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2cf94136-d7ce-4e61-8e5f-4469d8e30dd6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1679 microversion: 2.1 time: 0.277009 Apr 09 21:13:25.381567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:25.382394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:25.397848 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2427/4817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:25 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1679 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:25.411206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:25.411721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:25.412625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:25.413129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:25.746300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:25.767719 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb527659-f21d-4253-89e2-c564785d4d2e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.389921 Apr 09 21:13:25.781090 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2391/4818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:25 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:26.043217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:26.044673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:26.061576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.063955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.064795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.065264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.174076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-51b1019d-68bf-4d8d-bbf3-64fa66af69c8 req-83fc5e1e-2d96-4d0c-8a17-6cc05973146f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "name": "network-vif-plugged", "status": "completed", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:26.201524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-51b1019d-68bf-4d8d-bbf3-64fa66af69c8 req-83fc5e1e-2d96-4d0c-8a17-6cc05973146f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.204534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-51b1019d-68bf-4d8d-bbf3-64fa66af69c8 req-83fc5e1e-2d96-4d0c-8a17-6cc05973146f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.235684 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-51b1019d-68bf-4d8d-bbf3-64fa66af69c8 req-83fc5e1e-2d96-4d0c-8a17-6cc05973146f service nova] Creating event network-vif-plugged:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch1-master-1 Apr 09 21:13:26.241757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-51b1019d-68bf-4d8d-bbf3-64fa66af69c8 req-83fc5e1e-2d96-4d0c-8a17-6cc05973146f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081782 Apr 09 21:13:26.242628 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2392/4819] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:26.383767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:26.384623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:26.403570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.404582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.406051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.408117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.536675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:26.545286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6084ff8b-48be-45c4-9b72-2173ff8b7408 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.506666 Apr 09 21:13:26.546511 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2428/4820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:26 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:26.786428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:26.787496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:26.795716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.807300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.810773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:26.811778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:26.920407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:26.929462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-125583d7-ed76-4b11-a725-f7e8f40f66a9 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1679 microversion: 2.1 time: 0.550104 Apr 09 21:13:26.930084 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2393/4821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:26 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1679 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:27.330999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:27.342394 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab1b6e77-3882-4bca-a287-2c91d751423f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1389 microversion: 2.1 time: 0.560044 Apr 09 21:13:27.344436 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2429/4822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:26 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1389 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:27.567247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:27.569194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:27.576326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:27.577077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:27.578066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:27.579498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:27.947436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:27.947986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:27.958622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:27.959116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:27.959886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:27.960362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:28.048787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:28.112389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-daff16a8-eb19-47ef-b3eb-edc0ec512dea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.549996 Apr 09 21:13:28.123957 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2394/4823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:27 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:28.362602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:28.363543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:28.383165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:28.383923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:28.385193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:28.385849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:28.937381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:28.947996 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f66da9e5-bc7b-4485-babb-cb9d4cc2e2b7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1561 microversion: 2.1 time: 0.589939 Apr 09 21:13:28.952878 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2395/4824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:28 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1561 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:28.980433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:28.991104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-263740390", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ff888c0-c368-48bd-816c-de9ec28120a0"}], "security_groups": [{"name": "tempest-securitygroup--827660201"}], "key_name": "tempest-keypair-1766988564", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:29.009434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18883202-8064-4f9b-bd6c-d432e6ec4334 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1679 microversion: 2.1 time: 1.066087 Apr 09 21:13:29.010072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2430/4825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:27 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1679 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:29.041511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:29.050581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:29.075158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:29.075840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:29.077748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:29.078607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:29.339429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] validate_networks() for [('7ff888c0-c368-48bd-816c-de9ec28120a0', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:13:29.467878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:29.476861 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd752541-4f05-420f-9528-c1d0ff71e418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1561 microversion: 2.1 time: 0.447003 Apr 09 21:13:29.488113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2431/4826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:29 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1561 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:29.491718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:29.492341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:29.503928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:29.504761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:29.505902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:29.506803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:29.983991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:29.995274 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-70152ea7-dd08-4659-9047-4624dfe34f06 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.514138 Apr 09 21:13:29.996286 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2432/4827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:29 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:30.002907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6e8ce0be-c907-4ece-8452-5dd197a2e995 req-4137f1a3-eb51-4f9f-9a55-5e458fd51791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b53be2-baae-4a03-89e1-7c4b2637308b", "name": "network-vif-deleted", "tag": "bc957e5e-3d07-4968-a48d-c19afe1b8457"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:30.021019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e8ce0be-c907-4ece-8452-5dd197a2e995 req-4137f1a3-eb51-4f9f-9a55-5e458fd51791 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.025928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6e8ce0be-c907-4ece-8452-5dd197a2e995 req-4137f1a3-eb51-4f9f-9a55-5e458fd51791 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.051803 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6e8ce0be-c907-4ece-8452-5dd197a2e995 req-4137f1a3-eb51-4f9f-9a55-5e458fd51791 service nova] Creating event network-vif-deleted:bc957e5e-3d07-4968-a48d-c19afe1b8457 for instance a4b53be2-baae-4a03-89e1-7c4b2637308b on nch2-master-1 Apr 09 21:13:30.067007 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6e8ce0be-c907-4ece-8452-5dd197a2e995 req-4137f1a3-eb51-4f9f-9a55-5e458fd51791 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069080 Apr 09 21:13:30.068064 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2433/4828] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:30.080827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:30.081773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:30.095514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.096032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.097149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.099845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.163873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.164413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.165145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'fault' on Instance uuid a4b53be2-baae-4a03-89e1-7c4b2637308b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:30.231704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:30.240285 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5242d755-3ddc-4f83-9f93-f24ae14112bf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 200 len: 1330 microversion: 2.1 time: 0.170350 Apr 09 21:13:30.248961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2434/4829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:30 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 1330 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:30.720726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:13:30.721826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:13:30.722465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:13:30.723045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:13:30.723625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:13:30.738084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.741961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.742830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:30.743298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:30.796765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for project b0a1102e4f4e441b947116441b3e330d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:30.807027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Getting quotas for user f2809b3bcbea4d2eb9ab6b360669fc67 and project b0a1102e4f4e441b947116441b3e330d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:30.832452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:13:30.842608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:13:30.944841 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f88a088-969a-4f27-801c-cd1e69669bd2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.980278 Apr 09 21:13:30.947605 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2396/4830] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:13:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:13:30.959772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:30.961070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:31.014169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:31.014922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:31.025876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:31.026723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:31.030799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:31.031500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:31.121144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:31.134267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:31.141576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:31.148590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a64cadbd-4053-48ab-ad62-02319bf6a115 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1281 microversion: 2.20 time: 0.190268 Apr 09 21:13:31.152538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2435/4831] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:30 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:31.266862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:31.267614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:31.283203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:31.284324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:31.288870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:31.288870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:31.321762 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. Apr 09 21:13:31.328294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:31.329280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-607badb1-4af4-4106-a22a-43ad1d4e3200 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 404 len: 111 microversion: 2.1 time: 0.067426 Apr 09 21:13:31.330390 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2436/4832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:31 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:13:31.343350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a28843f4-bfdb-4be2-ad6a-c099815c09d1 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '.version_select at 0x7fb08e4f79d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:31.386146 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a28843f4-bfdb-4be2-ad6a-c099815c09d1 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595748399" status: 202 len: 0 microversion: 2.1 time: 0.050779 Apr 09 21:13:31.388074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2437/4833] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:13:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595748399 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:31.466663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:31.478703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-530e6457-8840-4af0-9eaa-c49ebd21c3a2 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.469248 Apr 09 21:13:31.487837 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2397/4834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:31 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:32.181295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:32.182838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:32.209510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:32.214290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:32.217611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:32.219137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:32.508182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:32.509507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:32.531623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:32.532665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:32.535267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:32.536785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:32.730764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:32.753242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:32.754924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:32.756113 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45be82c3-727a-4ae0-8576-a5b5d1a8cbbc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1277 microversion: 2.20 time: 0.590749 Apr 09 21:13:32.767324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2438/4835] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:32 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1277 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:33.656453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:33.672746 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69875d50-3cdf-4b25-9b4e-4f9e0e2eeed9 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 1.171239 Apr 09 21:13:33.682653 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2398/4836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:32 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:33.776431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:33.777096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:33.801505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:33.802296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:33.803407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:33.804140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:34.004261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:34.027321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:34.029507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:34.033069 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3670f5bf-bdd2-485c-b336-01b3d8492ef4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1339 microversion: 2.20 time: 0.261920 Apr 09 21:13:34.049473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2439/4837] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:33 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:34.224867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:34.226787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:34.253774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d298d431-cc1f-4241-8166-c863acb7efc2 req-faee7b7d-2e7e-4756-b262-bc30ed209bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:34.267164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:34.271075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:34.274713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:34.276179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:34.283618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d298d431-cc1f-4241-8166-c863acb7efc2 req-faee7b7d-2e7e-4756-b262-bc30ed209bad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:34.306418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d298d431-cc1f-4241-8166-c863acb7efc2 req-faee7b7d-2e7e-4756-b262-bc30ed209bad service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:34.337755 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d298d431-cc1f-4241-8166-c863acb7efc2 req-faee7b7d-2e7e-4756-b262-bc30ed209bad service nova] Creating event network-changed:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch1-master-1 Apr 09 21:13:34.348761 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d298d431-cc1f-4241-8166-c863acb7efc2 req-faee7b7d-2e7e-4756-b262-bc30ed209bad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111157 Apr 09 21:13:34.352893 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2440/4838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:34.699800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:34.701308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:34.713282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:34.714061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:34.714877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:34.715415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:35.610858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:35.624937 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68c222c6-2c2e-4e2f-870b-b638c8a5c88e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1677 microversion: 2.1 time: 0.929943 Apr 09 21:13:35.628313 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2441/4839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:34 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1677 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:35.641911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:35.643128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:35.662985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:35.663556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:35.664914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:35.666002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:35.688988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:35.702031 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05954e5e-ea89-46ea-806a-73ecd8575d62 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1561 microversion: 2.1 time: 1.483587 Apr 09 21:13:35.703378 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2399/4840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:34 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1561 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:35.733028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:35.733771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:35.741425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:35.742186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:35.743343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:35.743946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:35.864092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'services' on Instance uuid 0f8926ba-de0b-42ed-9343-4f06f614270f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:35.965821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:35.986842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:35.992100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:35.999327 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2fe6a88f-0ee9-4f14-971a-6e9d240bf89f tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1339 microversion: 2.20 time: 0.366576 Apr 09 21:13:36.001075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2442/4841] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:35 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1339 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:36.038029 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e435d29-0ff4-4c81-b869-ac099e79a453 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments/bfadbca7-6ec2-4a80-84f2-c2e391afc3f4" status: 202 len: 0 microversion: 2.1 time: 0.332944 Apr 09 21:13:36.039117 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2400/4842] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:13:35 2022] DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments/bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:36.053262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:36.056465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:36.068139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:36.069053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:36.070275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:36.071952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:36.171364 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99bb4222-1f58-4801-82af-b0f7a5cb63e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127660 Apr 09 21:13:36.175164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2443/4843] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:13:36 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:13:36.658424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:36.659504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:36.693132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:36.694353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:36.695358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:36.696210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.030024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:37.030687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:37.037601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.038285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.039125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.039501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.281664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:37.294069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:37.303468 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-41f8ef04-bc7a-4153-902b-ae5a7fe6f153 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1654 microversion: 2.1 time: 0.655245 Apr 09 21:13:37.308070 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2401/4844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:36 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1654 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:37.319656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:37.328878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:37.330695 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dbe4aaf6-144b-462e-9f4b-44e6eae280c0 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1339 microversion: 2.20 time: 0.314660 Apr 09 21:13:37.331733 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2444/4845] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:37 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:37.338161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3d95dea-2aa2-4d2e-a926-91658afe5493 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:37.340674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:37.346750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:37.350069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3d95dea-2aa2-4d2e-a926-91658afe5493 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.350794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3d95dea-2aa2-4d2e-a926-91658afe5493 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.361824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.362281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.367788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.368621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.382257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3d95dea-2aa2-4d2e-a926-91658afe5493 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Going to try to start instance {{(pid=141818) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:13:37.461169 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3f2299d-776e-405a-b273-5400caa0e2ee tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151628 Apr 09 21:13:37.462051 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2402/4846] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:13:37 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:13:37.463752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3d95dea-2aa2-4d2e-a926-91658afe5493 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action" status: 202 len: 0 microversion: 2.1 time: 0.130434 Apr 09 21:13:37.465710 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2445/4847] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:13:37 2022] POST /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:37.477799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:37.478461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:37.486620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.487676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.489145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.491311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.627690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:37.629173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:37.693139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.694153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.696726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:37.697977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:37.792206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:13:38.041808 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d30998b-ae94-4ee9-9602-d72bb7020e55 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 204 len: 0 microversion: 2.1 time: 0.422847 Apr 09 21:13:38.046142 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2446/4848] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:13:37 2022] DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:13:38.076771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:38.077492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:38.077974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:38.090399 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05444f8a-2129-483d-a6aa-9679690e1d51 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1663 microversion: 2.1 time: 0.614864 Apr 09 21:13:38.091861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:38.094264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:38.094762 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2403/4849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:37 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1663 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:38.104108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:38.105100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:38.352512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:38.353657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:38.371469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:38.372049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:38.374311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:38.377483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:38.866568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:38.876011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9b01787-6332-40fc-9668-3f57f1252bcc tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1682 microversion: 2.1 time: 0.822216 Apr 09 21:13:38.890249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2447/4850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:38 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1682 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:38.942327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:38.955950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:38.959261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:38.963892 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1b92b42-4665-48fe-9a5e-e4ce4a58ad20 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.615863 Apr 09 21:13:38.965560 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2404/4851] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:38 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:13:39.112746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:39.114080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:39.123813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:39.126116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:39.128788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:39.129593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:39.529739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:39.539481 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-468b7be8-a463-46ad-a06b-f24828d31dc6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1663 microversion: 2.1 time: 0.430480 Apr 09 21:13:39.540224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2448/4852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:39 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1663 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:39.899649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:39.900508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:39.918251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:39.919202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:39.920250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:39.921548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:39.994919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:39.997932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:40.021029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:40.021821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:40.022939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:40.024410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:40.763234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:40.775718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:40.796275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:40.801779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:40.802383 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3885e6b1-f723-4d9f-8978-714533a09fe2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.823180 Apr 09 21:13:40.804219 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2449/4853] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:39 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:40.824496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:40.830545 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81558624-385a-4895-bdce-2377b31678c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1682 microversion: 2.1 time: 0.919133 Apr 09 21:13:40.831407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2405/4854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:39 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1682 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:40.842033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e1e57416-691f-4808-9b54-2212ef0bfb35 req-e6794ac4-3762-4475-8fc5-5df8fd7538ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:40.844467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:40.877688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:40.879810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:40.882857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:40.886057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e1e57416-691f-4808-9b54-2212ef0bfb35 req-e6794ac4-3762-4475-8fc5-5df8fd7538ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:40.888221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:40.896436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e1e57416-691f-4808-9b54-2212ef0bfb35 req-e6794ac4-3762-4475-8fc5-5df8fd7538ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:40.934477 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e1e57416-691f-4808-9b54-2212ef0bfb35 req-e6794ac4-3762-4475-8fc5-5df8fd7538ff service nova] Creating event network-changed:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch2-master-1 Apr 09 21:13:40.952997 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e1e57416-691f-4808-9b54-2212ef0bfb35 req-e6794ac4-3762-4475-8fc5-5df8fd7538ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112796 Apr 09 21:13:40.957754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2406/4855] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:41.822723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:41.824292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:41.832859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:41.834152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:41.835139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:41.837867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:42.202693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:42.218079 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22498e97-d73c-4512-a59f-d241ccb80dca tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1667 microversion: 2.1 time: 1.412415 Apr 09 21:13:42.218593 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2450/4856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:40 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1667 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:42.223415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:42.224379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:42.246775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:42.247265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:42.248070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:42.248508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:42.510839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:42.521339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:42.523707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:42.526284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26682740-1aff-404e-aa82-84583105f1db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.708922 Apr 09 21:13:42.537723 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2407/4857] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:41 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:13:42.734033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:42.751558 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-519df469-5c2b-420a-a7ff-92f9d8d7f382 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1682 microversion: 2.1 time: 0.531399 Apr 09 21:13:42.754870 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2451/4858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:42 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1682 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:43.325748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2809bf06-8f51-43f8-9808-261210f4d711 req-c7b6f8fd-0f16-412c-a96a-6864e79d562c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8926ba-de0b-42ed-9343-4f06f614270f", "name": "network-vif-deleted", "tag": "fb082d76-dfa5-400a-8a59-2c435b48cf05"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:43.341640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2809bf06-8f51-43f8-9808-261210f4d711 req-c7b6f8fd-0f16-412c-a96a-6864e79d562c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.342736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2809bf06-8f51-43f8-9808-261210f4d711 req-c7b6f8fd-0f16-412c-a96a-6864e79d562c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.375134 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2809bf06-8f51-43f8-9808-261210f4d711 req-c7b6f8fd-0f16-412c-a96a-6864e79d562c service nova] Creating event network-vif-deleted:fb082d76-dfa5-400a-8a59-2c435b48cf05 for instance 0f8926ba-de0b-42ed-9343-4f06f614270f on nch1-master-1 Apr 09 21:13:43.393064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2809bf06-8f51-43f8-9808-261210f4d711 req-c7b6f8fd-0f16-412c-a96a-6864e79d562c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073741 Apr 09 21:13:43.398790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2408/4859] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:43.549894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:43.553847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:43.565778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.566301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.567742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.567872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.784251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:43.784964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:43.789482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:43.794421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.795155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.798473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.799141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.819966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:43.826426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:43.832727 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2398f99a-920f-4d29-a6e9-564e45aacef8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.292318 Apr 09 21:13:43.836349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2452/4860] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:43 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:43.854573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:43.855167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:43.855832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'fault' on Instance uuid 0f8926ba-de0b-42ed-9343-4f06f614270f {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:13:43.918989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:43.932581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02311083-4b92-4547-b4d6-d04867b1d2cb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 200 len: 1332 microversion: 2.1 time: 0.162350 Apr 09 21:13:43.934241 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2409/4861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:43 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:44.857128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:44.858431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:44.869546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:44.870111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:44.872368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:44.873421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:44.952820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:44.954555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:44.967157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:44.967998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:44.969083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:44.969961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:44.999905 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. Apr 09 21:13:45.001467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:13:45.002490 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7de91c5-a2d2-46b0-9be8-92149785b1cf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 404 len: 111 microversion: 2.1 time: 0.055293 Apr 09 21:13:45.003437 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2410/4862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:44 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:13:45.025029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-33e6018d-4720-45cc-8c09-490d4ab1306c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '.version_select at 0x7fb08ee8a9d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:45.083796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-33e6018d-4720-45cc-8c09-490d4ab1306c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496121688" status: 202 len: 0 microversion: 2.1 time: 0.063234 Apr 09 21:13:45.084988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2411/4863] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496121688 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:13:45.300675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:45.338794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:45.345233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:45.350345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4918e1e-c24c-4e80-9c31-abce5269ae02 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.497752 Apr 09 21:13:45.351774 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2453/4864] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:44 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:46.783269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: .version_select at 0x7fb08eba50d0>, body: {"keypair": {"name": "tempest-keypair-1527169081"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:46.823456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:46.835452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:46.874299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:46.875893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:46.887942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:46.888420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:46.891347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:46.892655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:47.224193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:47.235880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:47.237850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:47.239652 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-71d6d83c-7c9e-4e3d-b171-bff3dd3ab29b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.873968 Apr 09 21:13:47.241184 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2412/4865] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:46 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:47.396786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:47.405890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:47.434400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57dd0365-42e6-41cf-9c24-1df7de65aa12 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.667567 Apr 09 21:13:47.435528 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2454/4866] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:13:46 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:13:48.242062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9827c6c8-a8a7-4e07-8571-03d0b44c73cf req-9a753072-4368-4743-85dc-05f97a0d3b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "name": "network-vif-plugged", "status": "completed", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:48.255712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9827c6c8-a8a7-4e07-8571-03d0b44c73cf req-9a753072-4368-4743-85dc-05f97a0d3b3d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:48.256435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9827c6c8-a8a7-4e07-8571-03d0b44c73cf req-9a753072-4368-4743-85dc-05f97a0d3b3d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:48.260934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:48.264057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:48.273669 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9827c6c8-a8a7-4e07-8571-03d0b44c73cf req-9a753072-4368-4743-85dc-05f97a0d3b3d service nova] Creating event network-vif-plugged:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch2-master-1 Apr 09 21:13:48.282336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9827c6c8-a8a7-4e07-8571-03d0b44c73cf req-9a753072-4368-4743-85dc-05f97a0d3b3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045287 Apr 09 21:13:48.284493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2413/4867] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:13:48.299090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:48.299685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:48.310284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:48.314977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:48.746113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:48.760412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:48.763791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:48.766030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-432a12ab-25fb-4704-8b90-a7e4ddb27aee tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.509986 Apr 09 21:13:48.768702 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2455/4868] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:48 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:49.788368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:49.791006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:49.800994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:49.801590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:49.802604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:49.803254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:50.020218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:50.031390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:50.032911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:50.034819 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-689b0a8f-5363-4610-81eb-54bd0bf824f6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1406 microversion: 2.20 time: 0.252273 Apr 09 21:13:50.040163 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2414/4869] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:49 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:51.063278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:51.064299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:51.072184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:51.073029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:51.074646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:51.075339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:51.113572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885745953", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7"}], "security_groups": [{"name": "tempest-securitygroup--1504789232"}], "key_name": "tempest-keypair-1527169081", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:51.350451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] validate_networks() for [('f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:13:51.400400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:51.414755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:51.418489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:51.422629 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d585017-2c03-4362-8ee0-63f3d18b56bf tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1598 microversion: 2.20 time: 0.370530 Apr 09 21:13:51.425330 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2456/4870] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:13:51 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1598 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:13:51.441624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:51.442450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:51.462851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:51.463301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:51.464090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:51.464524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:51.674910 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d495e550-6cd4-43d3-a218-833375360679 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.238083 Apr 09 21:13:51.675482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2457/4871] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Apr 9 21:13:51 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:13:51.981790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:13:51.982874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:13:51.983589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:13:51.984268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:13:51.984994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:13:51.997668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:51.998392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:52.000215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:52.000873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:52.025941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:13:52.051913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:13:52.084109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:13:52.086478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:13:52.162110 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9767c750-7957-4593-87c6-e669c0c217f2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.053556 Apr 09 21:13:52.175228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58f37274-5ff3-4303-8d2f-7111993e1aaf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:52.175990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58f37274-5ff3-4303-8d2f-7111993e1aaf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:52.182194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2415/4872] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:13:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:13:52.276280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-58f37274-5ff3-4303-8d2f-7111993e1aaf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:52.283692 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58f37274-5ff3-4303-8d2f-7111993e1aaf tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1242 microversion: 2.1 time: 0.113926 Apr 09 21:13:52.285387 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2458/4873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:52 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:53.164660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:53.165633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:53.181743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:53.182203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:53.183015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:53.183455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:53.261608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7808d85c-092c-4947-9efe-ad5525323395 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action" status: 200 len: 24569 microversion: 2.1 time: 0.100517 Apr 09 21:13:53.263894 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2416/4874] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:13:53 2022] POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action => generated 24569 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:13:53.305951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:53.309466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:53.320543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:53.321865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:53.323034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:53.324022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:53.512688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fed8871f-5284-4b5c-bf75-74fc1376afea req-678c6b8e-11b4-49bb-a6a2-e3cd23129882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:53.524882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fed8871f-5284-4b5c-bf75-74fc1376afea req-678c6b8e-11b4-49bb-a6a2-e3cd23129882 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:53.527839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fed8871f-5284-4b5c-bf75-74fc1376afea req-678c6b8e-11b4-49bb-a6a2-e3cd23129882 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:53.538858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:53.543230 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fed8871f-5284-4b5c-bf75-74fc1376afea req-678c6b8e-11b4-49bb-a6a2-e3cd23129882 service nova] Creating event network-changed:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch2-master-1 Apr 09 21:13:53.547644 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08003c08-31a4-464d-a369-e3ec8c56b7fd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1294 microversion: 2.1 time: 0.249182 Apr 09 21:13:53.549349 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2459/4875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:53 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1294 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:53.549799 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fed8871f-5284-4b5c-bf75-74fc1376afea req-678c6b8e-11b4-49bb-a6a2-e3cd23129882 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040913 Apr 09 21:13:53.550681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2417/4876] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:13:54.568835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:54.569492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:54.589407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:54.594056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:54.612544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:54.616496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:55.207940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:55.222482 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35aee686-fe2a-4287-95c9-a37b74fc26e2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1300 microversion: 2.1 time: 0.662179 Apr 09 21:13:55.223029 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2460/4877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:54 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1300 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:56.242482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:56.244003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:56.264958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:56.265434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:56.266630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:56.270064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:56.757563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:56.769407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-322a081f-b51d-4b76-9631-e9f3cf56d260 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.533006 Apr 09 21:13:56.771242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2418/4878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:56 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:57.780483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c102fc62-a821-4aa6-9bb2-15fd4469c878 req-e762bf82-dd0a-47f9-b6a7-87b62d386ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d6dee3-586e-4cbc-85af-69d9f3a4a151", "tag": "9592d81b-5138-45a2-ae95-069e629fea7f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:13:57.789143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:57.790557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:57.806073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:57.808995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:57.811190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:57.812495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:57.813003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c102fc62-a821-4aa6-9bb2-15fd4469c878 req-e762bf82-dd0a-47f9-b6a7-87b62d386ba5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:57.816200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c102fc62-a821-4aa6-9bb2-15fd4469c878 req-e762bf82-dd0a-47f9-b6a7-87b62d386ba5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:57.857277 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c102fc62-a821-4aa6-9bb2-15fd4469c878 req-e762bf82-dd0a-47f9-b6a7-87b62d386ba5 service nova] Creating event network-changed:9592d81b-5138-45a2-ae95-069e629fea7f for instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 on nch1-master-1 Apr 09 21:13:57.874417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c102fc62-a821-4aa6-9bb2-15fd4469c878 req-e762bf82-dd0a-47f9-b6a7-87b62d386ba5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110313 Apr 09 21:13:57.879411 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2461/4879] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:13:58.241849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:58.262186 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da5bef66-f344-40e0-a442-4297b22ad481 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.477901 Apr 09 21:13:58.264534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2419/4880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:57 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:13:59.281672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:13:59.282972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:13:59.296636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:59.309402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:59.311562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:13:59.322345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:13:59.642010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:13:59.655736 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bef491b4-bd33-42b8-a951-ba40e9522c02 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.377413 Apr 09 21:13:59.657058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2462/4881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:13:59 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:00.673692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:00.674337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:00.681882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:00.685193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:00.685193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:00.685193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:00.871524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:00.879840 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d300ba6-e7e5-4feb-accc-8eec97ec4d01 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.210530 Apr 09 21:14:00.880768 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2420/4882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:00 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:01.897679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:01.898581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:01.907242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:01.908414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:01.910819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:01.911869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:02.141864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:02.151001 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df8a758c-e4e0-4122-87b1-34c6a5a2af88 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.257684 Apr 09 21:14:02.152553 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2463/4883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:01 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:03.168074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:03.169520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:03.176285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:03.179508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:03.187283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:03.188455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:03.383255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:03.398846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f2724fe-6833-4269-8d05-cf2aa7509dde tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.232946 Apr 09 21:14:03.409736 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2421/4884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:03 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:04.096120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-64cada31-9917-4cc9-86d6-73146df63fd4 req-f7612623-3feb-4952-b460-3bde545f73cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d6dee3-586e-4cbc-85af-69d9f3a4a151", "name": "network-vif-plugged", "status": "completed", "tag": "9592d81b-5138-45a2-ae95-069e629fea7f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:04.111110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-64cada31-9917-4cc9-86d6-73146df63fd4 req-f7612623-3feb-4952-b460-3bde545f73cf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:04.114212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-64cada31-9917-4cc9-86d6-73146df63fd4 req-f7612623-3feb-4952-b460-3bde545f73cf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:04.135251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-64cada31-9917-4cc9-86d6-73146df63fd4 req-f7612623-3feb-4952-b460-3bde545f73cf service nova] Creating event network-vif-plugged:9592d81b-5138-45a2-ae95-069e629fea7f for instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 on nch1-master-1 Apr 09 21:14:04.157238 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-64cada31-9917-4cc9-86d6-73146df63fd4 req-f7612623-3feb-4952-b460-3bde545f73cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065355 Apr 09 21:14:04.167290 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2464/4885] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:04.238772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:04.239392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:04.247739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:04.248317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:04.249292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:04.249738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:04.418200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:04.419410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:04.427122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:04.427679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:04.428635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:04.429247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:04.820108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:04.831205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b617420c-8b09-4760-8d8c-25eee09309b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1368 microversion: 2.1 time: 0.418899 Apr 09 21:14:04.834400 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2465/4886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:04 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1368 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:05.017637 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd67f521-4abc-4ca8-9b2c-cc1359fb32e2 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1831 microversion: 2.1 time: 0.782718 Apr 09 21:14:05.018232 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2422/4887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:04 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1831 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:05.038657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:05.039423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:05.051149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.051646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.052470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.052917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.293740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:05.305464 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80244633-bf28-4bb0-a229-692b4392b210 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1680 microversion: 2.1 time: 0.270678 Apr 09 21:14:05.305992 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2466/4888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:05 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:05.514167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:05.515834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:05.528952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.529776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.534630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.535435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.678679 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00b2cfd6-e7ff-42fa-8ba9-88d9c9f77dac tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action" status: 200 len: 32642 microversion: 2.1 time: 0.171358 Apr 09 21:14:05.680086 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2423/4889] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:05 2022] POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action => generated 32642 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:14:05.834387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:05.835041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:05.847620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.850516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.852286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:05.852972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.853966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.854152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:05.879242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.880864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.883998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:05.885959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:05.955536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f9202e7a69af4d7aba0bdf5982972be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05fb2ff69eb4e3e8464952cacd62c77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:05.957844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] flavor_id is None. Assuming migration. {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 09 21:14:05.958592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:14:06.135589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:06.149146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5fcc0a71-f384-43be-9666-d8ba355f3843 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1557 microversion: 2.1 time: 0.296876 Apr 09 21:14:06.152441 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2424/4890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:05 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1557 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:06.172241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:06.174583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:06.190730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:06.192028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:06.205471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:06.206360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:06.366042 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6db0580-7f42-443d-ac13-da43c653ba9d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200950 Apr 09 21:14:06.369361 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2425/4891] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:14:06 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:06.620866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2306fa7-0f0f-4c6f-b19c-2da566bff929 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action" status: 202 len: 0 microversion: 2.1 time: 0.790061 Apr 09 21:14:06.621903 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2467/4892] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:05 2022] POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:06.632450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:06.634376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:06.643164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:06.644994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:06.646129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:06.646757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:07.328203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:07.336800 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff6481b2-6cba-4e3d-b015-2290b1aa574a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1689 microversion: 2.1 time: 0.709992 Apr 09 21:14:07.340559 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2426/4893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:06 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1689 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:08.265366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1594126003", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "02925ad7-4273-4914-bcec-b963c0462978"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:08.331009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] validate_networks() for [('02925ad7-4273-4914-bcec-b963c0462978', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:14:08.363311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:08.366355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:08.388985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:08.390323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:08.391276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:08.392371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:08.759825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:08.772072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7db63eb1-5d88-42bf-a236-21dc73e8e98c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1689 microversion: 2.1 time: 0.417080 Apr 09 21:14:08.773242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2427/4894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:08 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1689 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:09.388679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:14:09.389818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:14:09.390387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-431b7c1d-4342-4092-b429-c1c2fb7a6986 req-53c2b758-d256-4ccf-9c69-fb2867230a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d6dee3-586e-4cbc-85af-69d9f3a4a151", "tag": "9592d81b-5138-45a2-ae95-069e629fea7f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:09.390924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:14:09.391490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:14:09.392047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:14:09.415055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:09.415753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:09.416803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:09.417407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:09.417840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-431b7c1d-4342-4092-b429-c1c2fb7a6986 req-53c2b758-d256-4ccf-9c69-fb2867230a5e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:09.418290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-431b7c1d-4342-4092-b429-c1c2fb7a6986 req-53c2b758-d256-4ccf-9c69-fb2867230a5e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:09.458372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-431b7c1d-4342-4092-b429-c1c2fb7a6986 req-53c2b758-d256-4ccf-9c69-fb2867230a5e service nova] Creating event network-changed:9592d81b-5138-45a2-ae95-069e629fea7f for instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 on nch1-master-1 Apr 09 21:14:09.464155 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-431b7c1d-4342-4092-b429-c1c2fb7a6986 req-53c2b758-d256-4ccf-9c69-fb2867230a5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085452 Apr 09 21:14:09.465646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2428/4895] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:09.467428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Getting quotas for project 8fe14a0717bc4da1b5b0a8a79cc45ee1. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:14:09.489132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Getting quotas for user 02f94fd5c3894a26b9abd6abca1e4932 and project 8fe14a0717bc4da1b5b0a8a79cc45ee1. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:14:09.511453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:14:09.513885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:14:09.607417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-474a421c-4c01-4ac0-9b61-605ce33ae991 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888910 Apr 09 21:14:09.608097 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2468/4896] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:14:09.619336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f05370d3-489d-4ebc-8331-0c54bb53fa50 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:09.620375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f05370d3-489d-4ebc-8331-0c54bb53fa50 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:09.790836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:09.791475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:09.801961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:09.803233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:09.805135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:09.805707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:09.872958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f05370d3-489d-4ebc-8331-0c54bb53fa50 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:09.884483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f05370d3-489d-4ebc-8331-0c54bb53fa50 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1215 microversion: 2.1 time: 0.268576 Apr 09 21:14:09.887289 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2429/4897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:09 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:10.250089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:10.269197 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d395be79-0e25-42ba-a5af-04d2864e3342 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1689 microversion: 2.1 time: 0.481087 Apr 09 21:14:10.272037 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2469/4898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:09 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1689 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:10.903601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:10.904213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:10.914560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:10.926192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:10.927282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:10.927889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:11.098659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:11.115073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f88cc07-1460-431d-801d-dc087183a676 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1267 microversion: 2.1 time: 0.213756 Apr 09 21:14:11.117554 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2430/4899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:10 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:11.288202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:11.288799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:11.302432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:11.303175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:11.304211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:11.305435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:11.667748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:11.689185 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9e7e413-5ea6-4107-90ad-0a63a3ceea5a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.405135 Apr 09 21:14:11.691655 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2470/4900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:11 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:12.131876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:12.133089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:12.140297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:12.140958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:12.141949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:12.142523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:12.460973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:12.477444 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93264fc2-7f10-4869-8a85-68fcba5b8424 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.344399 Apr 09 21:14:12.478434 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2431/4901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:12 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:12.717770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:12.718578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:12.733612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:12.734241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:12.735324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:12.736027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:12.975820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:12.984942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e34c594e-d394-476a-946a-391d71625833 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.278247 Apr 09 21:14:12.989941 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2471/4902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:12 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:13.496188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:13.497585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:13.516122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:13.516840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:13.517855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:13.536305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:13.593095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2242866e-452f-4f9c-b7aa-dfb0b1489e58 req-d76facce-59b5-4a61-ba4d-52dae0d6dd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c4d087-2594-4746-bb81-4b6a4cbf6581", "tag": "5639fa03-cc59-4abb-9017-2fe259efc10f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:13.614841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2242866e-452f-4f9c-b7aa-dfb0b1489e58 req-d76facce-59b5-4a61-ba4d-52dae0d6dd92 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:13.618166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2242866e-452f-4f9c-b7aa-dfb0b1489e58 req-d76facce-59b5-4a61-ba4d-52dae0d6dd92 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:13.689542 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2242866e-452f-4f9c-b7aa-dfb0b1489e58 req-d76facce-59b5-4a61-ba4d-52dae0d6dd92 service nova] Creating event network-changed:5639fa03-cc59-4abb-9017-2fe259efc10f for instance d1c4d087-2594-4746-bb81-4b6a4cbf6581 on nch1-master-1 Apr 09 21:14:13.702592 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2242866e-452f-4f9c-b7aa-dfb0b1489e58 req-d76facce-59b5-4a61-ba4d-52dae0d6dd92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113056 Apr 09 21:14:13.703718 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2472/4903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:13.972478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:13.987577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02be816f-bbe9-4c7c-a148-92ac60cf0a7a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.493080 Apr 09 21:14:13.991601 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2432/4904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:13 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:14.007381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:14.008092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:14.019102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:14.020171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:14.021023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:14.021749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:14.262310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:14.273098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3712b535-fd3d-43d3-b5f7-56b31272f22d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.270408 Apr 09 21:14:14.274044 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2473/4905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:14 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:15.008800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:15.011022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:15.022194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:15.023409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:15.025412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:15.026216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:15.204704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:15.219765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d29fdd1e-30a7-45f8-bdef-9f4ac6df7b91 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.212977 Apr 09 21:14:15.221877 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2433/4906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:15 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:15.290738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:15.292271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:15.299946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:15.300687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:15.302242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:15.302856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:15.666778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:15.679961 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-35683432-0d1d-45b5-81bf-410eb7760df1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.393057 Apr 09 21:14:15.700436 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2474/4907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:15 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:16.238217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:16.238830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:16.245905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:16.246353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:16.247402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:16.247973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:16.431529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:16.440923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-569d1391-8692-4b58-b049-07feb4b520c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.206472 Apr 09 21:14:16.441769 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2434/4908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:16 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:16.701017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:16.702915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:16.720554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:16.721329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:16.722773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:16.723435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:16.995633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:17.004647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b38a6359-0650-41f6-8246-bccacc66d3ad tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.309836 Apr 09 21:14:17.006355 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2475/4909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:16 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:17.462594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:17.465914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:17.493682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:17.494318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:17.495612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:17.496359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:17.794929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:17.803119 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-11568a4a-4a64-45bb-9d9d-a2e792acd50b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.348457 Apr 09 21:14:17.813561 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2435/4910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:17 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:18.022577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:18.023357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:18.036053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:18.036407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:18.040797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:18.041403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:18.117464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7ada7a87-ba8d-4f42-84de-3727774b8c00 req-8ae106bb-dcee-4d2e-9da8-f8ee25feaa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c4d087-2594-4746-bb81-4b6a4cbf6581", "name": "network-vif-plugged", "status": "completed", "tag": "5639fa03-cc59-4abb-9017-2fe259efc10f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:18.132619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ada7a87-ba8d-4f42-84de-3727774b8c00 req-8ae106bb-dcee-4d2e-9da8-f8ee25feaa33 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:18.137503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ada7a87-ba8d-4f42-84de-3727774b8c00 req-8ae106bb-dcee-4d2e-9da8-f8ee25feaa33 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:18.152797 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7ada7a87-ba8d-4f42-84de-3727774b8c00 req-8ae106bb-dcee-4d2e-9da8-f8ee25feaa33 service nova] Creating event network-vif-plugged:5639fa03-cc59-4abb-9017-2fe259efc10f for instance d1c4d087-2594-4746-bb81-4b6a4cbf6581 on nch1-master-1 Apr 09 21:14:18.159126 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7ada7a87-ba8d-4f42-84de-3727774b8c00 req-8ae106bb-dcee-4d2e-9da8-f8ee25feaa33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045119 Apr 09 21:14:18.160110 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2436/4911] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:14:18.337641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:18.356705 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6d7ba18-d429-44af-baca-37b9f6fb7102 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.337451 Apr 09 21:14:18.358502 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2476/4912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:18 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:18.822279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:18.823616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:18.830142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:18.830584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:18.831539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:18.832107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:19.374743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:19.375892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:19.388601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:19.389078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:19.390106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:19.397926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:19.437117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:19.448439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e1d23da-3cd7-4937-aebf-12bd5225ece4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1315 microversion: 2.1 time: 0.631663 Apr 09 21:14:19.452843 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2437/4913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:18 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:19.674233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:19.696880 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-56cae558-87c0-4d8b-9f3f-c8dc7840f481 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.325034 Apr 09 21:14:19.700968 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2477/4914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:19 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:20.472540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:20.474543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:20.486447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.487661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:20.488759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.489394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:20.716010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:20.716608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:20.731830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.733331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:20.738225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.739330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:20.753427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:20.771634 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0b97d12-2f00-4c6e-84b2-17a136313f96 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1501 microversion: 2.1 time: 0.306023 Apr 09 21:14:20.772781 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2438/4915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:20 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1501 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:20.797027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:20.798567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:20.808342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.809293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:20.810951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:20.812036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:21.116371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:21.128998 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e54f8f78-9bba-4c1f-bd72-c2b2c7eefa8c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.416469 Apr 09 21:14:21.130448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2478/4916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:20 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:21.158814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:21.177146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd75ddb9-9242-4ba2-82f9-e91bda7e20f1 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1501 microversion: 2.1 time: 0.390378 Apr 09 21:14:21.178684 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2439/4917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:20 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1501 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:21.194410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:21.195206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:21.201349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:21.201996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:21.202922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:21.203528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:21.238581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lazy-loading 'flavor' on Instance uuid d1c4d087-2594-4746-bb81-4b6a4cbf6581 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:14:21.351133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88df700d-9740-4312-adc4-359865025c2a tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action" status: 202 len: 0 microversion: 2.1 time: 0.160158 Apr 09 21:14:21.352425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2479/4918] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:21 2022] POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:21.361602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:21.362290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:21.370793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:21.371530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:21.372534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:21.373096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:21.734790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:21.756609 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ef34627-948a-4ecb-bed0-a96bfc280dd0 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1509 microversion: 2.1 time: 0.399994 Apr 09 21:14:21.760264 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2440/4919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:21 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:22.149059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:22.149790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:22.160381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:22.160844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:22.161686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:22.162127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:22.426048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:22.436819 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-796500b6-aea2-4bd2-a900-2f010e412cc3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1694 microversion: 2.1 time: 0.293223 Apr 09 21:14:22.437442 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2480/4920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:22 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1694 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:22.775268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:22.775888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:22.790692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:22.791081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:22.791876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:22.792313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:23.139117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:23.155423 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c0614f8b-0d93-4b30-af21-e06e2e494c2d tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1509 microversion: 2.1 time: 0.384102 Apr 09 21:14:23.167111 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2441/4921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:22 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:23.461321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:23.463675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:23.475185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:23.477898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:23.481426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:23.482035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:23.808523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:23.818980 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7938f50f-e554-4e25-a14f-99982412450f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1693 microversion: 2.1 time: 0.363214 Apr 09 21:14:23.819815 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2481/4922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:23 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1693 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:24.175166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:24.176436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:24.183687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.184415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.185455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.186083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.214907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "name": "network-vif-unplugged", "status": "completed", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:24.228022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.228476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.251385 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] Creating event network-vif-unplugged:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch2-master-1 Apr 09 21:14:24.260919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] Instance cab84835-9825-41f5-b4d4-d960e79d1673 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:14:24.277757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-df30752a-988e-407d-815f-3e6e0e99aa33 req-7d60fa44-8665-4353-b241-89bd2756d5ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066581 Apr 09 21:14:24.279670 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2482/4923] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:14:24.692945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:24.701002 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f2fabba-7c4f-49b6-ae80-baa851d0a129 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1492 microversion: 2.1 time: 0.530279 Apr 09 21:14:24.704882 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2442/4924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:24 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1492 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:24.723555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:24.724999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:24.744827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.745309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.746196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.746627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.837694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:24.838210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:24.848000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.848465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.849664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.850103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.920294 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-580bd395-5376-4a4b-a984-27eb4981dbee tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action" status: 202 len: 0 microversion: 2.1 time: 0.201715 Apr 09 21:14:24.921834 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2483/4925] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:24 2022] POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:24.937271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:24.943030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:24.953959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.955844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:24.957012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:24.957716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:25.575051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:25.584497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:25.594516 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa895347-87ee-4e6f-9250-8d7a9e8bf097 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1498 microversion: 2.1 time: 0.667485 Apr 09 21:14:25.595164 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff3f9e50-e345-4a86-8875-d6241bec6e20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1693 microversion: 2.1 time: 0.761363 Apr 09 21:14:25.598377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2443/4926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:24 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1693 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:25.599564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2484/4927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:24 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1498 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:26.318039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:26.328483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:26.328939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:26.344975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] Creating event network-changed:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch2-master-1 Apr 09 21:14:26.353266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] Instance cab84835-9825-41f5-b4d4-d960e79d1673 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:14:26.366688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f676400c-af9f-42d6-a49a-ec36c051664b req-b0eaaafc-c8ab-4655-b4a3-beae3e660ffd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052929 Apr 09 21:14:26.367464 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2444/4928] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:26.617421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:26.618896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:26.620796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:26.621296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:26.631984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:26.632434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:26.633788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:26.634364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:26.635472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:26.636150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:26.637162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:26.637796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:27.275690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:27.294073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00f42a3a-2319-4641-b9df-8b18fc77a1b4 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1498 microversion: 2.1 time: 0.678905 Apr 09 21:14:27.295099 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2445/4929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:26 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1498 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:27.335212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:27.347657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7f4c631-6515-47fd-b637-784c3cc50e92 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1693 microversion: 2.1 time: 0.735355 Apr 09 21:14:27.358972 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2485/4930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:26 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1693 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:28.314219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:28.315535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:28.323832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.324635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.326802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.327516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.367582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:28.369121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:28.379756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.380357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.381342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.381914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.783888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:28.787122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:28.791735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57963ee2-0373-4414-a3f4-f069a24202e5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1501 microversion: 2.1 time: 0.482188 Apr 09 21:14:28.792536 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2446/4931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:28 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1501 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:28.797887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-461bd860-65bd-40c5-90be-ed79bc75f1dd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1691 microversion: 2.1 time: 0.435130 Apr 09 21:14:28.798954 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2486/4932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:28 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1691 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:28.812802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:28.813613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:28.820610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.821439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.822495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:28.823074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:28.851238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lazy-loading 'flavor' on Instance uuid d1c4d087-2594-4746-bb81-4b6a4cbf6581 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:14:29.002871 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-27529bd8-029b-4f70-bc21-21d5e2d7d2d6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action" status: 202 len: 0 microversion: 2.1 time: 0.193633 Apr 09 21:14:29.004380 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2447/4933] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:28 2022] POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:29.012855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:29.013677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:29.029172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:29.029657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:29.030473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:29.030913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:29.332467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:29.341806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bcc7fec2-46dc-492f-a687-779364e1fefa tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1509 microversion: 2.1 time: 0.333786 Apr 09 21:14:29.342628 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2487/4934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:29 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:29.816377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:29.817848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:29.827912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:29.828679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:29.829795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:29.837085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.084820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:30.096608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-630f66a2-8885-41f2-b102-10a99e33a949 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1691 microversion: 2.1 time: 0.284737 Apr 09 21:14:30.110302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2448/4935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:29 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:30.362163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:30.362926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:30.375022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.375450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.376508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.376917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.544282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:30.553115 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5595db74-0886-4f9f-abaa-19b1b06df4d2 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1492 microversion: 2.1 time: 0.196592 Apr 09 21:14:30.553706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2488/4936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:30 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1492 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:30.576457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:30.577757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:30.587293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.587757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.588560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.589003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.690878 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e924e9e7-3e85-46ca-831e-d9474bc60957 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action" status: 202 len: 0 microversion: 2.1 time: 0.124527 Apr 09 21:14:30.693765 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2449/4937] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:30 2022] POST /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:30.702441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:30.703354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:30.716715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.718811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:30.720656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:30.721314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.119528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:31.122026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:31.134801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.135561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.137097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.137714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.338039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:31.347934 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b3f34ea-2489-4bf7-aa98-c4c2b73cccd5 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1498 microversion: 2.1 time: 0.650083 Apr 09 21:14:31.349238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2489/4938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:30 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1498 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:31.734413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:31.746822 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3fc24fef-0f88-4dad-884e-41cfa81727e6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1688 microversion: 2.1 time: 0.634981 Apr 09 21:14:31.747603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2450/4939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:31 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1688 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:31.763380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:31.763915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:31.771599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.772287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.773329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.773962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.862650 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e23603c-20fc-4994-8faf-eb5b561fcf12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action" status: 204 len: 0 microversion: 2.1 time: 0.102992 Apr 09 21:14:31.864080 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2490/4940] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:14:31 2022] POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:14:31.882405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:31.883986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:31.896017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.896848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:31.898760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:31.899716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:32.367101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:32.367809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:32.374371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:32.375007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:32.376002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:32.376650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:32.519160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:32.527715 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-959d4ac0-5f84-45cc-b22a-091b8458e28c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1688 microversion: 2.1 time: 0.658993 Apr 09 21:14:32.530694 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2451/4941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:31 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1688 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:33.255846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:33.268600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b3b10a7d-2fc5-40b4-b52e-b158bcd7fa5f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1498 microversion: 2.1 time: 0.905744 Apr 09 21:14:33.279111 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2491/4942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:32 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1498 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:33.546739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:33.547399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:33.555292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:33.556039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:33.557248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:33.558936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:33.838247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:33.848216 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-01d965b5-3784-4e68-a096-850b02b6f78b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1688 microversion: 2.1 time: 0.305587 Apr 09 21:14:33.851195 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2452/4943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:33 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1688 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:34.231080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "name": "network-vif-plugged", "status": "completed", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:34.241821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.242476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.264986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] Creating event network-vif-plugged:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch2-master-1 Apr 09 21:14:34.275780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] Instance cab84835-9825-41f5-b4d4-d960e79d1673 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:14:34.286244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:34.286769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:34.295874 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7f27b96e-5a60-4a3f-8038-5a8e16392c60 req-073d148b-6dd3-48b1-b45e-79f97ff2c881 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069144 Apr 09 21:14:34.296177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.296366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.298056 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2492/4944] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:34.303925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.304694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.548043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:34.568976 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38824a2d-3b8a-45f6-b69e-b994161f6c5b tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1501 microversion: 2.1 time: 0.287215 Apr 09 21:14:34.571669 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2453/4945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:34 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:34.587127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:34.587731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:34.597843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.598295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.599580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.600022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.634574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:14:34.759879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-00eeb0d4-2f65-435e-9d93-8dfecc49ee87 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 204 len: 0 microversion: 2.1 time: 0.176932 Apr 09 21:14:34.761438 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2493/4946] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:14:34 2022] DELETE /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:14:34.769338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:34.769971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:34.781446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.781865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.786493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.788505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.868565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:34.869340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:34.876397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.877092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:34.878036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:34.878474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:35.187144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:35.198092 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7957a871-24dc-45ed-b989-e282a130374f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1507 microversion: 2.1 time: 0.432797 Apr 09 21:14:35.207660 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2454/4947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:34 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:35.232294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:35.242252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43c4830f-f9c9-488a-80b7-e274e8e5c997 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1680 microversion: 2.1 time: 0.377754 Apr 09 21:14:35.243333 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2494/4948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:34 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1680 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:36.028291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:36.029407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:36.035799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.036258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.037081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.037529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.070037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:14:36.166080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 204 len: 0 microversion: 2.42 time: 0.368297 Apr 09 21:14:36.170087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2455/4949] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:14:35 2022] DELETE /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:14:36.175381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:36.175997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:36.182118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.182552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.183392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.183819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.219947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:36.220995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:36.228251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.229086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.229989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:36.230509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:36.622867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:36.640196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:36.648649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:36.650777 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-129b19d8-b8a0-44e3-983e-062545845fa8 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2955 microversion: 2.42 time: 0.479309 Apr 09 21:14:36.652266 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2495/4950] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:36 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2955 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:36.656012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:36.666455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4af4b371-6d51-46a4-8415-2811ecd390c6 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1507 microversion: 2.1 time: 0.454014 Apr 09 21:14:36.667062 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2456/4951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:36 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:37.594197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:37.598363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:37.609262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.610367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:37.611379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.612582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:37.661479 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c4623e3-a581-4e8d-a263-5a154de8e99c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072550 Apr 09 21:14:37.662787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2496/4952] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:14:37 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:14:37.684131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:37.684862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:37.685835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:37.686390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:37.693862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.694601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:37.695575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.696216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:37.708313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.708800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:37.709664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:37.710100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:38.106926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:38.108541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:38.122265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:38.123266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd3cab50-7253-4e3e-a4b4-aa34e4a85351 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1507 microversion: 2.1 time: 0.443424 Apr 09 21:14:38.124058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2497/4953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:37 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:38.133920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:38.133920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:38.139210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:38.140778 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-606da83a-6d83-4047-985a-c277bdcca06d tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2955 microversion: 2.42 time: 0.471876 Apr 09 21:14:38.142891 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2457/4954] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:37 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2955 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:38.144897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:38.145406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:38.146207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:38.146649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:38.189933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:14:38.312400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a6234806-ff24-429e-9efa-3f38fa762fdf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 204 len: 0 microversion: 2.1 time: 0.186732 Apr 09 21:14:38.316607 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2498/4955] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:14:38 2022] DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:14:38.323811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:38.324603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:38.332753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:38.333655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:38.335663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:38.336469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:38.564861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:38.575854 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f191b34e-38a5-4669-8b3f-81095b004be8 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1673 microversion: 2.1 time: 0.257285 Apr 09 21:14:38.586638 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2458/4956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:38 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:39.141283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:39.142562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:39.149911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.150605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.151689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.152262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.163138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:39.164471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:39.176816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.177570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.178536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.180777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.659927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f94fd5c3894a26b9abd6abca1e4932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe14a0717bc4da1b5b0a8a79cc45ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:39.672381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23b8861f-6abe-4a9e-8bff-e52d0a481960 tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 200 len: 1507 microversion: 2.1 time: 0.531058 Apr 09 21:14:39.673248 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2499/4957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:39 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:39.687148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:39.702111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:39.708459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.708923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.709745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.710177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.750090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:39.763318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:39.768231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:39.769922 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a15b8f8-eb07-4d89-9f2d-1fd0b21f0303 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2955 microversion: 2.42 time: 0.610635 Apr 09 21:14:39.771816 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2459/4958] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:39 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2955 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:39.943865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4c5ea9f7-2b3a-4f48-9ede-76cc50665e90 req-94bffd9d-90f8-45b9-9732-d6abe6d2d230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c4d087-2594-4746-bb81-4b6a4cbf6581", "name": "network-vif-deleted", "tag": "5639fa03-cc59-4abb-9017-2fe259efc10f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:39.956766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c5ea9f7-2b3a-4f48-9ede-76cc50665e90 req-94bffd9d-90f8-45b9-9732-d6abe6d2d230 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:39.959963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c5ea9f7-2b3a-4f48-9ede-76cc50665e90 req-94bffd9d-90f8-45b9-9732-d6abe6d2d230 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:39.972830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4c5ea9f7-2b3a-4f48-9ede-76cc50665e90 req-94bffd9d-90f8-45b9-9732-d6abe6d2d230 service nova] Creating event network-vif-deleted:5639fa03-cc59-4abb-9017-2fe259efc10f for instance d1c4d087-2594-4746-bb81-4b6a4cbf6581 on nch1-master-1 Apr 09 21:14:39.978836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4c5ea9f7-2b3a-4f48-9ede-76cc50665e90 req-94bffd9d-90f8-45b9-9732-d6abe6d2d230 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040173 Apr 09 21:14:39.980123 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2460/4959] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:40.642544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:40.652184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b4a5c68-0726-45e6-a872-9849d908cfbb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1673 microversion: 2.1 time: 0.968846 Apr 09 21:14:40.652818 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2500/4960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:39 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1673 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:40.690579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:40.691269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] [instance: d1c4d087-2594-4746-bb81-4b6a4cbf6581] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:40.701173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:40.701683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:40.702755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:40.703226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:40.724629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] HTTP exception thrown: Instance d1c4d087-2594-4746-bb81-4b6a4cbf6581 could not be found. Apr 09 21:14:40.725364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] Returning 404 to user: Instance d1c4d087-2594-4746-bb81-4b6a4cbf6581 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:14:40.726446 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b6e58d6-97e2-42b2-8528-96574c112d6f tempest-TestServerAdvancedOps-2127556675 tempest-TestServerAdvancedOps-2127556675-project] 10.222.0.30 "GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581" status: 404 len: 111 microversion: 2.1 time: 0.040286 Apr 09 21:14:40.727084 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2461/4961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:40 2022] GET /compute/v2.1/servers/d1c4d087-2594-4746-bb81-4b6a4cbf6581 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:14:40.793426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:40.794679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:40.801256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:40.801990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:40.802785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:40.803457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:41.560776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:41.576858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:41.578946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:41.580491 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d3d3906-0051-4d62-a060-b23c79300e6c tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2955 microversion: 2.42 time: 0.792303 Apr 09 21:14:41.581559 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2501/4962] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:40 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2955 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:41.670283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:41.670903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:41.695748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:41.698248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:41.700011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:41.701123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:42.174041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-056bcce5-7739-4f8c-ad75-b6ed72028128 req-3741b381-4f47-4353-90f0-5a06a1332e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8709fe-4ff2-4d1a-b51d-e89c7bc51920"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:42.190739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-056bcce5-7739-4f8c-ad75-b6ed72028128 req-3741b381-4f47-4353-90f0-5a06a1332e73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:42.191394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-056bcce5-7739-4f8c-ad75-b6ed72028128 req-3741b381-4f47-4353-90f0-5a06a1332e73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:42.219385 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-056bcce5-7739-4f8c-ad75-b6ed72028128 req-3741b381-4f47-4353-90f0-5a06a1332e73 service nova] Creating event network-vif-unplugged:3e8709fe-4ff2-4d1a-b51d-e89c7bc51920 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:42.234796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-056bcce5-7739-4f8c-ad75-b6ed72028128 req-3741b381-4f47-4353-90f0-5a06a1332e73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064591 Apr 09 21:14:42.236009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2502/4963] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:42.252485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:42.273533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7fffdb46-12b8-4be1-83fa-9a92cf5302be tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1673 microversion: 2.1 time: 0.606558 Apr 09 21:14:42.274234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2462/4964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:41 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1673 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:42.601612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:42.602311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:42.617820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:42.618516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:42.619446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:42.620018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:43.291158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:43.291787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:43.300891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:43.301748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:43.304146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:43.304761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:43.541427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:43.549829 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64d79232-ccb6-438f-b117-16339cef22b5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1605 microversion: 2.1 time: 0.262674 Apr 09 21:14:43.550804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2463/4965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:43 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:43.595164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:43.615850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:43.617686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:43.619009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4433acb9-6011-4972-b346-6a428e4730f6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2934 microversion: 2.42 time: 1.022108 Apr 09 21:14:43.620642 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2503/4966] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:42 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2934 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:43.984570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-456845cf-d833-4f6c-b4c0-32f0fd9c59ee req-01b8a197-6de2-479d-b8c8-14d3badb7105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f732d8e8-0c52-44e4-89c6-b97595485ebc", "name": "network-vif-deleted", "tag": "7db0e06f-1adf-4655-97b4-f840efe455ae"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:44.003927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-456845cf-d833-4f6c-b4c0-32f0fd9c59ee req-01b8a197-6de2-479d-b8c8-14d3badb7105 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.004618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-456845cf-d833-4f6c-b4c0-32f0fd9c59ee req-01b8a197-6de2-479d-b8c8-14d3badb7105 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.033798 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-456845cf-d833-4f6c-b4c0-32f0fd9c59ee req-01b8a197-6de2-479d-b8c8-14d3badb7105 service nova] Creating event network-vif-deleted:7db0e06f-1adf-4655-97b4-f840efe455ae for instance f732d8e8-0c52-44e4-89c6-b97595485ebc on nch2-master-1 Apr 09 21:14:44.049913 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-456845cf-d833-4f6c-b4c0-32f0fd9c59ee req-01b8a197-6de2-479d-b8c8-14d3badb7105 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068869 Apr 09 21:14:44.050950 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2464/4967] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:44.284907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-unplugged", "status": "completed", "tag": "da958d47-ba90-4946-a8c2-f3457704513e"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-unplugged", "status": "completed", "tag": "795eaf94-b9aa-4494-8de0-8b62eecc59b1"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-unplugged", "status": "completed", "tag": "ace7507d-dd06-475c-b999-2430bd431592"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-unplugged", "status": "completed", "tag": "1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:44.306648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.311301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.343079 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Creating event network-vif-unplugged:da958d47-ba90-4946-a8c2-f3457704513e for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:44.344108 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Creating event network-vif-unplugged:795eaf94-b9aa-4494-8de0-8b62eecc59b1 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:44.349304 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Creating event network-vif-unplugged:ace7507d-dd06-475c-b999-2430bd431592 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:44.350215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] Creating event network-vif-unplugged:1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:44.362645 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2f9fae80-b658-40c2-8ffc-cc28ad6fcccb req-ffd61f59-abf7-44cf-8a29-97936a6d7c81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.082975 Apr 09 21:14:44.367150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2504/4968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:14:44.577842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:44.580445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:44.601483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.602408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.603528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.605320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.641097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:44.642589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:44.665826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.666306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.667318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.667680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.716869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:44.717399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:44.717866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lazy-loading 'fault' on Instance uuid f732d8e8-0c52-44e4-89c6-b97595485ebc {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:14:45.164332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:45.171395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02f695de-2104-4884-981e-fdaf2255ccaf tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 200 len: 1328 microversion: 2.1 time: 0.606628 Apr 09 21:14:45.172255 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2465/4969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:44 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 1328 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:45.486876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:45.500631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:45.503468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:45.504866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-892b15bc-2a3f-4330-b11d-f7b317ad6ae3 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2913 microversion: 2.42 time: 0.868475 Apr 09 21:14:45.507045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2505/4970] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:44 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2913 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:45.881714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:45.882273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:45.892693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:45.893178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:45.896447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:45.897109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:45.935075 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0474616b-1962-4911-9255-4d455b6ee0b2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/ips" status: 200 len: 149 microversion: 2.1 time: 0.056870 Apr 09 21:14:45.935838 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2466/4971] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:14:45 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:46.189456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:46.190622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:46.198581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:46.199036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:46.199970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:46.200559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:46.218996 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. Apr 09 21:14:46.219843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:14:46.221465 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3bc645c1-1a82-4c05-9efb-7edb0d23ee98 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 404 len: 111 microversion: 2.1 time: 0.035989 Apr 09 21:14:46.222596 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2506/4972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:46 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:14:46.232606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-abb5dd63-aa60-4c7f-914a-8bdf0338ae07 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '.version_select at 0x7fb08e1f3550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:46.269025 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-abb5dd63-aa60-4c7f-914a-8bdf0338ae07 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083068436" status: 202 len: 0 microversion: 2.1 time: 0.041474 Apr 09 21:14:46.269629 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2467/4973] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:14:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083068436 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:46.528074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:46.529226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:46.545752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-47e7ce7e-c073-43b7-a1e8-25f1cc4b1784 req-86cab8bd-e78c-4683-afa5-fa999e33487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-deleted", "tag": "da958d47-ba90-4946-a8c2-f3457704513e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:46.554624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:46.555290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:46.557858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:46.559557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:46.560701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-47e7ce7e-c073-43b7-a1e8-25f1cc4b1784 req-86cab8bd-e78c-4683-afa5-fa999e33487c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:46.565504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-47e7ce7e-c073-43b7-a1e8-25f1cc4b1784 req-86cab8bd-e78c-4683-afa5-fa999e33487c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:46.591722 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-47e7ce7e-c073-43b7-a1e8-25f1cc4b1784 req-86cab8bd-e78c-4683-afa5-fa999e33487c service nova] Creating event network-vif-deleted:da958d47-ba90-4946-a8c2-f3457704513e for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:46.607162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-47e7ce7e-c073-43b7-a1e8-25f1cc4b1784 req-86cab8bd-e78c-4683-afa5-fa999e33487c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066629 Apr 09 21:14:46.611834 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2468/4974] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:47.093399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:47.110614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:47.114778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:47.116713 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc8d30e2-3ceb-46d7-95d2-3a519f10ce74 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2867 microversion: 2.42 time: 0.593328 Apr 09 21:14:47.119917 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2507/4975] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:46 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2867 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:47.500052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eced0af0-a8c1-464c-9b1d-5ed1898e863c"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:47.503180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:47.525947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:47.528394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:47.529363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:47.529874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:47.771535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: .version_select at 0x7fb08ddd4c10>, body: {"keypair": {"name": "tempest-keypair-1645359192"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:47.832595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:14:47.859914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:14:48.033916 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de8ba8db-e6e6-4618-b93b-096ea3601b03 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542735 Apr 09 21:14:48.034949 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2469/4976] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:14:47 2022] POST /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:48.140987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:48.141731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:48.152614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:48.153083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:48.165196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:48.167764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:48.322531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:14:48.331215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:14:48.374381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3278329-1a97-44d6-95f5-279a14afe642 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.606953 Apr 09 21:14:48.377507 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2508/4977] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:14:47 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:48.668967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c1c682f3-ed98-4768-a23e-40a01f58db11 req-33ec518e-b012-4ca2-984a-e224b33fce31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-deleted", "tag": "3e8709fe-4ff2-4d1a-b51d-e89c7bc51920"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:48.680861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c1c682f3-ed98-4768-a23e-40a01f58db11 req-33ec518e-b012-4ca2-984a-e224b33fce31 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:48.681338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c1c682f3-ed98-4768-a23e-40a01f58db11 req-33ec518e-b012-4ca2-984a-e224b33fce31 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:48.711690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c1c682f3-ed98-4768-a23e-40a01f58db11 req-33ec518e-b012-4ca2-984a-e224b33fce31 service nova] Creating event network-vif-deleted:3e8709fe-4ff2-4d1a-b51d-e89c7bc51920 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:48.718463 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c1c682f3-ed98-4768-a23e-40a01f58db11 req-33ec518e-b012-4ca2-984a-e224b33fce31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053611 Apr 09 21:14:48.719132 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2509/4978] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:14:49.001501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:49.017250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:49.026210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:49.029078 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26c5c85c-e9ca-4b65-9c95-270ea15609ba tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2529 microversion: 2.42 time: 0.891201 Apr 09 21:14:49.042234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2470/4979] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:48 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2529 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:50.049026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:50.049926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:50.062597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:50.065821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:50.066905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:50.067567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:50.359437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:50.372236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:50.373788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:50.375048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ca729098-7f8e-429a-adb2-75458b29e926 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 2370 microversion: 2.42 time: 0.330769 Apr 09 21:14:50.375999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2510/4980] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:50 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 2370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:50.779555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-deleted", "tag": "795eaf94-b9aa-4494-8de0-8b62eecc59b1"}, {"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-deleted", "tag": "1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:50.801629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:50.803193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:50.820147 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] Creating event network-vif-deleted:795eaf94-b9aa-4494-8de0-8b62eecc59b1 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:50.821278 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] Creating event network-vif-deleted:1330acfc-6f7c-4e6b-85fd-e347dcbfa7b7 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:50.831497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-412c42d5-eec0-44cd-a7a3-1cc2014af6ae req-431a4011-55d7-4328-9b74-6d62eb44c3ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057606 Apr 09 21:14:50.832880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2471/4981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:51.410165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:51.411743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:51.435886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.436622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.438051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.438680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.565812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eced0af0-a8c1-464c-9b1d-5ed1898e863c"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:51.567027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:51.575340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.576162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.577019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.577790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.705782 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Invalid volume: volume eced0af0-a8c1-464c-9b1d-5ed1898e863c is already attached to instances: d4d6dee3-586e-4cbc-85af-69d9f3a4a151 Apr 09 21:14:51.706932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 400 to user: Invalid volume: volume eced0af0-a8c1-464c-9b1d-5ed1898e863c is already attached to instances: d4d6dee3-586e-4cbc-85af-69d9f3a4a151 {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:14:51.708859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-55e988e6-5da4-434f-8c59-11b78dc55093 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148346 Apr 09 21:14:51.716791 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2472/4982] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:14:51 2022] POST /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:14:51.857547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:51.858682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:51.868908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.874100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.875909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:51.877884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:51.988306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'services' on Instance uuid d4d6dee3-586e-4cbc-85af-69d9f3a4a151 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:14:52.076063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7aa0df99-b239-431a-9a13-1b6071033c0b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments/eced0af0-a8c1-464c-9b1d-5ed1898e863c" status: 202 len: 0 microversion: 2.1 time: 0.222491 Apr 09 21:14:52.076621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2473/4983] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:14:51 2022] DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments/eced0af0-a8c1-464c-9b1d-5ed1898e863c => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:14:52.086245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-507572408", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "716e02fb-2354-45aa-9b94-e82b4f941149"}], "security_groups": [{"name": "tempest-securitygroup--315232675"}], "key_name": "tempest-keypair-1645359192", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:52.091791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:52.102828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:52.104534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2b92cb8d21d42eea56146d7935a74e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60eee2c55ed842f78ac0fa9e1b400fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:52.106049 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9db75598-08db-405d-9226-c36e13ff4a0a tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 200 len: 1605 microversion: 2.42 time: 0.707768 Apr 09 21:14:52.106648 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2511/4984] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:51 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 1605 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:14:52.113193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:52.114405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:52.129094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:52.129974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:52.131077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:52.131699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:52.167438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f285289-444d-4924-8daf-a3353954f5ac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058795 Apr 09 21:14:52.168028 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2512/4985] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:14:52 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:14:52.275717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] validate_networks() for [('716e02fb-2354-45aa-9b94-e82b4f941149', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:14:52.893240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bebb88b7-f788-4b17-b7db-af00a0f5c372 req-8c86e29d-8e62-4f9a-815c-f2ea83251017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26648861-23d6-4a96-a429-d9a55cf50a16", "name": "network-vif-deleted", "tag": "ace7507d-dd06-475c-b999-2430bd431592"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:14:52.948940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bebb88b7-f788-4b17-b7db-af00a0f5c372 req-8c86e29d-8e62-4f9a-815c-f2ea83251017 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:52.949678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bebb88b7-f788-4b17-b7db-af00a0f5c372 req-8c86e29d-8e62-4f9a-815c-f2ea83251017 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:52.971252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bebb88b7-f788-4b17-b7db-af00a0f5c372 req-8c86e29d-8e62-4f9a-815c-f2ea83251017 service nova] Creating event network-vif-deleted:ace7507d-dd06-475c-b999-2430bd431592 for instance 26648861-23d6-4a96-a429-d9a55cf50a16 on nch1-master-1 Apr 09 21:14:52.982244 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bebb88b7-f788-4b17-b7db-af00a0f5c372 req-8c86e29d-8e62-4f9a-815c-f2ea83251017 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103817 Apr 09 21:14:52.984227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2513/4986] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:14:53.129968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.131736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:53.150618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.151119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.151972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.152413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.178198 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] HTTP exception thrown: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. Apr 09 21:14:53.179815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Returning 404 to user: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:14:53.181131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87875f00-20ec-4409-8b13-f000abefebfe tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 404 len: 111 microversion: 2.42 time: 0.060176 Apr 09 21:14:53.185177 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2514/4987] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:14:53 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:14:53.196850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.198903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:53.206212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.207231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.209149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.209961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.216491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:14:53.217736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:14:53.218543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:14:53.219162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:14:53.219810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:14:53.233375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.234218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.235334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.236815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.248345 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e8839d5-892c-41aa-b5a0-12e7cc3e3bc6 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059726 Apr 09 21:14:53.250400 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2515/4988] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:14:53 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:14:53.256117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a932436e-fc3c-4020-9d99-376aedc1d9ad tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '.version_select at 0x7fb08eaefb80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.284409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for project fdd53d98faf74d6a92cdfabace62b088. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:14:53.288320 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a932436e-fc3c-4020-9d99-376aedc1d9ad tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908874820" status: 204 len: 0 microversion: 2.42 time: 0.036510 Apr 09 21:14:53.289283 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2516/4989] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 21:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908874820 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:14:53.299808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Getting quotas for user 7ce296c1004c4976930f46de34be880d and project fdd53d98faf74d6a92cdfabace62b088. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:14:53.315889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:14:53.319502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:14:53.353494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.354019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:53.361385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.362588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.363869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.364585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.397313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:14:53.411436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f7a41609-e52f-45a3-bc09-d6c765a808a1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.327908 Apr 09 21:14:53.418170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2474/4990] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:14:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:14:53.425667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ab6a0bc-2983-4922-ae67-d5159bc5156f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.429218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ab6a0bc-2983-4922-ae67-d5159bc5156f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:53.560369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ab6a0bc-2983-4922-ae67-d5159bc5156f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:53.567664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ab6a0bc-2983-4922-ae67-d5159bc5156f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1237 microversion: 2.1 time: 0.147877 Apr 09 21:14:53.569885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2475/4991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:53 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:53.613654 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c4342aa-b9ea-4b72-bc71-295744f04bac tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 204 len: 0 microversion: 2.1 time: 0.265229 Apr 09 21:14:53.614586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2517/4992] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:14:53 2022] DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:14:53.622985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:53.623601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:53.630680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.631308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:53.633067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:53.633823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:54.022944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:54.031897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b82abff-5c9f-48e1-a9d3-560bd375c052 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1682 microversion: 2.1 time: 0.412993 Apr 09 21:14:54.032531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2476/4993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:53 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1682 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:54.592894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:54.594265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:54.605745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:54.610507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:54.611508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:54.612249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:54.755113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:54.765211 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-67e45596-2698-4924-a9f3-b496fee88c27 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1241 microversion: 2.1 time: 0.183087 Apr 09 21:14:54.779145 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2518/4994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:54 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:55.051526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:55.052135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:55.063783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:55.064238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:55.075652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:55.076193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:55.787237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:55.787854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:55.800111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:55.803800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:55.804765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:55.805254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:55.985497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:56.001784 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-531bdf91-23ff-4b10-9827-ea95a0f4db52 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1295 microversion: 2.1 time: 0.218899 Apr 09 21:14:56.003155 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2519/4995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:55 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:56.005161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:56.022994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e47f811-d676-4451-b209-4a123eab63bb tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1682 microversion: 2.1 time: 0.973045 Apr 09 21:14:56.033410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2477/4996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:55 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1682 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:57.019616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:57.020247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:57.030706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:57.031068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:57.032302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:57.032911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:57.041675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:57.042294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:57.064574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:57.065833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:57.069302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:57.070008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:57.487268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:57.497430 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b30d5ade-588b-482e-a205-d06f6bfcdba6 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1295 microversion: 2.1 time: 0.481714 Apr 09 21:14:57.500102 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2520/4997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:57 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1295 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:58.158670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:58.182165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70c5be09-7de2-4fd9-9d07-b7e1117ecbc2 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1682 microversion: 2.1 time: 1.146059 Apr 09 21:14:58.182959 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2478/4998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:57 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1682 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:14:58.515207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:58.516765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:58.540295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:58.541292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:58.542395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:58.543077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:59.012985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:59.013652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:59.024431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:59.024975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:59.025802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:59.031421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:59.083334 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f87848fc-6651-425c-9467-44acb72e0f18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.074922 Apr 09 21:14:59.084009 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2479/4999] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Apr 9 21:14:59 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/ips => generated 151 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:14:59.206344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:14:59.206990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:14:59.230964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:59.232417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:59.233302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:14:59.238152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:14:59.681836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:59.691469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9df4ee19-5dc5-4bb1-b8da-7a2f540643aa tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1295 microversion: 2.1 time: 1.179688 Apr 09 21:14:59.692279 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2521/5000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:58 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1295 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:14:59.730548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:14:59.747085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17d6facc-68a3-4d3d-b5df-513e1f7831e0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1614 microversion: 2.1 time: 0.551799 Apr 09 21:14:59.760980 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2480/5001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:14:59 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1614 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:15:00.707709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:00.708328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:00.719557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:00.722651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:00.723484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:00.726010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:00.779691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:00.781454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:00.810527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:00.811184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:00.814993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:00.815707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:01.210048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:01.227516 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae483e3c-9c41-4244-98c2-2f5b77ea2541 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 200 len: 1614 microversion: 2.1 time: 0.453182 Apr 09 21:15:01.240600 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2481/5002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:00 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 1614 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:15:01.254332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6ff61ce5-8254-4ad7-b634-887d74d66825 req-6f700c42-2308-4cd2-b602-5bf6dcf0b862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d6dee3-586e-4cbc-85af-69d9f3a4a151", "name": "network-vif-deleted", "tag": "9592d81b-5138-45a2-ae95-069e629fea7f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:01.277848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6ff61ce5-8254-4ad7-b634-887d74d66825 req-6f700c42-2308-4cd2-b602-5bf6dcf0b862 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:01.281668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6ff61ce5-8254-4ad7-b634-887d74d66825 req-6f700c42-2308-4cd2-b602-5bf6dcf0b862 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:01.316064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6ff61ce5-8254-4ad7-b634-887d74d66825 req-6f700c42-2308-4cd2-b602-5bf6dcf0b862 service nova] Creating event network-vif-deleted:9592d81b-5138-45a2-ae95-069e629fea7f for instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 on nch1-master-1 Apr 09 21:15:01.328209 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6ff61ce5-8254-4ad7-b634-887d74d66825 req-6f700c42-2308-4cd2-b602-5bf6dcf0b862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085794 Apr 09 21:15:01.331059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2482/5003] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:01.508640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:01.510538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:01.531193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:01.532094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:01.537861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:01.539995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:01.645783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lazy-loading 'flavor' on Instance uuid a80d6f9b-c4bf-4bde-8951-0118a622c5b3 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:15:02.293618 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4b452c79-3c77-4e22-8429-04c32151d7af tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/action" status: 202 len: 0 microversion: 2.20 time: 0.791892 Apr 09 21:15:02.294804 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2483/5004] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:15:01 2022] POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:15:02.312808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:02.313571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:02.327637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:02.328897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:02.330923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:02.335629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:02.338005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:02.341459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4513aa19-25b5-46d9-98e6-0a2d63c76f84 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 1.637393 Apr 09 21:15:02.343844 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2522/5005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:00 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:02.358503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:02.364120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:02.378838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. Apr 09 21:15:02.379459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:15:02.379823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:02.380545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:02.381065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-750ce572-1b31-423f-8514-6b7fc4566fc4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 404 len: 111 microversion: 2.1 time: 0.085133 Apr 09 21:15:02.384676 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2484/5006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:02 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:15:02.386887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:02.389677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:02.398268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a107a09-8417-4f7e-a5c1-66aaa3a95877 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '.version_select at 0x7fb098486550>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:02.476200 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a107a09-8417-4f7e-a5c1-66aaa3a95877 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527169081" status: 202 len: 0 microversion: 2.1 time: 0.089178 Apr 09 21:15:02.479097 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2485/5007] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527169081 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:15:03.362321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:03.363692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:03.379846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:03.382866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:03.401153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:03.401700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:03.800073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:03.813752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:03.830445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:03.836082 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a49ca55c-bb3e-4b78-8cb9-db9edeef6c37 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 1.489608 Apr 09 21:15:03.838254 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2523/5008] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:02 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:03.843409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:03.856683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:03.868196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:03.870709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:03.872891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:03.874262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:03.989782 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58536812-72a3-4b12-9515-95f1f5f89d49 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action" status: 200 len: 24576 microversion: 2.1 time: 0.149764 Apr 09 21:15:03.991214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2524/5009] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:15:03 2022] POST /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673/action => generated 24576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:15:04.856609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:04.857520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:04.880253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:04.880923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:04.881848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:04.882414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:04.976733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:04.999156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c86891e7-505d-4536-b36a-8b3fa6260a25 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 1.643049 Apr 09 21:15:05.015211 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2486/5010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:03 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:05.188992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:05.198442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:05.202663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:05.203878 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bc6c7e3e-4160-47de-b230-9e40de2a38ce tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.351806 Apr 09 21:15:05.204452 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2525/5011] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:04 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:05.659362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2a74a095-b995-4cba-a867-43dbb634ec16 req-653d0112-d0fa-469c-b199-38cdf081413d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ae83f5-5cda-4bb8-9808-eec0a42a1ea4", "tag": "f550ab8b-46fc-476d-9e17-cf770f908314"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:05.698526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a74a095-b995-4cba-a867-43dbb634ec16 req-653d0112-d0fa-469c-b199-38cdf081413d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:05.699274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a74a095-b995-4cba-a867-43dbb634ec16 req-653d0112-d0fa-469c-b199-38cdf081413d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:05.736357 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2a74a095-b995-4cba-a867-43dbb634ec16 req-653d0112-d0fa-469c-b199-38cdf081413d service nova] Creating event network-changed:f550ab8b-46fc-476d-9e17-cf770f908314 for instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 on nch1-master-1 Apr 09 21:15:05.746753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2a74a095-b995-4cba-a867-43dbb634ec16 req-653d0112-d0fa-469c-b199-38cdf081413d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093052 Apr 09 21:15:05.747392 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2487/5012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:06.020466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:06.021746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:06.046478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:06.046935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:06.047747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:06.059538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:06.225216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:06.226514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:06.241192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:06.247232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:06.248109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:06.248560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:06.634775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:06.649736 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2158210e-afa9-45b1-acbe-18ab297a40ab tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 0.634147 Apr 09 21:15:06.651103 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2526/5013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:06 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:06.679436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:06.692842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:06.695030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:06.696552 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5eb305a6-e01c-4a47-acd3-d9a57d93ef48 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.477190 Apr 09 21:15:06.697815 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2488/5014] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:06 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:07.348272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: .version_select at 0x7fb08dd1e9d0>, body: {"keypair": {"name": "tempest-keypair-1939155403"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:07.384809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:07.397445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:07.667989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:07.670148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:07.682980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:07.687147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:07.689608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:07.691363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:07.874151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:07.883583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:07.905481 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d979544-d4f6-459f-b7db-7abfa99c407a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.571917 Apr 09 21:15:07.908030 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2527/5015] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:15:07 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:07.931333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:07.933491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:07.950195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:07.950648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:07.954352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:07.954801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:08.669419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:08.709608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fb34dad-b9e9-414a-8423-339c1c116a5c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 1.043516 Apr 09 21:15:08.719321 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2489/5016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:07 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:15:08.728962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:08.729744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:08.736311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:08.736990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:08.737972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:08.738555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:08.753129 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] HTTP exception thrown: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. Apr 09 21:15:08.753960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Returning 404 to user: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:15:08.754993 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a85651a9-ebbe-471d-a7ca-bb3cf991bec6 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 404 len: 111 microversion: 2.42 time: 0.034393 Apr 09 21:15:08.756079 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2490/5017] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:15:08 2022] DELETE /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:15:08.767849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:08.768481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] [instance: 26648861-23d6-4a96-a429-d9a55cf50a16] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:08.778445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:08.779065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:08.779872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:08.780318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:08.796161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] HTTP exception thrown: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. Apr 09 21:15:08.796776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] Returning 404 to user: Instance 26648861-23d6-4a96-a429-d9a55cf50a16 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:15:08.797670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-562063a4-3874-4b9a-a83c-3ebcf2c3c251 tempest-TaggedBootDevicesTest_v242-429285116 tempest-TaggedBootDevicesTest_v242-429285116-project] 10.222.0.30 "GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16" status: 404 len: 111 microversion: 2.42 time: 0.035489 Apr 09 21:15:08.811553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2491/5018] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:08 2022] GET /compute/v2.1/servers/26648861-23d6-4a96-a429-d9a55cf50a16 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:15:09.321460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:09.335254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:09.337210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:09.338496 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-84487b4f-ba54-4bba-9560-21aacfae184a tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 1.428087 Apr 09 21:15:09.339086 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2528/5019] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:07 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:09.741867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:09.746921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:09.762628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:09.764071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:09.765065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:09.765703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:10.357787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:10.358393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:10.370494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:10.372879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:10.377634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:10.378286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:10.403618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:10.416464 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f66ed26-512f-4fce-a090-314e905450d4 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 0.693387 Apr 09 21:15:10.419202 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2492/5020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:09 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:10.942528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:10.957914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:10.960908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:10.963103 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f9f7353-2075-47d4-9c92-b65eb42b7e66 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.609410 Apr 09 21:15:10.964905 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2529/5021] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:10 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:11.439428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:11.442045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:11.454995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:11.456041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:11.457424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:11.459830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:11.993649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:11.994477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:12.012333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:12.013681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:12.016799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:12.017562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:12.169870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:12.180386 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b318703-ede4-4227-8a0a-bdfbf7b0fe72 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 0.748036 Apr 09 21:15:12.182536 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2493/5022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:11 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:12.182536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-206478986", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7"}], "security_groups": [{"name": "tempest-securitygroup--92239994"}], "key_name": "tempest-keypair-1939155403", "user_data": "}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:12.478512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:12.494689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:12.496212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:12.497469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-597b9568-477b-423c-9a1f-6c4e5a0696d7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.516548 Apr 09 21:15:12.508263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2530/5023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:11 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:12.514568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] validate_networks() for [('f2f7c54a-ce1b-46a5-bfae-f5163bfa08d7', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:15:12.785716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2b2ee319-f51a-49fb-8064-b0ef55a038df req-a5e80504-1d43-4223-958e-26eedfc25984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ae83f5-5cda-4bb8-9808-eec0a42a1ea4", "name": "network-vif-plugged", "status": "completed", "tag": "f550ab8b-46fc-476d-9e17-cf770f908314"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:12.810242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b2ee319-f51a-49fb-8064-b0ef55a038df req-a5e80504-1d43-4223-958e-26eedfc25984 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:12.812026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b2ee319-f51a-49fb-8064-b0ef55a038df req-a5e80504-1d43-4223-958e-26eedfc25984 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:12.844334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2b2ee319-f51a-49fb-8064-b0ef55a038df req-a5e80504-1d43-4223-958e-26eedfc25984 service nova] Creating event network-vif-plugged:f550ab8b-46fc-476d-9e17-cf770f908314 for instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 on nch1-master-1 Apr 09 21:15:12.852504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2b2ee319-f51a-49fb-8064-b0ef55a038df req-a5e80504-1d43-4223-958e-26eedfc25984 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071999 Apr 09 21:15:12.853230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2531/5024] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:13.200958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:13.202159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:13.226892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:13.231792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:13.237546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:13.243323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:14.081665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:14.103999 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-77de4d31-a31d-47e4-bda8-e4afab44f8cb tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1362 microversion: 2.1 time: 0.908391 Apr 09 21:15:14.122953 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2532/5025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:13 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1362 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:14.128261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:14.130688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:14.138464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:14.139285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:14.147698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:14.148645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:14.158318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:15:14.159287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:15:14.159918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:15:14.160473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:15:14.161057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:15:14.179566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:14.180204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:14.181205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:14.181853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:14.227083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:14.235081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Getting quotas for user a6dcb8344fde4e4580e73efc09e633a7 and project 92f38b2c41e34e73bd6baa83478dddfa. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:14.275541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:15:14.282478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:15:14.400861 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7de1605b-308e-4e35-9970-5b29cb5bf3c5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.218042 Apr 09 21:15:14.408868 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2494/5026] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:15:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:15:14.419031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9620d00-cd7a-4cf2-b56f-efbbdda3c161 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:14.419658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b9620d00-cd7a-4cf2-b56f-efbbdda3c161 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:14.631499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b9620d00-cd7a-4cf2-b56f-efbbdda3c161 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:14.643839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9620d00-cd7a-4cf2-b56f-efbbdda3c161 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1241 microversion: 2.1 time: 0.227224 Apr 09 21:15:14.646368 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2495/5027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:14 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:14.754175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:14.770286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:14.772186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:14.773663 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99430c42-6c49-4880-96f3-342a89fb86f1 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1743 microversion: 2.20 time: 0.649386 Apr 09 21:15:14.774412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2533/5028] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:14 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1743 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:15.139373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:15.140306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:15.149051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.149880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.151693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.152454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.661327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:15.662019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:15.677676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.678138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.678941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.679381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.682409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:15.702671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87f90321-de33-4a8f-bb61-b69b5f16aca7 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1547 microversion: 2.1 time: 0.567457 Apr 09 21:15:15.711458 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2496/5029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:15 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1547 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:15.723024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:15.723593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:15.762128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.763697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.766135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.768886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.826637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:15.842888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c22d200-ce40-4f7d-9216-9595e691808a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1293 microversion: 2.1 time: 0.185603 Apr 09 21:15:15.843787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2534/5030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:15 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:15:15.852740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:15.861666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:15.879198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.879668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:15.880459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:15.880935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:16.463939 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff0ea34c-1b96-4de3-a63d-41445b6d398c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.748554 Apr 09 21:15:16.464557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2497/5031] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:15:15 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-interface => generated 284 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:16.636159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c3835adf-e852-436b-8eb6-0de176a47fe2 req-60e4ba3a-03d0-4b40-92fd-7cd376c1ae79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "name": "network-vif-plugged", "status": "completed", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:16.647213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3835adf-e852-436b-8eb6-0de176a47fe2 req-60e4ba3a-03d0-4b40-92fd-7cd376c1ae79 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:16.647670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c3835adf-e852-436b-8eb6-0de176a47fe2 req-60e4ba3a-03d0-4b40-92fd-7cd376c1ae79 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:16.673530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c3835adf-e852-436b-8eb6-0de176a47fe2 req-60e4ba3a-03d0-4b40-92fd-7cd376c1ae79 service nova] Creating event network-vif-plugged:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch2-master-1 Apr 09 21:15:16.695920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c3835adf-e852-436b-8eb6-0de176a47fe2 req-60e4ba3a-03d0-4b40-92fd-7cd376c1ae79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058010 Apr 09 21:15:16.698823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2498/5032] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:15:16.850423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:16.869395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:16.872564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:16.898616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:16.901765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:16.903452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:16.904816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:16.906627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:16.908260 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef7fcef9-df92-4559-b5ed-b704083839c5 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1743 microversion: 2.20 time: 1.063304 Apr 09 21:15:16.908998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:16.913402 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2535/5033] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:15 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1743 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:17.064601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:17.072838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbacdef5-8b7f-4d1b-8443-ca1b7813f971 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1299 microversion: 2.1 time: 0.212404 Apr 09 21:15:17.076923 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2499/5034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:16 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:17.952565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:17.955250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:17.980870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:17.982384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:17.983959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:17.984610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:18.236787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:18.237722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:18.250320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:18.250796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:18.252201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:18.253119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:18.577305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:18.588603 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b467d37-d2d8-44e8-b8d2-ae98fc78c462 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1299 microversion: 2.1 time: 0.498934 Apr 09 21:15:18.589432 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2500/5035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:18 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1299 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:19.291468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:19.304283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:19.312338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:19.314204 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f577453d-0999-460f-af64-9fdfffe10420 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1743 microversion: 2.20 time: 1.385457 Apr 09 21:15:19.315317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2536/5036] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:17 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1743 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:19.605945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:19.607429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:19.623679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:19.626669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:19.627538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:19.627985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:20.028739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0c5accd7-7495-46ee-ba7d-4c34673b7c44 req-d83a2551-fdaa-4c3e-b424-c2a0b251d0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ae83f5-5cda-4bb8-9808-eec0a42a1ea4", "tag": "f550ab8b-46fc-476d-9e17-cf770f908314"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:20.044046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0c5accd7-7495-46ee-ba7d-4c34673b7c44 req-d83a2551-fdaa-4c3e-b424-c2a0b251d0a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:20.044400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0c5accd7-7495-46ee-ba7d-4c34673b7c44 req-d83a2551-fdaa-4c3e-b424-c2a0b251d0a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:20.084259 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0c5accd7-7495-46ee-ba7d-4c34673b7c44 req-d83a2551-fdaa-4c3e-b424-c2a0b251d0a9 service nova] Creating event network-changed:f550ab8b-46fc-476d-9e17-cf770f908314 for instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 on nch1-master-1 Apr 09 21:15:20.120946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0c5accd7-7495-46ee-ba7d-4c34673b7c44 req-d83a2551-fdaa-4c3e-b424-c2a0b251d0a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077676 Apr 09 21:15:20.123311 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2537/5037] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:15:20.336321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:20.338289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:20.358465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:20.360494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:20.361364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:20.361813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:21.019990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:21.041203 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b34ed8be-113a-4c8d-b505-b94dc120fa7b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 1.432491 Apr 09 21:15:21.043972 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2501/5038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:19 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:21.456112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:21.467222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:21.477276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:21.478831 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cbd05b33-a1db-4cd8-866d-e963ed0748bc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.149654 Apr 09 21:15:21.479555 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2538/5039] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:20 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:22.062061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:22.062823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:22.084220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:22.092147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:22.099334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:22.102458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:22.500515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:22.501824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:22.526417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:22.535274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:22.536318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:22.539915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:23.820418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:23.832145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9721d17f-f6e4-4e02-a384-2b60a63a4ca4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 1.774411 Apr 09 21:15:23.843369 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2502/5040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:22 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:24.366057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:24.376097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:24.394065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:24.395949 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61a17ec2-3fd4-4593-9628-9b6818cd156c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.901854 Apr 09 21:15:24.400538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2539/5041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:22 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:24.850575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:24.851982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:24.875641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:24.876358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:24.877421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:24.878084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:25.419691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:25.421175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:25.432086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:25.432922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:25.475202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:25.477521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:25.940815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:25.991658 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7109be2-2bd3-421c-ac47-b9be634fcfd3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 1.140917 Apr 09 21:15:25.995841 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2503/5042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:24 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:26.061681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:26.077255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:26.078810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:26.080307 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3710952d-0177-4d31-b1fc-f8bbc5b9056e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 0.666355 Apr 09 21:15:26.101973 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2540/5043] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:25 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:26.203143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cea7c835-433e-4132-9ecf-7bc2bbce3bf1 req-4944300a-cd2e-405f-9123-aa317239c4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f677bb6-c97f-4574-9104-3a2fb5dd4ae6", "tag": "9fd8a7ed-acf3-4312-8c33-6e136c187474"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:26.225663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cea7c835-433e-4132-9ecf-7bc2bbce3bf1 req-4944300a-cd2e-405f-9123-aa317239c4c3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:26.228455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cea7c835-433e-4132-9ecf-7bc2bbce3bf1 req-4944300a-cd2e-405f-9123-aa317239c4c3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:26.271530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cea7c835-433e-4132-9ecf-7bc2bbce3bf1 req-4944300a-cd2e-405f-9123-aa317239c4c3 service nova] Creating event network-changed:9fd8a7ed-acf3-4312-8c33-6e136c187474 for instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 on nch2-master-1 Apr 09 21:15:26.280003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cea7c835-433e-4132-9ecf-7bc2bbce3bf1 req-4944300a-cd2e-405f-9123-aa317239c4c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081153 Apr 09 21:15:26.282107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2504/5044] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:26.759486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:26.760162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:26.776882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:26.777371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:26.778175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:26.778620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:26.989955 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d22d368-2330-4e1b-a6f9-978d5092314e tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1831 microversion: 2.1 time: 0.234277 Apr 09 21:15:26.994272 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2541/5045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:26 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1831 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:27.017522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:27.023919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:27.063155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:27.063891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:27.064990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:27.073233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:27.102828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:27.104048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:27.124065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:27.124883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:27.130210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:27.131191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:28.683789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:28.693329 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-49290806-872b-4b45-ad7f-59c58a1eb255 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 1.686975 Apr 09 21:15:28.697598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2505/5046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:27 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:28.706905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:28.723674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:28.725587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:28.727094 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1026e31c-1810-41f1-bcdb-7d3762ad5a26 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.629459 Apr 09 21:15:28.738236 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2542/5047] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:27 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:29.759545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:29.761144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:29.762634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:29.768484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:29.800441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:29.800963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:29.801868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:29.802983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:29.803585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:29.804391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:29.805968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:29.807530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:30.922291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:30.940913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:30.947633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:30.952018 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f052fcf1-3128-4e56-bced-779318073f0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.209823 Apr 09 21:15:30.952457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:30.952987 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2543/5048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:29 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:30.975522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e0fb01d-2304-4b4c-9adc-5c91f5ae9266 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 1.264278 Apr 09 21:15:30.976965 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2506/5049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:29 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:31.058997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:31.059513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:31.076511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:31.080809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:31.081936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:31.082404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:31.114001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-aa4d55cb-cca9-4ec2-b862-1c152b86856e req-676e76f4-ee0a-4247-a006-01310831304c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:31.130261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa4d55cb-cca9-4ec2-b862-1c152b86856e req-676e76f4-ee0a-4247-a006-01310831304c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:31.133304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-aa4d55cb-cca9-4ec2-b862-1c152b86856e req-676e76f4-ee0a-4247-a006-01310831304c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:31.173644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:15:31.179712 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-aa4d55cb-cca9-4ec2-b862-1c152b86856e req-676e76f4-ee0a-4247-a006-01310831304c service nova] Creating event network-changed:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch2-master-1 Apr 09 21:15:31.194279 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-aa4d55cb-cca9-4ec2-b862-1c152b86856e req-676e76f4-ee0a-4247-a006-01310831304c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088652 Apr 09 21:15:31.196304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2507/5050] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 09 21:15:31.379431 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-520b6a64-4e4c-44bb-a017-72b834936b0f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 204 len: 0 microversion: 2.1 time: 0.323997 Apr 09 21:15:31.384681 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2544/5051] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:15:31 2022] DELETE /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:15:31.399442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:31.400329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:31.412810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:31.415628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:31.430862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:31.431780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:31.974327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:31.975907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:31.999723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:32.006269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:32.010133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:32.014515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:32.365411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:32.381487 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65f73bc2-3210-4be6-9add-e2596ac14c3b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1686 microversion: 2.1 time: 0.990031 Apr 09 21:15:32.386955 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2508/5052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:31 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1686 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:32.396082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:32.396695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:32.412367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:32.417583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:32.419157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:32.419770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:32.685938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:32.706542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3786f85e-d80c-47b2-9b01-075e89887880 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 0.317924 Apr 09 21:15:32.707451 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2509/5053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:32 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:32.819766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:32.833855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:32.841328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:32.859946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b381885-91cd-4507-8a76-8de2a9a2b5f2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 0.889071 Apr 09 21:15:32.861363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2545/5054] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:31 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:33.399628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:33.401423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:33.413915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:33.421079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:33.422454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:33.430593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:33.724279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:33.725997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:33.758714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:33.759665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:33.760947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:33.769671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:34.236767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:34.248204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dc6ecefc-e9b9-44e5-9fe4-2ca8684ea7f1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1686 microversion: 2.1 time: 0.852690 Apr 09 21:15:34.253342 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2510/5055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:33 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1686 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:34.269012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:34.274391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:34.288911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:34.292368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:34.308694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:34.311240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:34.350070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:34.368973 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-faa36037-57ee-48e1-976f-50c6addcc5f7 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 0.640944 Apr 09 21:15:34.385532 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2546/5056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:33 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:15:34.679278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:34.697593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:34.708441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:34.719567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f382227c-78e1-4bc4-b8c6-141f925d2574 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 0.461483 Apr 09 21:15:34.720449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2511/5057] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:34 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:34.942141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4d52db0b-49b6-4f89-bc70-1c04f8bf0552 req-59cab45a-a81c-4038-a865-55561d535938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f677bb6-c97f-4574-9104-3a2fb5dd4ae6", "name": "network-vif-plugged", "status": "completed", "tag": "9fd8a7ed-acf3-4312-8c33-6e136c187474"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:34.960422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4d52db0b-49b6-4f89-bc70-1c04f8bf0552 req-59cab45a-a81c-4038-a865-55561d535938 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:34.964464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4d52db0b-49b6-4f89-bc70-1c04f8bf0552 req-59cab45a-a81c-4038-a865-55561d535938 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:34.988667 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4d52db0b-49b6-4f89-bc70-1c04f8bf0552 req-59cab45a-a81c-4038-a865-55561d535938 service nova] Creating event network-vif-plugged:9fd8a7ed-acf3-4312-8c33-6e136c187474 for instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 on nch2-master-1 Apr 09 21:15:35.000596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4d52db0b-49b6-4f89-bc70-1c04f8bf0552 req-59cab45a-a81c-4038-a865-55561d535938 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065134 Apr 09 21:15:35.010781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2547/5058] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:35.303440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:35.304228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:35.319391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.319784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.320581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.321027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.393069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:35.393902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:35.408733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.410393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.413196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.414948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.537635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:35.546877 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7509711e-8868-4e1b-bf99-ff6c1ea03ab3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1501 microversion: 2.1 time: 0.277707 Apr 09 21:15:35.549358 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2512/5059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:35 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:35.554352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-31138054-3fd7-41eb-9883-e61a5a8a5999 req-ed807142-fcd0-4d38-b2eb-d62b4791d6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84835-9825-41f5-b4d4-d960e79d1673", "name": "network-vif-deleted", "tag": "22016826-f680-47d2-85f4-3569f1c8e8d1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:35.563791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-31138054-3fd7-41eb-9883-e61a5a8a5999 req-ed807142-fcd0-4d38-b2eb-d62b4791d6fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.566611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-31138054-3fd7-41eb-9883-e61a5a8a5999 req-ed807142-fcd0-4d38-b2eb-d62b4791d6fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.583960 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-31138054-3fd7-41eb-9883-e61a5a8a5999 req-ed807142-fcd0-4d38-b2eb-d62b4791d6fd service nova] Creating event network-vif-deleted:22016826-f680-47d2-85f4-3569f1c8e8d1 for instance cab84835-9825-41f5-b4d4-d960e79d1673 on nch2-master-1 Apr 09 21:15:35.598308 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-31138054-3fd7-41eb-9883-e61a5a8a5999 req-ed807142-fcd0-4d38-b2eb-d62b4791d6fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047344 Apr 09 21:15:35.599812 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2513/5060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:35.741375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:35.743456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:35.778990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.781951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:35.783269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:35.791237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:36.064625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:36.080174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b8ae959-2d47-407e-9806-c2891fdaca77 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1365 microversion: 2.1 time: 0.691808 Apr 09 21:15:36.081298 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2548/5061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:35 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1365 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:36.345592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:36.379861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:36.384121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:36.385994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f14d5930-7021-44e3-ae0d-5c453e9738ab tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 0.649245 Apr 09 21:15:36.386583 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2514/5062] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:35 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:36.568038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:36.568672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:36.579096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:36.579537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:36.580321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:36.580759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:36.732453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:36.733281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:36.748270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lazy-loading 'fault' on Instance uuid cab84835-9825-41f5-b4d4-d960e79d1673 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:15:36.860520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:36.885864 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ce007f5-9997-4de3-9248-629cfe355056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 200 len: 1355 microversion: 2.1 time: 0.323833 Apr 09 21:15:36.886803 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2549/5063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:36 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 1355 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:37.103357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:37.105413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:37.114996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.117601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.119229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.120424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.406743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:37.407510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:37.417192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.419903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.421912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.426755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.663395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:37.672157 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64e9bc52-c726-4937-9af2-6b7d60fc6bae tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1555 microversion: 2.1 time: 0.578646 Apr 09 21:15:37.693744 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2515/5064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:37 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1555 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:37.700619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:37.701389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:37.714838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.717821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.718824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.719613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.865526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb623c0e-e16b-4a04-958b-765823df7d6f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169793 Apr 09 21:15:37.866477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2516/5065] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:15:37 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:37.904330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:37.905412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: cab84835-9825-41f5-b4d4-d960e79d1673] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:37.913826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.920430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.921860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:37.922474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:37.954898 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] HTTP exception thrown: Instance cab84835-9825-41f5-b4d4-d960e79d1673 could not be found. Apr 09 21:15:37.957824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Returning 404 to user: Instance cab84835-9825-41f5-b4d4-d960e79d1673 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:15:37.958966 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4511f77-2510-49c2-a728-2be15cef6b70 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673" status: 404 len: 111 microversion: 2.1 time: 0.059278 Apr 09 21:15:37.965846 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2517/5066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:37 2022] GET /compute/v2.1/servers/cab84835-9825-41f5-b4d4-d960e79d1673 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:15:38.401089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:38.411887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:38.413513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:38.414600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7f7773a-9041-44cb-a1ff-b1186833b2b6 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.013085 Apr 09 21:15:38.415179 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2550/5067] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:37 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:39.436087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:39.437325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:39.457711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:39.467715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:39.469642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:39.470256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:41.442472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:41.477464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:41.479077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:41.480334 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dfd5a32f-5f35-4729-9c1d-191231f7c7cb tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 2.048185 Apr 09 21:15:41.487156 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2518/5068] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:39 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:42.506238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:42.506939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:42.519548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:42.520874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:42.522134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:42.522854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:43.355154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:43.375846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:43.380449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:43.384911 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0256c5da-77c1-4e2c-ad52-078ed16f7269 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 0.882870 Apr 09 21:15:43.387864 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2551/5069] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:42 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:44.413950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:44.415928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:44.425898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:44.426673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:44.427682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:44.428432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:45.818982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:45.844334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:45.847972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:45.852581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-015423ca-6bdf-493c-97e7-d7257ba9b30d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1738 microversion: 2.20 time: 1.443679 Apr 09 21:15:45.855743 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2519/5070] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:44 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1738 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:46.488067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-459f7506-6360-45cc-bd87-67718a0a117f req-ea040ca9-b057-4e94-9573-102bcefa6d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f677bb6-c97f-4574-9104-3a2fb5dd4ae6", "tag": "9fd8a7ed-acf3-4312-8c33-6e136c187474"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:46.508774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-459f7506-6360-45cc-bd87-67718a0a117f req-ea040ca9-b057-4e94-9573-102bcefa6d90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:46.509525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-459f7506-6360-45cc-bd87-67718a0a117f req-ea040ca9-b057-4e94-9573-102bcefa6d90 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:46.523714 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-459f7506-6360-45cc-bd87-67718a0a117f req-ea040ca9-b057-4e94-9573-102bcefa6d90 service nova] Creating event network-changed:9fd8a7ed-acf3-4312-8c33-6e136c187474 for instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 on nch2-master-1 Apr 09 21:15:46.546358 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-459f7506-6360-45cc-bd87-67718a0a117f req-ea040ca9-b057-4e94-9573-102bcefa6d90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076090 Apr 09 21:15:46.547392 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2552/5071] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:46.872391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:46.873770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:46.891385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:46.892145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:46.893173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:46.893806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:47.342688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:47.343558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:47.356529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:47.361397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:47.363743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:47.365457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:47.464749 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0acaa96-4915-4327-b46c-fa339e6d983a tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/ips" status: 200 len: 145 microversion: 2.1 time: 0.125928 Apr 09 21:15:47.478179 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2553/5072] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:15:47 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:15:48.579651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:48.595154 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:48.596914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:48.598365 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-990930a7-e980-44ca-8110-b886d9e45510 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1720 microversion: 2.20 time: 1.730383 Apr 09 21:15:48.602247 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2520/5073] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:46 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1720 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:49.306093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-25827063-d72b-43ab-854f-6484d2c38eda req-84ebcf29-441d-4e3e-abaf-78cef94a38d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:49.323546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-25827063-d72b-43ab-854f-6484d2c38eda req-84ebcf29-441d-4e3e-abaf-78cef94a38d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:49.324279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-25827063-d72b-43ab-854f-6484d2c38eda req-84ebcf29-441d-4e3e-abaf-78cef94a38d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:49.343102 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-25827063-d72b-43ab-854f-6484d2c38eda req-84ebcf29-441d-4e3e-abaf-78cef94a38d3 service nova] Creating event network-vif-unplugged:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch2-master-1 Apr 09 21:15:49.353280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-25827063-d72b-43ab-854f-6484d2c38eda req-84ebcf29-441d-4e3e-abaf-78cef94a38d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.368844 Apr 09 21:15:49.357650 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2554/5074] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:49.439275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87a4f7ac-5834-4bfb-aca8-28b95fd56bdb"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:49.440590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:49.455087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:49.457319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:49.460559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:49.465769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:49.627546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:49.628316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:49.651906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:49.654415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:49.656258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:49.658245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:49.829773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36aac146-0eaf-4184-83c5-19d9df969ba5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395229 Apr 09 21:15:49.836885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2521/5075] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:15:49 2022] POST /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:50.354970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Action: 'create', calling method: .version_select at 0x7fb08e2921f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2036262543"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:50.374135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for project a2e537a0863d43df811118a31e20609c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:50.382600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for user 8303163dfe6c44dc8552919975c72eba and project a2e537a0863d43df811118a31e20609c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:50.755231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for project a2e537a0863d43df811118a31e20609c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:50.761767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for user 8303163dfe6c44dc8552919975c72eba and project a2e537a0863d43df811118a31e20609c. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:50.784852 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7edb4be4-152b-43b1-bdc3-e65301cfd9da tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.436465 Apr 09 21:15:50.786785 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2522/5076] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:51.055578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:51.065178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:51.066667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:51.072484 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a89ce1c8-0b1e-4e67-8786-971478d18429 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1720 microversion: 2.20 time: 1.456815 Apr 09 21:15:51.075897 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2555/5077] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:49 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1720 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:52.094892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:52.096466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:52.116387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:52.117512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:52.121414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:52.122790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:52.669581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:52.690619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:52.693703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:52.699823 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64506389-6779-4255-8307-c92ff72752b2 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1663 microversion: 2.20 time: 0.609010 Apr 09 21:15:52.704581 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2523/5078] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:52 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1663 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:52.730623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4e2ef7c-1f94-4c30-8c14-8c01141e174a"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:52.732411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:52.741894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:52.742574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:52.743625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:52.744206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.047114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-517489716", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "fc7f341d-80bd-4d4e-b4fe-3dfca09d2534"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:53.117681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] validate_networks() for [('fc7f341d-80bd-4d4e-b4fe-3dfca09d2534', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:15:53.269163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-abf34a80-3dc6-4e08-96a5-2a966a3cb917 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.548692 Apr 09 21:15:53.270109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2556/5079] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Apr 9 21:15:52 2022] POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments => generated 188 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:15:53.317074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:53.318640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:53.327487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.328041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.329956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.330764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.366583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-57032b55-437e-41db-a262-ff44c2cc80ad tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055541 Apr 09 21:15:53.367641 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2557/5080] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:15:53 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:15:53.378983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:53.380271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:53.388481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.389553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.390932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.391579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.453529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb36f3bb-f74f-4419-bebe-9639493ab759 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb" status: 200 len: 194 microversion: 2.1 time: 0.073976 Apr 09 21:15:53.453529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2558/5081] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Apr 9 21:15:53 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:53.458417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:53.459023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:53.474461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.475387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.476487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.477371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.824407 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fdcc5b41-76dd-4e2d-ba17-da903274c629 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments/f4e2ef7c-1f94-4c30-8c14-8c01141e174a" status: 202 len: 0 microversion: 2.20 time: 0.373878 Apr 09 21:15:53.829238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2559/5082] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Apr 9 21:15:53 2022] DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments/f4e2ef7c-1f94-4c30-8c14-8c01141e174a => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:15:53.929616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:53.930714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:53.943715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.944500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:53.946593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:53.949357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:54.104538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe435053-1fcb-47a1-a265-3ae9da1c05ac tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/action" status: 202 len: 0 microversion: 2.20 time: 0.178232 Apr 09 21:15:54.106164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2560/5083] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Apr 9 21:15:53 2022] POST /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:15:54.116254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ec0b11a-019d-4a5c-97e8-19a49a3b222a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '.version_select at 0x7fb08dbb0310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:54.146169 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ec0b11a-019d-4a5c-97e8-19a49a3b222a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-683740399" status: 202 len: 0 microversion: 2.1 time: 0.035620 Apr 09 21:15:54.146752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2561/5084] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Apr 9 21:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-683740399 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:15:54.156138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:54.157015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:54.200937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:54.201508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:54.203046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:54.203962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:54.696069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:15:54.696596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:15:54.697173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:15:54.697875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:15:54.698670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:15:54.715847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:54.716454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:54.717548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:54.718183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:54.753551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Getting quotas for project 7525a2e03c554c339134407c220d5499. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:54.774939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Getting quotas for user 5145fae3fdfd41f0ad5f1e1fe59558f0 and project 7525a2e03c554c339134407c220d5499. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:54.793961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Going to run 2 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:15:54.796649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 68d97087-edbc-447d-9589-45ec66ce060f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:15:54.833350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=68d97087-edbc-447d-9589-45ec66ce060f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:15:54.897200 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65d35b30-7975-40f0-b316-59233a8b23b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958810 Apr 09 21:15:54.899229 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2524/5085] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:15:54.908924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: .version_select at 0x7fb08e1f3790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1525650353"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:54.931984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:54.944305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:55.031243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:55.053409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:55.061799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:55.064426 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d018a144-cfdf-436c-800f-bd64a857d46c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1671 microversion: 2.20 time: 0.916424 Apr 09 21:15:55.065994 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2562/5086] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:54 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1671 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:55.079131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:55.087333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:55.088286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Searching by: {'deleted': False, 'project_id': '7525a2e03c554c339134407c220d5499'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:15:55.115929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:55.128872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:55.129993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:55.144565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:55.184510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:55.190657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:55.205560 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7b67e21-7aba-4d03-b71e-a6462e34420c tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.137561 Apr 09 21:15:55.206342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2563/5087] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:15:55 2022] GET /compute/v2.1/servers => generated 675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:55.213588 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ca83c73-cb73-4cdc-a840-81c8a0dd0e77 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.312867 Apr 09 21:15:55.214445 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2525/5088] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:15:54 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:55.215564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bec28885-9341-45d2-8167-2a84ee06888a"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:55.217657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:55.230285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81182dca-d396-40c4-9b91-4c88f54809ae tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:55.231276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81182dca-d396-40c4-9b91-4c88f54809ae tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:55.237295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:55.238011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:55.240212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:55.243123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:55.459671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81182dca-d396-40c4-9b91-4c88f54809ae tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:55.477286 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81182dca-d396-40c4-9b91-4c88f54809ae tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1219 microversion: 2.1 time: 0.259034 Apr 09 21:15:55.489665 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2526/5089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:55 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1219 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:55.782933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e19e7a3-8a0f-4759-9dff-425827a726bc tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "POST /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558370 Apr 09 21:15:55.787413 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2564/5090] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:15:55 2022] POST /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:55.926833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-28992654", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "77d8a986-eb34-4d3a-9ad7-5ad1b19954dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2036262543", "security_groups": [{"name": "tempest-secgroup-smoke-753836868"}], "networks": [{"uuid": "6224e166-ef4d-46aa-a3a6-6d9016c554e1"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:15:56.087091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:56.087815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:56.125071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:56.127249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:56.131744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:56.132879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:56.471763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] validate_networks() for [('6224e166-ef4d-46aa-a3a6-6d9016c554e1', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:15:57.187642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:57.207173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:57.208996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:57.211035 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22bbd308-c730-4623-85eb-557db4de8081 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1673 microversion: 2.20 time: 1.130003 Apr 09 21:15:57.212049 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2565/5091] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:56 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1673 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:15:57.219401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:57.220189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:57.231246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:57.232021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:57.233004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:57.235354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:57.470403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:57.486278 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-36aae17a-7eb5-4ec4-8122-b688cbb022e0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1271 microversion: 2.1 time: 0.271583 Apr 09 21:15:57.486982 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2566/5092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:57 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:58.232233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:58.233497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:58.261519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:58.261987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:58.267293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:58.270052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.058875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:59.067046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:59.068764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:59.069962 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb25494f-f5f1-46bc-8ebe-cb7e8cf2f30e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.841967 Apr 09 21:15:59.081167 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2567/5093] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:15:58 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:15:59.086733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:59.087646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:59.094841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.095576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.096516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.097195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.239122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:15:59.239622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:15:59.240139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:15:59.240607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:15:59.241155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:15:59.261572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.262668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.263689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.265299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.296109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for project a2e537a0863d43df811118a31e20609c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:15:59.306831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Getting quotas for user 8303163dfe6c44dc8552919975c72eba and project a2e537a0863d43df811118a31e20609c. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:15:59.353681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:15:59.367683 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ddc645b8-674a-4bff-ba9f-ea1fdc6b2f62 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1277 microversion: 2.1 time: 0.284231 Apr 09 21:15:59.370835 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2568/5094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:59 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:15:59.400543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:15:59.402283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:59.402844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77d8a986-eb34-4d3a-9ad7-5ad1b19954dd',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:15:59.403685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:59.418870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.419520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.420460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.421119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.524170 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17caa2ab-2048-4ce5-8a41-ec159ecba428 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.100144 Apr 09 21:15:59.524170 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2569/5095] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:15:59 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:15:59.649663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:59.650169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:59.660300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.660764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.661595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.662036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.678842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.756025 Apr 09 21:15:59.680947 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2527/5096] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:15:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:15:59.696339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-74815052-152c-4703-9f67-f99c5b03ffa5 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:59.698211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-74815052-152c-4703-9f67-f99c5b03ffa5 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:59.758687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d0e38266-c2a1-4db9-b81c-97d28fddd32e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb" status: 200 len: 194 microversion: 2.1 time: 0.113306 Apr 09 21:15:59.760127 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2570/5097] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Apr 9 21:15:59 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:15:59.769614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:15:59.770011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:15:59.777452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.779618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.780583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:15:59.784876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:15:59.899596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lazy-loading 'services' on Instance uuid 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:15:59.991292 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41ee141e-524f-4a81-9a5a-1099c72fc255 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb" status: 202 len: 0 microversion: 2.1 time: 0.225794 Apr 09 21:15:59.992217 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2571/5098] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:15:59 2022] DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/87a4f7ac-5834-4bfb-aca8-28b95fd56bdb => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:16:00.043857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-74815052-152c-4703-9f67-f99c5b03ffa5 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:00.054369 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-74815052-152c-4703-9f67-f99c5b03ffa5 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1097 microversion: 2.1 time: 0.367308 Apr 09 21:16:00.065984 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2528/5099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:15:59 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1097 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:00.090076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:00.091501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:00.109634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:00.110215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:00.111595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:00.112184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:00.390693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:00.391558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:00.413431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:00.415689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:00.417920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:00.420011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:00.651550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:00.669805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-67df296e-e5a2-4110-8e21-edcefaca5815 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1277 microversion: 2.1 time: 0.286097 Apr 09 21:16:00.685732 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2529/5100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:00 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:00.771448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:00.792592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:00.800321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:00.801786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bbd5ac7f-404c-4bb3-b577-4b1d72b1253b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.717271 Apr 09 21:16:00.802472 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2572/5101] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:00 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:01.073762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:01.074711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:01.081179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.081867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.082914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.083528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.255761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-41a135f5-84da-4164-ae30-4741290376e5 req-4889cefd-54d4-4339-82b3-3464ac8e9bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:01.272624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-41a135f5-84da-4164-ae30-4741290376e5 req-4889cefd-54d4-4339-82b3-3464ac8e9bdc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.273119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-41a135f5-84da-4164-ae30-4741290376e5 req-4889cefd-54d4-4339-82b3-3464ac8e9bdc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.294950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-41a135f5-84da-4164-ae30-4741290376e5 req-4889cefd-54d4-4339-82b3-3464ac8e9bdc service nova] Creating event network-changed:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch1-master-1 Apr 09 21:16:01.302053 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-41a135f5-84da-4164-ae30-4741290376e5 req-4889cefd-54d4-4339-82b3-3464ac8e9bdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158008 Apr 09 21:16:01.303327 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2573/5102] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:01.309817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:01.310775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:01.317872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.318756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.319724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.320442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.363303 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85040f92-2399-4158-bd0d-a2a7d44e9147 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/bec28885-9341-45d2-8167-2a84ee06888a" status: 200 len: 194 microversion: 2.1 time: 0.058179 Apr 09 21:16:01.364447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2574/5103] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Apr 9 21:16:01 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/bec28885-9341-45d2-8167-2a84ee06888a => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:01.375633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:01.376295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:01.385613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.386209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.387109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.387844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.403452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:01.417415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0e6f906-8b6f-44a7-af7d-6304a139059d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1213 microversion: 2.1 time: 0.344984 Apr 09 21:16:01.418892 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2530/5104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:01 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1213 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:01.537962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lazy-loading 'services' on Instance uuid 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:16:01.660589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43f3611d-abe2-405f-b67b-291475a2b3da tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/bec28885-9341-45d2-8167-2a84ee06888a" status: 202 len: 0 microversion: 2.1 time: 0.289209 Apr 09 21:16:01.661992 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2575/5105] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:16:01 2022] DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments/bec28885-9341-45d2-8167-2a84ee06888a => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:16:01.697444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:01.699950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:01.735897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.736419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.741000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.741658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.829368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:01.831343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:01.838714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.839742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:01.841635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:01.842668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:02.814200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:02.822165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a523c1c-b8da-4d82-beba-f5f0f37a71b7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 1.132263 Apr 09 21:16:02.833546 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2531/5106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:01 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:02.838794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:02.839636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:02.853283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:02.853733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:02.854529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:02.854962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:02.962869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:02.976828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:02.978430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:02.979626 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23aef078-bf82-4c58-8806-cdb212350e33 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 1.155264 Apr 09 21:16:02.980248 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2576/5107] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:01 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:02.994004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:02.995030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:03.001398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.001856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.002646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.003081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.052675 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c8f2cc4-1b38-4f70-83cb-b91d10796931 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071294 Apr 09 21:16:03.053577 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2577/5108] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:16:02 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:16:03.211714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:03.212956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:03.221123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.222448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.223336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.224245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.282243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd8172a5-9c35-4764-beaa-152d8d9b5011 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075386 Apr 09 21:16:03.283075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2578/5109] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:16:03 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 21:16:03.351208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:03.351729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:03.358746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.359279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.360139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.361463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.397084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:03.513585 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50c363fe-7138-40aa-aa4b-ccb506b4871e tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 204 len: 0 microversion: 2.1 time: 0.167592 Apr 09 21:16:03.514690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2579/5110] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:03 2022] DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:16:03.524088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:03.524839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:03.531781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.532240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.533020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.533478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.659568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:03.668405 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f84d51b-b22a-4cda-a47a-76be3d2667af tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 0.833324 Apr 09 21:16:03.669026 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2532/5111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:02 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:03.851531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:03.852810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:03.860616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.861212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.862147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:03.862632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:03.943822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:03.956679 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4c1f933-ad2d-40d9-9a80-6d4d43e5940f tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1672 microversion: 2.1 time: 0.436842 Apr 09 21:16:03.967687 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2580/5112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:03 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1672 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:04.001002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:04.002080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:04.014693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.015325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.016199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.016705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.395411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:04.408662 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-832c6301-45eb-408d-82ae-d81dd83d5098 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.559127 Apr 09 21:16:04.411052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2533/5113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:03 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:04.559693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:04.584749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:04.587842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:04.593693 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e06868d5-9cbd-491c-b679-4592cef2aa80 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.599011 Apr 09 21:16:04.594318 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2581/5114] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:03 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:04.688138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:04.688769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:04.700124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.701330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.702383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.703272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.914326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dc8c8001-4126-4a52-a3fa-17cad77fb05f req-0ecf4bfc-89d0-4370-80bd-b357b75efe67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:04.934532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dc8c8001-4126-4a52-a3fa-17cad77fb05f req-0ecf4bfc-89d0-4370-80bd-b357b75efe67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.938848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dc8c8001-4126-4a52-a3fa-17cad77fb05f req-0ecf4bfc-89d0-4370-80bd-b357b75efe67 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.952370 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dc8c8001-4126-4a52-a3fa-17cad77fb05f req-0ecf4bfc-89d0-4370-80bd-b357b75efe67 service nova] Creating event network-changed:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:16:04.960711 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dc8c8001-4126-4a52-a3fa-17cad77fb05f req-0ecf4bfc-89d0-4370-80bd-b357b75efe67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058503 Apr 09 21:16:04.966620 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2582/5115] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:04.974687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:04.984462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:04.992201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.993318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:04.996200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:04.996664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:05.901474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:05.911142 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4598a8e5-eae1-46df-902c-17d4c1795736 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 1.228617 Apr 09 21:16:05.919607 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2534/5116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:04 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:05.924688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:05.925536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:05.941392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:05.941392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:05.942216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:05.942594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:05.942720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:05.960856 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe690567-64bd-4044-8548-b92035324286 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1672 microversion: 2.1 time: 0.989906 Apr 09 21:16:05.962260 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2583/5117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:04 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1672 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:05.968633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:05.969659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:05.981890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:05.983782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:05.986803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:05.988477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:07.182756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:07.197938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:07.199740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:07.216471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-97e0636f-33f7-45ca-94f4-9ac901a705fa tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 1.237256 Apr 09 21:16:07.217299 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2584/5118] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:05 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:07.233845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:07.241799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:07.267063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:07.276766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:07.278624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:07.281718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:07.319921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:07.338944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6872c334-379b-490e-b9a4-80b76240fc31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 1.417920 Apr 09 21:16:07.339470 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2535/5119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:05 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:07.358003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:07.359488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:07.366721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:07.367461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:07.368477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:07.369125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:08.710993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:08.721853 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce5f01f9-de27-401f-be24-21fc1bdaf527 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 1.503359 Apr 09 21:16:08.722449 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2585/5120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:07 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:08.758499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-827a3de2-73a3-41f5-9f57-bdecf43dae63 req-666690b6-34f1-4438-90ff-3f80a725596a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69082140-9d03-4061-8d5d-f571512ac513", "tag": "7de152ca-405a-4d66-9c78-b397ef59c4a1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:08.781853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-827a3de2-73a3-41f5-9f57-bdecf43dae63 req-666690b6-34f1-4438-90ff-3f80a725596a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:08.782725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-827a3de2-73a3-41f5-9f57-bdecf43dae63 req-666690b6-34f1-4438-90ff-3f80a725596a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:08.805413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-827a3de2-73a3-41f5-9f57-bdecf43dae63 req-666690b6-34f1-4438-90ff-3f80a725596a service nova] Creating event network-changed:7de152ca-405a-4d66-9c78-b397ef59c4a1 for instance 69082140-9d03-4061-8d5d-f571512ac513 on nch2-master-1 Apr 09 21:16:08.823181 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-827a3de2-73a3-41f5-9f57-bdecf43dae63 req-666690b6-34f1-4438-90ff-3f80a725596a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099314 Apr 09 21:16:08.824542 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2586/5121] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:08.837640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:08.838910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:08.853616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:08.863295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:08.864227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:08.864893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:09.095414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:09.109734 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6de29189-3b6c-4bae-b989-67610325ef87 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1672 microversion: 2.1 time: 1.758790 Apr 09 21:16:09.115052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2536/5122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:07 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1672 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:09.131429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:09.135560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:09.163424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:09.164437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:09.165763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:09.167177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:11.112217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:11.149295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-25d1510e-04db-4cbc-ad20-16293e01fdb1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 2.027871 Apr 09 21:16:11.154048 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2537/5123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:09 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:11.174590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9b23cdf8-4a19-4e41-b9b5-959426f4b406 req-a69a0beb-fb96-4214-9a35-6fdbe6c1b786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ae83f5-5cda-4bb8-9808-eec0a42a1ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "f550ab8b-46fc-476d-9e17-cf770f908314"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:11.216609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9b23cdf8-4a19-4e41-b9b5-959426f4b406 req-a69a0beb-fb96-4214-9a35-6fdbe6c1b786 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:11.221987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9b23cdf8-4a19-4e41-b9b5-959426f4b406 req-a69a0beb-fb96-4214-9a35-6fdbe6c1b786 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:11.272816 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9b23cdf8-4a19-4e41-b9b5-959426f4b406 req-a69a0beb-fb96-4214-9a35-6fdbe6c1b786 service nova] Creating event network-vif-unplugged:f550ab8b-46fc-476d-9e17-cf770f908314 for instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 on nch1-master-1 Apr 09 21:16:11.285408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9b23cdf8-4a19-4e41-b9b5-959426f4b406 req-a69a0beb-fb96-4214-9a35-6fdbe6c1b786 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128300 Apr 09 21:16:11.287332 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2538/5124] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:11.300785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:11.302960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:11.317370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:11.318514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:11.320112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:11.321164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:11.948342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:12.001860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:12.013009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:12.021673 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f6fc2d5-b0d1-4772-8f52-aa348a011706 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 3.193598 Apr 09 21:16:12.026708 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2587/5125] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:08 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 3201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:12.044507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:12.052367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:12.072573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:12.073063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:12.073853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:12.074289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:12.558173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:12.566737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-630d23cc-adbf-4bab-b7f2-7813cd2f1248 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1605 microversion: 2.1 time: 0.535034 Apr 09 21:16:12.570692 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2588/5126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:12 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1605 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:12.585917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:12.586909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:12.599262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:12.600209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:12.601226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:12.601842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:12.966827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:13.004145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de861669-8e51-4387-a9ca-ed29e4d5165b tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 1.712940 Apr 09 21:16:13.009748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2539/5127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:11 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:13.033789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b031b870-998e-470f-8fdf-0a294523961c req-a4aa426f-e8f4-4650-83b1-0e37159e2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ae83f5-5cda-4bb8-9808-eec0a42a1ea4", "name": "network-vif-deleted", "tag": "f550ab8b-46fc-476d-9e17-cf770f908314"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:13.091058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b031b870-998e-470f-8fdf-0a294523961c req-a4aa426f-e8f4-4650-83b1-0e37159e2d8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.092835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b031b870-998e-470f-8fdf-0a294523961c req-a4aa426f-e8f4-4650-83b1-0e37159e2d8f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.141927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:13.149562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-15b796fb-4940-4c36-a1c6-eebe8f27aa74 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.576321 Apr 09 21:16:13.157533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b031b870-998e-470f-8fdf-0a294523961c req-a4aa426f-e8f4-4650-83b1-0e37159e2d8f service nova] Creating event network-vif-deleted:f550ab8b-46fc-476d-9e17-cf770f908314 for instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 on nch1-master-1 Apr 09 21:16:13.157788 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2589/5128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:12 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:13.174074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:13.174693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:13.176587 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b031b870-998e-470f-8fdf-0a294523961c req-a4aa426f-e8f4-4650-83b1-0e37159e2d8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157209 Apr 09 21:16:13.183788 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2540/5129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:13.194691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.195277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.195997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.205462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.599891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:13.603590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:13.627844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.630710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.633093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.634941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.819445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:13.826117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:13.827227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lazy-loading 'fault' on Instance uuid 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:16:14.068593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce296c1004c4976930f46de34be880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd53d98faf74d6a92cdfabace62b088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:14.105815 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0823dde0-a45b-4bf0-a710-0fae10079e6c tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 200 len: 1327 microversion: 2.1 time: 0.521410 Apr 09 21:16:14.115811 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2541/5130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:13 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 1327 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:14.130762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:14.131769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:14.153983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:14.157075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:14.158088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:14.158685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:14.381312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:14.394907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:14.470365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:14.478377 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f485a63c-ef4b-437b-8ec2-ff51f168ec0b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 1.315208 Apr 09 21:16:14.479399 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2590/5131] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:13 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:14.513483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:14.533378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:14.569994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:14.570969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:14.582949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:14.584114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:15.222675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:15.239494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f24a61e-d9cc-4741-a1fa-c917235f0fa8 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 1.118099 Apr 09 21:16:15.253631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2542/5132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:14 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:15.259271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:15.269669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:15.279332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:15.285948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:15.291056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:15.291928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:15.326691 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. Apr 09 21:16:15.331981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:16:15.333299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbd6a245-8a29-423e-96cb-e03175a08c1d tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 404 len: 111 microversion: 2.1 time: 0.078315 Apr 09 21:16:15.337784 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2543/5133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:15 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:16:15.352618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c36904d-fdd1-4c68-8ac7-6b9b6ed3c3d5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '.version_select at 0x7fb08db12b80>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:15.398357 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c36904d-fdd1-4c68-8ac7-6b9b6ed3c3d5 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645359192" status: 202 len: 0 microversion: 2.1 time: 0.059235 Apr 09 21:16:15.399561 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2544/5134] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645359192 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:16:15.418127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1090948649", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "94987c3c-74d8-4227-9a28-ca107fefd2ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1525650353", "security_groups": [{"name": "tempest-secgroup-smoke-1307408129"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:15.782100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:15.794071 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2c5ee129-37bd-413d-b7db-50c37baef67e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 1.293400 Apr 09 21:16:15.800368 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2591/5135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:14 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:15.816572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:15.818190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:15.837019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:15.838222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:15.839946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:15.842839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:16.260203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] validate_networks() for [('94987c3c-74d8-4227-9a28-ca107fefd2ce', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:16:16.698622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:16.713544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:16.716334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:16.720643 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eee1dc08-e37f-41b9-b97c-4fd7bb900963 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.915601 Apr 09 21:16:16.721326 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2592/5136] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:15 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:16.738966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d91eefaf-66e9-4c24-81f4-57cc0269c4b7 req-7b885086-ccaf-41ad-9fe5-9a8e3d6fc09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d97087-edbc-447d-9589-45ec66ce060f", "tag": "6cab0c9d-5bc2-486c-bb73-355c8198a313"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:16.769475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d91eefaf-66e9-4c24-81f4-57cc0269c4b7 req-7b885086-ccaf-41ad-9fe5-9a8e3d6fc09e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:16.779371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d91eefaf-66e9-4c24-81f4-57cc0269c4b7 req-7b885086-ccaf-41ad-9fe5-9a8e3d6fc09e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:16.827169 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d91eefaf-66e9-4c24-81f4-57cc0269c4b7 req-7b885086-ccaf-41ad-9fe5-9a8e3d6fc09e service nova] Creating event network-changed:6cab0c9d-5bc2-486c-bb73-355c8198a313 for instance 68d97087-edbc-447d-9589-45ec66ce060f on nch1-master-1 Apr 09 21:16:16.849634 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d91eefaf-66e9-4c24-81f4-57cc0269c4b7 req-7b885086-ccaf-41ad-9fe5-9a8e3d6fc09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116283 Apr 09 21:16:16.850824 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2593/5137] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:16.864316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:16.865293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:16.879802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:16.880560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:16.881571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:16.885703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:17.770726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:16:17.771491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:16:17.772041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:16:17.772799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:16:17.773292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:16:17.791061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:17.795690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:17.796913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:17.797411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:17.861973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:16:17.879590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:16:17.915796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:16:17.922997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:16:18.076915 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42677b22-8da7-41a1-8e9c-3285c934f07c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.660126 Apr 09 21:16:18.079677 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2545/5138] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:16:18.095583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:18.096961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:18.134264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:18.134648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:18.135462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:18.135911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:18.329325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:18.347225 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1115767e-8661-4aff-ade6-d9253bcf38b0 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 1.493977 Apr 09 21:16:18.349633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2594/5139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:16 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:18.374805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a18f67e7-4038-43ee-9337-cb6ef45f1032 req-4a7cd58a-ef76-4942-87f1-625754ad4770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "name": "network-vif-plugged", "status": "completed", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:18.406858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a18f67e7-4038-43ee-9337-cb6ef45f1032 req-4a7cd58a-ef76-4942-87f1-625754ad4770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:18.410973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a18f67e7-4038-43ee-9337-cb6ef45f1032 req-4a7cd58a-ef76-4942-87f1-625754ad4770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:18.502735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a18f67e7-4038-43ee-9337-cb6ef45f1032 req-4a7cd58a-ef76-4942-87f1-625754ad4770 service nova] Creating event network-vif-plugged:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:16:18.521085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a18f67e7-4038-43ee-9337-cb6ef45f1032 req-4a7cd58a-ef76-4942-87f1-625754ad4770 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164175 Apr 09 21:16:18.525655 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2595/5140] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:18.547795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:18.550681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:18.572037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:18.574617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:18.581578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:18.582928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:18.981659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:18.994580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dfc2e799-b760-49b0-9c63-96faade7ce79 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.912194 Apr 09 21:16:18.995536 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2546/5141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:18 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:19.003330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-70f6a443-d9c8-42af-8ce7-f1b59edc79a0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:19.004194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-70f6a443-d9c8-42af-8ce7-f1b59edc79a0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:19.051982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:19.066677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:19.095729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:19.103392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06190910-7255-47f7-96b9-bf486cd54e6e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.573297 Apr 09 21:16:19.105933 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2596/5142] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:18 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:19.135473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-70f6a443-d9c8-42af-8ce7-f1b59edc79a0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:19.147575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-70f6a443-d9c8-42af-8ce7-f1b59edc79a0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1267 microversion: 2.1 time: 0.147083 Apr 09 21:16:19.150880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2547/5143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:18 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:19.369410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:19.370925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:19.384574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.385814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.387174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.387921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.614057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:19.614749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:19.634234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.634698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.655890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.655890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.684813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. Apr 09 21:16:19.688306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:16:19.690265 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d49769ae-2c13-4cbb-9116-5aa3dba6499b tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 404 len: 111 microversion: 2.1 time: 0.081873 Apr 09 21:16:19.702520 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2548/5144] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:19 2022] DELETE /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:16:19.712214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:19.713211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:19.728634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.729783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.732637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:19.735496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:19.779528 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. Apr 09 21:16:19.780404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance 38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:16:19.781745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95a509fb-a233-4e6e-a686-3641f20bcec1 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4" status: 404 len: 111 microversion: 2.1 time: 0.077425 Apr 09 21:16:19.787094 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2549/5145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:19 2022] GET /compute/v2.1/servers/38ae83f5-5cda-4bb8-9808-eec0a42a1ea4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:16:19.878554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:19.900556 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9334570-c019-4e38-a3ff-43b6318b280a tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1268 microversion: 2.1 time: 0.532827 Apr 09 21:16:19.904108 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2597/5146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:19 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1268 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:20.012698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:20.014723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:20.022388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.023072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.024136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.024795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.128936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:20.130070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:20.165681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.166065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.170734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.171237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.398908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:20.418302 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1404a529-739d-4221-b0a6-8679b5d0cc8b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.406734 Apr 09 21:16:20.419555 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2550/5147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:20 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:20.429555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:20.433353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:20.450890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.451614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.454900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.456565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.626575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:20.639240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:20.640826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:20.655394 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-382e9c22-accd-499c-9f9f-5194c00ec593 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.534241 Apr 09 21:16:20.668550 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2598/5148] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:20 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:20.729756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:20.741295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94d095ca-9265-4dfa-a304-b18173cdabb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1327 microversion: 2.1 time: 0.320319 Apr 09 21:16:20.759504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2551/5149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:20 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1327 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:20.920103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:20.920644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:20.949513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.950057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:20.950904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:20.951364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.225884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:21.227374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:21.238547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.239312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.242738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.245426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.276580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. Apr 09 21:16:21.280578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:16:21.281755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8eebd71b-78e4-4af6-b630-f977b5aac295 tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 404 len: 111 microversion: 2.1 time: 0.060350 Apr 09 21:16:21.282531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2552/5150] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:21 2022] DELETE /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:16:21.302951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:21.315550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:21.323132 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2e12641-4f72-4e37-aff9-9413f6ad06d9 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1455 microversion: 2.1 time: 0.408201 Apr 09 21:16:21.324743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2599/5151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:20 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1455 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:21.327695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] [instance: f732d8e8-0c52-44e4-89c6-b97595485ebc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:21.354483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:21.356649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:21.358750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.361423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.363839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.366368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.370588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.384338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.386023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.390883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.418246 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] HTTP exception thrown: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. Apr 09 21:16:21.425430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] Returning 404 to user: Instance f732d8e8-0c52-44e4-89c6-b97595485ebc could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:16:21.436688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8561478f-5bec-49f2-a2a8-e137d6c57aea tempest-AttachVolumeTestJSON-873042647 tempest-AttachVolumeTestJSON-873042647-project] 10.222.0.30 "GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc" status: 404 len: 111 microversion: 2.1 time: 0.125161 Apr 09 21:16:21.445312 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2553/5152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:21 2022] GET /compute/v2.1/servers/f732d8e8-0c52-44e4-89c6-b97595485ebc => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:16:21.455645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:21.457709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:21.477300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.477796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:21.478661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:21.483352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.001658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.011794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e9d974bc-4de9-44b5-8b58-924dbb903b47 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.564703 Apr 09 21:16:22.028822 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2554/5153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:21 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:22.037347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:22.038491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:22.048250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:22.049007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.050048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:22.050646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.150665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.161795 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e3117ed-eb23-4391-ac32-b1c7e671f315 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1455 microversion: 2.1 time: 0.823904 Apr 09 21:16:22.162965 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2600/5154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:21 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1455 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:22.169142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:22.170085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:22.178680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:22.179459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.180556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:22.181536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.321329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.333157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-efe32e11-53fe-4cb8-be03-8cde969b97d1 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1325 microversion: 2.1 time: 0.168707 Apr 09 21:16:22.337611 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2601/5155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:22 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:22.359855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-008cafc1-232c-4e72-92e2-7f53694e1306 req-269cdcf0-4536-4f67-83cf-eb9b84906a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69082140-9d03-4061-8d5d-f571512ac513", "name": "network-vif-plugged", "status": "completed", "tag": "7de152ca-405a-4d66-9c78-b397ef59c4a1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:22.385982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-008cafc1-232c-4e72-92e2-7f53694e1306 req-269cdcf0-4536-4f67-83cf-eb9b84906a74 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:22.386834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-008cafc1-232c-4e72-92e2-7f53694e1306 req-269cdcf0-4536-4f67-83cf-eb9b84906a74 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:22.422047 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-008cafc1-232c-4e72-92e2-7f53694e1306 req-269cdcf0-4536-4f67-83cf-eb9b84906a74 service nova] Creating event network-vif-plugged:7de152ca-405a-4d66-9c78-b397ef59c4a1 for instance 69082140-9d03-4061-8d5d-f571512ac513 on nch2-master-1 Apr 09 21:16:22.444133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-008cafc1-232c-4e72-92e2-7f53694e1306 req-269cdcf0-4536-4f67-83cf-eb9b84906a74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103464 Apr 09 21:16:22.457431 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2602/5156] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:22.475602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.490111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.494736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:22.500953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0bf71c94-4551-43b2-bb91-9e2d4b260fae tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.465607 Apr 09 21:16:22.505371 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2555/5157] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:22 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:23.036661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:23.037596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:23.060913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.062078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:23.064790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.066395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:23.362119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:23.363057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:23.392854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.405139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:23.407382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.409744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:23.871871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:23.887270 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c85634d4-8e48-4637-8309-5389d11357ca tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1319 microversion: 2.1 time: 0.860183 Apr 09 21:16:23.887868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2603/5158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:23 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1319 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:23.902999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:23.904651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:23.917660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.919277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:23.920762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:23.923757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:24.046688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:24.064338 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e780f06d-cd8f-40e9-8759-420106aa2b4a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 0.715661 Apr 09 21:16:24.065116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2556/5159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:23 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:24.499088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:24.516293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-196d99e3-b4a8-4f6f-83b9-181800093038 req-3497a9c8-1b9a-45bb-aed0-7c38be30d1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d97087-edbc-447d-9589-45ec66ce060f", "name": "network-vif-plugged", "status": "completed", "tag": "6cab0c9d-5bc2-486c-bb73-355c8198a313"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:24.532626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-196d99e3-b4a8-4f6f-83b9-181800093038 req-3497a9c8-1b9a-45bb-aed0-7c38be30d1d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:24.534208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:24.540091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:24.543515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-196d99e3-b4a8-4f6f-83b9-181800093038 req-3497a9c8-1b9a-45bb-aed0-7c38be30d1d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:24.546031 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db091b88-e81b-4b8d-ae72-b317db7640ea tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.647507 Apr 09 21:16:24.550582 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2604/5160] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:23 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:24.576168 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-196d99e3-b4a8-4f6f-83b9-181800093038 req-3497a9c8-1b9a-45bb-aed0-7c38be30d1d7 service nova] Creating event network-vif-plugged:6cab0c9d-5bc2-486c-bb73-355c8198a313 for instance 68d97087-edbc-447d-9589-45ec66ce060f on nch1-master-1 Apr 09 21:16:24.587956 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-196d99e3-b4a8-4f6f-83b9-181800093038 req-3497a9c8-1b9a-45bb-aed0-7c38be30d1d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077264 Apr 09 21:16:24.590438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2557/5161] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:24.904917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:24.905585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:24.912098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:24.912542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:24.913374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:24.913809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:25.084197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:25.086249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:25.093873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:25.094605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:25.096184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:25.096856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:26.024848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:26.053350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1f1b694-1867-4900-9ef2-1dea5b8a620d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 200 len: 1507 microversion: 2.1 time: 1.146780 Apr 09 21:16:26.075725 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2605/5162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:24 2022] GET /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 1507 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:26.092174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:26.095401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:26.132562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:26.136347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:26.137384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:26.137854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:26.508280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:26.531458 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbb566fd-2e81-4e5b-8de8-020fd85ffa04 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 1.453517 Apr 09 21:16:26.540739 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2558/5163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:25 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:26.540739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:26.540739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 68d97087-edbc-447d-9589-45ec66ce060f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:26.545780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:26.546311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:26.547145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:26.547587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:26.693491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:26.705278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:26.709126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:26.711010 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0938517-61d5-4e1a-a893-d9bd19eee0cc tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.633571 Apr 09 21:16:26.714705 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2606/5164] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:26 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:27.059708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-be072c4e-8144-491d-aea7-9b4f865c84d3 req-6f60074b-a97c-43de-a786-d18063c63587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:27.074256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-be072c4e-8144-491d-aea7-9b4f865c84d3 req-6f60074b-a97c-43de-a786-d18063c63587 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.083124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-be072c4e-8144-491d-aea7-9b4f865c84d3 req-6f60074b-a97c-43de-a786-d18063c63587 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.108579 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-be072c4e-8144-491d-aea7-9b4f865c84d3 req-6f60074b-a97c-43de-a786-d18063c63587 service nova] Creating event network-changed:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:16:27.118222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:27.120240 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-be072c4e-8144-491d-aea7-9b4f865c84d3 req-6f60074b-a97c-43de-a786-d18063c63587 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064328 Apr 09 21:16:27.124861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2607/5165] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:27.137189 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f7da178-270f-447f-82f8-7d7a68ebd6e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/68d97087-edbc-447d-9589-45ec66ce060f" status: 200 len: 1508 microversion: 2.1 time: 0.603497 Apr 09 21:16:27.140608 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2559/5166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:26 2022] GET /compute/v2.1/servers/68d97087-edbc-447d-9589-45ec66ce060f => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:27.156233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:27.156760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 68d97087-edbc-447d-9589-45ec66ce060f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:27.190033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.191005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.192064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.192734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.233174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 68d97087-edbc-447d-9589-45ec66ce060f] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:27.385245 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b37ecadf-c6c4-4137-9085-af9ca5acff1b tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "DELETE /compute/v2.1/servers/68d97087-edbc-447d-9589-45ec66ce060f" status: 204 len: 0 microversion: 2.1 time: 0.230623 Apr 09 21:16:27.386885 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2608/5167] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:27 2022] DELETE /compute/v2.1/servers/68d97087-edbc-447d-9589-45ec66ce060f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:27.395017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:27.395529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:27.411143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.412745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.414033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.415256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.462417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: 69082140-9d03-4061-8d5d-f571512ac513] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:27.550248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:27.551417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:27.566788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.568904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.571867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.572603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.598986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d558180b-db43-4aaa-9b71-ffac7211d449 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513" status: 204 len: 0 microversion: 2.1 time: 0.206714 Apr 09 21:16:27.600858 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2560/5168] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:27 2022] DELETE /compute/v2.1/servers/69082140-9d03-4061-8d5d-f571512ac513 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:27.732213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:27.733974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:27.746208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.747878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.747878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:27.748163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:27.925773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:27.934469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-282d5bc6-77a1-4304-9ed9-79694097be18 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 0.389825 Apr 09 21:16:27.943969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2609/5169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:27 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:27.943969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2146997923", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "fc7f341d-80bd-4d4e-b4fe-3dfca09d2534"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:28.005550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] validate_networks() for [('fc7f341d-80bd-4d4e-b4fe-3dfca09d2534', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:16:28.202820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:28.215199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:28.217874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:28.222504 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f52dc23-5a71-4756-ae27-620aaea1b572 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.495659 Apr 09 21:16:28.224059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2561/5170] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:27 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:16:28.953505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:28.954777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:28.974539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:28.974997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:28.975979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:28.976576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.071914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:30.083674 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ffa340f-b9f5-4c81-a1a4-eaca68d45854 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 1.135234 Apr 09 21:16:30.093941 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2562/5171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:28 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:30.105662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:30.106278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:30.121614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.122079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.123479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.124525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.466903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:16:30.467363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:16:30.467908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:16:30.468387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:16:30.468896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:16:30.480798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.485977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.486997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.487519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.521139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Getting quotas for project 7525a2e03c554c339134407c220d5499. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:16:30.534373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Getting quotas for user 5145fae3fdfd41f0ad5f1e1fe59558f0 and project 7525a2e03c554c339134407c220d5499. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:16:30.564605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Going to run 2 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:16:30.567403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:16:30.618307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=ac05d77b-11c5-4514-93bc-656c0b070ac8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:16:30.698324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:30.711994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:30.717394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:30.719006 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e64eb5a3-a5ef-4f73-a873-754e1b55fd18 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.620617 Apr 09 21:16:30.720001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2563/5172] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:30 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:30.725243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-88c34dcc-3e1a-49a5-b773-d104d00b3da7 req-75cb211c-a226-485e-84dc-9706bc157be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "name": "network-vif-plugged", "status": "completed", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:30.738087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-88c34dcc-3e1a-49a5-b773-d104d00b3da7 req-75cb211c-a226-485e-84dc-9706bc157be2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.738570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-88c34dcc-3e1a-49a5-b773-d104d00b3da7 req-75cb211c-a226-485e-84dc-9706bc157be2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.750148 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d12d855-8144-4c80-b454-0b66bf98c5d1 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.812428 Apr 09 21:16:30.752430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2610/5173] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:16:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 2816 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 09 21:16:30.762601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:30.778471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-88c34dcc-3e1a-49a5-b773-d104d00b3da7 req-75cb211c-a226-485e-84dc-9706bc157be2 service nova] Creating event network-vif-plugged:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch1-master-1 Apr 09 21:16:30.782017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:30.785896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Searching by: {'deleted': False, 'project_id': '7525a2e03c554c339134407c220d5499'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:16:30.796321 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-88c34dcc-3e1a-49a5-b773-d104d00b3da7 req-75cb211c-a226-485e-84dc-9706bc157be2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074853 Apr 09 21:16:30.807864 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2564/5174] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:30.820104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.820893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.823087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:30.824518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:30.871941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:16:30.909873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-594d7eab-0166-40c9-9af4-5f8a08f28cd4 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.153619 Apr 09 21:16:30.917368 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2611/5175] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:16:30 2022] GET /compute/v2.1/servers => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:30.925684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-392a25fc-8890-46b7-8716-b71133211a86 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:30.933784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-392a25fc-8890-46b7-8716-b71133211a86 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:31.069010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-392a25fc-8890-46b7-8716-b71133211a86 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:31.085595 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-392a25fc-8890-46b7-8716-b71133211a86 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1218 microversion: 2.1 time: 0.166707 Apr 09 21:16:31.090650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2565/5176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:30 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:31.104468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:31.105476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:31.115000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:31.115681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:31.116682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:31.118852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:31.351049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5b3ffe1d-4610-4906-8263-5e5746cbd3eb req-5afabb62-da56-4d44-a57e-42dbea12bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:31.378619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b3ffe1d-4610-4906-8263-5e5746cbd3eb req-5afabb62-da56-4d44-a57e-42dbea12bf84 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:31.379410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b3ffe1d-4610-4906-8263-5e5746cbd3eb req-5afabb62-da56-4d44-a57e-42dbea12bf84 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:31.396364 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5b3ffe1d-4610-4906-8263-5e5746cbd3eb req-5afabb62-da56-4d44-a57e-42dbea12bf84 service nova] Creating event network-changed:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:16:31.412366 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5b3ffe1d-4610-4906-8263-5e5746cbd3eb req-5afabb62-da56-4d44-a57e-42dbea12bf84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065268 Apr 09 21:16:31.413837 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2566/5177] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:31.750143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:31.753757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:31.774390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:31.776698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:31.781637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:31.785315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:32.206877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:32.225880 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf8fcd09-fb07-461a-bd55-5f1be42b2337 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 1.128432 Apr 09 21:16:32.237121 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2612/5178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:31 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:32.242903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3a183fa-76df-4b8c-828f-fc972c435344 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:32.243745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3a183fa-76df-4b8c-828f-fc972c435344 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:32.923363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3a183fa-76df-4b8c-828f-fc972c435344 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:32.930578 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3a183fa-76df-4b8c-828f-fc972c435344 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1218 microversion: 2.1 time: 0.691946 Apr 09 21:16:32.937693 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2613/5179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:32 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1218 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:33.136959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:33.146659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:33.151832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:33.162523 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0103298f-1e33-48e6-b107-91c65d07e0db tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 1.427498 Apr 09 21:16:33.175757 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2567/5180] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:31 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:33.266512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:33.267270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:33.280488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:33.281458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:33.282542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:33.283209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:33.467177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d97087-edbc-447d-9589-45ec66ce060f", "name": "network-vif-deleted", "tag": "6cab0c9d-5bc2-486c-bb73-355c8198a313"}, {"server_uuid": "69082140-9d03-4061-8d5d-f571512ac513", "name": "network-vif-deleted", "tag": "7de152ca-405a-4d66-9c78-b397ef59c4a1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:33.500094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:33.505704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:33.542936 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] Creating event network-vif-deleted:6cab0c9d-5bc2-486c-bb73-355c8198a313 for instance 68d97087-edbc-447d-9589-45ec66ce060f on nch1-master-1 Apr 09 21:16:33.543753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] Creating event network-vif-deleted:7de152ca-405a-4d66-9c78-b397ef59c4a1 for instance 69082140-9d03-4061-8d5d-f571512ac513 on nch2-master-1 Apr 09 21:16:33.565528 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-99a36c71-b3f8-4f97-a41a-bd0bcd1571b4 req-5d3b215b-cb10-4b49-86ab-314fa77301e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099702 Apr 09 21:16:33.567692 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2568/5181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:33.952407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:33.954052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:33.974046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:33.987972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:33.991264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:33.993275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:34.279171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:34.288846 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76255a0e-e67e-46f5-a2f2-1dc731e62056 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 1.038905 Apr 09 21:16:34.291249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2614/5182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:33 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:34.306384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:34.307171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:34.317458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:34.318198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:34.325855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:34.326614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:34.441564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:34.465258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae263a21-2e70-4b95-acae-06e4a0bb67a0 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1288 microversion: 2.1 time: 0.508673 Apr 09 21:16:34.465258 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2569/5183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:33 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1288 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:35.037608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c22f08e8-b85a-41fe-817d-cedf12a7fbf6 req-4a354145-44c9-416d-a0cf-c6369309dc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:35.050744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c22f08e8-b85a-41fe-817d-cedf12a7fbf6 req-4a354145-44c9-416d-a0cf-c6369309dc94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:35.056353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c22f08e8-b85a-41fe-817d-cedf12a7fbf6 req-4a354145-44c9-416d-a0cf-c6369309dc94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:35.079463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c22f08e8-b85a-41fe-817d-cedf12a7fbf6 req-4a354145-44c9-416d-a0cf-c6369309dc94 service nova] Creating event network-changed:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:16:35.091737 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c22f08e8-b85a-41fe-817d-cedf12a7fbf6 req-4a354145-44c9-416d-a0cf-c6369309dc94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057855 Apr 09 21:16:35.094498 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2570/5184] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:35.233692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:35.242860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:35.244382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:35.245614 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9fb6caf4-d80f-4c6a-92b2-8b2a0000541e tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1729 microversion: 2.20 time: 0.951525 Apr 09 21:16:35.253504 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2615/5185] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:34 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1729 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:35.309520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:35.310241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:35.322455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:35.322932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:35.324729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:35.325342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:35.470419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:35.471570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:35.480630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:35.481122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:35.481934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:35.486178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:35.699427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:35.707311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d9d1929-eaed-436b-baf6-69f7933721b8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1276 microversion: 2.1 time: 0.240686 Apr 09 21:16:35.707923 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2616/5186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:35 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:35.976519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:35.984993 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5a3ff6a-39f1-4d57-836b-87edbfd4474b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 0.680692 Apr 09 21:16:35.990140 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2571/5187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:35 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:36.264316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:36.265007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:36.283048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:36.283793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:36.284928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:36.285540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:36.726105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:36.726838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:36.737246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:36.737787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:36.738900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:36.739539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:36.758022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:36.768254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:36.772972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:36.786153 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81b84194-1323-4794-8e21-23f31f9f1276 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1716 microversion: 2.20 time: 0.526032 Apr 09 21:16:36.787663 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2617/5188] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:16:36 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1716 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:16:37.007231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:37.008641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:37.018601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:37.021391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:37.022921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:37.025017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:37.504443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:37.516803 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56bd7aa4-ca40-4f3f-b514-e1c168ad2f29 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.794731 Apr 09 21:16:37.520186 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2572/5189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:36 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:37.527903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e79e3e7c-aa6f-4cca-b532-ea4e9e30ca88 req-f95b5385-e8dc-457e-b089-519cf4c3c157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:37.550026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e79e3e7c-aa6f-4cca-b532-ea4e9e30ca88 req-f95b5385-e8dc-457e-b089-519cf4c3c157 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:37.550486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e79e3e7c-aa6f-4cca-b532-ea4e9e30ca88 req-f95b5385-e8dc-457e-b089-519cf4c3c157 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:37.572678 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e79e3e7c-aa6f-4cca-b532-ea4e9e30ca88 req-f95b5385-e8dc-457e-b089-519cf4c3c157 service nova] Creating event network-changed:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:16:37.586004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e79e3e7c-aa6f-4cca-b532-ea4e9e30ca88 req-f95b5385-e8dc-457e-b089-519cf4c3c157 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061556 Apr 09 21:16:37.586663 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2573/5190] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:37.598706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4323788f-7546-4ddb-ad33-51274582430e req-a58201f0-876b-41c9-a717-5a1d9ba1732e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-plugged", "status": "completed", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:37.614119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4323788f-7546-4ddb-ad33-51274582430e req-a58201f0-876b-41c9-a717-5a1d9ba1732e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:37.616813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4323788f-7546-4ddb-ad33-51274582430e req-a58201f0-876b-41c9-a717-5a1d9ba1732e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:37.633610 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4323788f-7546-4ddb-ad33-51274582430e req-a58201f0-876b-41c9-a717-5a1d9ba1732e service nova] Creating event network-vif-plugged:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:16:37.639855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4323788f-7546-4ddb-ad33-51274582430e req-a58201f0-876b-41c9-a717-5a1d9ba1732e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050480 Apr 09 21:16:37.640831 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2574/5191] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:37.747267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:37.761325 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7490705e-d554-4f82-8242-ecad54f3e197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 0.758248 Apr 09 21:16:37.761999 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2618/5192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:37 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:38.537311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:38.538723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:38.546618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:38.547520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:38.548490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:38.549118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:38.778445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:38.779054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:38.787392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:38.793786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:38.794994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:38.795579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:39.149093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:39.162664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3336cb6-2b4a-41c9-bc42-bead83508168 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.625883 Apr 09 21:16:39.167878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:39.168130 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2575/5193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:38 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:39.188653 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f95f2e8b-a0a4-4fe1-84c5-620fee58980a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1393 microversion: 2.1 time: 0.414402 Apr 09 21:16:39.192426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2619/5194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:38 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1393 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:40.182015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:40.183280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:40.191990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.192612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.193846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.194628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.208722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:40.210636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:40.224458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.228369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.229876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.233677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.661569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:40.676419 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f917e5be-2240-4276-ba59-df9c01607779 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.498471 Apr 09 21:16:40.677401 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2576/5195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:40 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:40.704927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-05eaa4b7-838d-49fd-9748-0b96859cfdc1 req-3f9389ff-339c-4d87-b4ec-df5204db86db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b467734c-1d03-4fa7-a389-a6e0e4188a44", "tag": "dfa10231-bc67-45a7-ad05-5f927b62ddae"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:40.715591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:40.722877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-05eaa4b7-838d-49fd-9748-0b96859cfdc1 req-3f9389ff-339c-4d87-b4ec-df5204db86db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.726776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-05eaa4b7-838d-49fd-9748-0b96859cfdc1 req-3f9389ff-339c-4d87-b4ec-df5204db86db service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.728316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83d7fb5c-756b-4708-ab59-3683e2a4baca tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1564 microversion: 2.1 time: 0.522102 Apr 09 21:16:40.740492 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2620/5196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:40 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1564 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:40.752778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:40.754785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:40.763417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-05eaa4b7-838d-49fd-9748-0b96859cfdc1 req-3f9389ff-339c-4d87-b4ec-df5204db86db service nova] Creating event network-changed:dfa10231-bc67-45a7-ad05-5f927b62ddae for instance b467734c-1d03-4fa7-a389-a6e0e4188a44 on nch2-master-1 Apr 09 21:16:40.770258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.770620 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-05eaa4b7-838d-49fd-9748-0b96859cfdc1 req-3f9389ff-339c-4d87-b4ec-df5204db86db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092004 Apr 09 21:16:40.773234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2577/5197] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:40.774034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:40.775165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:40.777755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:41.241056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:41.249615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd874e89-8bf5-492c-9305-9701436b2849 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1564 microversion: 2.1 time: 0.501319 Apr 09 21:16:41.251195 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2621/5198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:40 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1564 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:41.699324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:41.700746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:41.717289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:41.718433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:41.719449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:41.720143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:41.980491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:41.988794 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42dec372-1165-4edb-a6c6-2f2f05cb9f4a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.294113 Apr 09 21:16:41.989413 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2578/5199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:41 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:42.799362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-473a94fa-42e8-4d63-93fa-e3438dcad7b1 req-329d16fe-d6be-4b9a-a0f8-1abd02ad74ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac05d77b-11c5-4514-93bc-656c0b070ac8", "tag": "a277fd70-b878-4d71-9771-62b4060f53e5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:42.813870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-473a94fa-42e8-4d63-93fa-e3438dcad7b1 req-329d16fe-d6be-4b9a-a0f8-1abd02ad74ee service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:42.814218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-473a94fa-42e8-4d63-93fa-e3438dcad7b1 req-329d16fe-d6be-4b9a-a0f8-1abd02ad74ee service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:42.843898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-473a94fa-42e8-4d63-93fa-e3438dcad7b1 req-329d16fe-d6be-4b9a-a0f8-1abd02ad74ee service nova] Creating event network-changed:a277fd70-b878-4d71-9771-62b4060f53e5 for instance ac05d77b-11c5-4514-93bc-656c0b070ac8 on nch1-master-1 Apr 09 21:16:42.852179 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-473a94fa-42e8-4d63-93fa-e3438dcad7b1 req-329d16fe-d6be-4b9a-a0f8-1abd02ad74ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055844 Apr 09 21:16:42.853619 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2622/5200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:43.006409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:43.008023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:43.016105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:43.016887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:43.018775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:43.019454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:43.685610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:43.719518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-11ce83f7-5ebc-461f-9ac5-af3ab39baa8a tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.717103 Apr 09 21:16:43.720100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2579/5201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:43 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:16:44.744593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:44.745467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:44.780959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:44.786102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:44.788411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:44.793318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:45.374484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:45.382821 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e6fdc3b-477c-4596-b27c-7026764215a5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.648010 Apr 09 21:16:45.392365 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2623/5202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:44 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:45.626705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:45.627500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:45.642101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:45.649134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-20c451cc-c74d-4bbc-84a3-a05a025e34a5 req-294f2566-d2af-469d-83d9-1503f012cd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:45.653900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:45.658141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:45.659067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:45.666319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-20c451cc-c74d-4bbc-84a3-a05a025e34a5 req-294f2566-d2af-469d-83d9-1503f012cd76 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:45.669788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-20c451cc-c74d-4bbc-84a3-a05a025e34a5 req-294f2566-d2af-469d-83d9-1503f012cd76 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:45.699894 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-20c451cc-c74d-4bbc-84a3-a05a025e34a5 req-294f2566-d2af-469d-83d9-1503f012cd76 service nova] Creating event network-changed:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:16:45.716112 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-20c451cc-c74d-4bbc-84a3-a05a025e34a5 req-294f2566-d2af-469d-83d9-1503f012cd76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071065 Apr 09 21:16:45.730328 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2624/5203] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:46.096612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:46.107570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-297c768d-c7fa-4655-8184-5b7dfe812ab7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1564 microversion: 2.1 time: 0.485064 Apr 09 21:16:46.108786 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2580/5204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:45 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1564 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:46.402604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:46.403299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:46.417334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:46.421200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:46.422443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:46.423746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:46.806430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:46.816655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86ff2c65-4053-43a9-8081-bc18124d488f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.420084 Apr 09 21:16:46.819088 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2625/5205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:46 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:47.169066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:47.170822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:47.179465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:47.180678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:47.181842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:47.182764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:47.210245 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8760d64-865d-4de0-a7a1-a4b9a9541441 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/ips" status: 200 len: 149 microversion: 2.1 time: 0.047262 Apr 09 21:16:47.213487 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2581/5206] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:16:47 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:47.836589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:47.837296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:47.856756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:47.859469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:47.874484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:47.881963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:48.473200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:48.499167 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cad8226e-118c-47b7-b911-1bd57f84016e tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.666469 Apr 09 21:16:48.500248 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2626/5207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:47 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:48.818711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abddb649-a500-4b6c-b59b-522751fd34a8"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:48.821443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:48.833883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:48.834766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:48.835836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:48.836474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:49.369093 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "POST /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563933 Apr 09 21:16:49.373618 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2582/5208] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:16:48 2022] POST /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:16:49.515766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:49.517088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:49.535031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:49.535650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:49.537049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:49.537506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:49.854030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:49.864695 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41c6148e-6f31-4a6c-a9cd-9a28a03ddbb5 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.351863 Apr 09 21:16:49.875220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2627/5209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:49 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:50.275549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-61b50008-b15c-45a0-a361-9083007a00e9 req-6eb3519e-bd2e-4a37-96ab-dc63cff36cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac05d77b-11c5-4514-93bc-656c0b070ac8", "name": "network-vif-plugged", "status": "completed", "tag": "a277fd70-b878-4d71-9771-62b4060f53e5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:50.297411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-61b50008-b15c-45a0-a361-9083007a00e9 req-6eb3519e-bd2e-4a37-96ab-dc63cff36cbb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:50.298369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-61b50008-b15c-45a0-a361-9083007a00e9 req-6eb3519e-bd2e-4a37-96ab-dc63cff36cbb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:50.327314 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-61b50008-b15c-45a0-a361-9083007a00e9 req-6eb3519e-bd2e-4a37-96ab-dc63cff36cbb service nova] Creating event network-vif-plugged:a277fd70-b878-4d71-9771-62b4060f53e5 for instance ac05d77b-11c5-4514-93bc-656c0b070ac8 on nch1-master-1 Apr 09 21:16:50.341130 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-61b50008-b15c-45a0-a361-9083007a00e9 req-6eb3519e-bd2e-4a37-96ab-dc63cff36cbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069698 Apr 09 21:16:50.342702 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2583/5210] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:50.881835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:50.882575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:50.896885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:50.898417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:50.902701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:50.904397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:51.188221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:51.198136 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2119f089-75df-4f1e-8b7f-b7fe4a2af764 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.320747 Apr 09 21:16:51.199416 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2628/5211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:50 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:52.220125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:52.221627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:52.235916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:52.236663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:52.237861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:52.238451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:52.380583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ca55ca8a-fdfa-4443-81a6-743228bb79a1 req-208a7ce0-747c-4149-b2b9-ce0169f6e35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b467734c-1d03-4fa7-a389-a6e0e4188a44", "name": "network-vif-plugged", "status": "completed", "tag": "dfa10231-bc67-45a7-ad05-5f927b62ddae"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:52.396340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ca55ca8a-fdfa-4443-81a6-743228bb79a1 req-208a7ce0-747c-4149-b2b9-ce0169f6e35c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:52.397028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ca55ca8a-fdfa-4443-81a6-743228bb79a1 req-208a7ce0-747c-4149-b2b9-ce0169f6e35c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:52.411410 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ca55ca8a-fdfa-4443-81a6-743228bb79a1 req-208a7ce0-747c-4149-b2b9-ce0169f6e35c service nova] Creating event network-vif-plugged:dfa10231-bc67-45a7-ad05-5f927b62ddae for instance b467734c-1d03-4fa7-a389-a6e0e4188a44 on nch2-master-1 Apr 09 21:16:52.417940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ca55ca8a-fdfa-4443-81a6-743228bb79a1 req-208a7ce0-747c-4149-b2b9-ce0169f6e35c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042004 Apr 09 21:16:52.419695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2629/5212] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:52.568361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:52.579585 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e1a439e-d079-453a-b085-6611e53a804f tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.367193 Apr 09 21:16:52.582555 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2584/5213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:52 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:53.602376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:53.603993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:53.622921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:53.623573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:53.626500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:53.627199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:53.856842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:53.867369 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f53c9201-1c84-4a34-8c4e-badd1f7bb1d2 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1318 microversion: 2.1 time: 0.271727 Apr 09 21:16:53.873421 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2630/5214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:53 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:54.138899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:54.139472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:54.147302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.148142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:54.149384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.149898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:54.303876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'services' on Instance uuid 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:16:54.461282 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2f664bf-00a6-4788-9038-1b87eb580835 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments/abddb649-a500-4b6c-b59b-522751fd34a8" status: 202 len: 0 microversion: 2.1 time: 0.328955 Apr 09 21:16:54.462399 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2585/5215] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:16:54 2022] DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments/abddb649-a500-4b6c-b59b-522751fd34a8 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:16:54.471314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:54.472307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:54.486788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.488113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:54.490147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.493568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:54.534403 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78f62d65-20e1-472a-800f-971a6290e1e3 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067249 Apr 09 21:16:54.535872 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2631/5216] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:16:54 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:16:54.894438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:54.895440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:54.912199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.912852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:54.914349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:54.914945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.548928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:55.551403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:55.563590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.564448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.565780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.566513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.624116 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40951a3c-c869-4910-99b3-75c8657fac6a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080212 Apr 09 21:16:55.646506 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2632/5217] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:16:55 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:16:55.696325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:55.706503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2fbc4c9-ef68-4ab5-bcd8-4d105c907776 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1507 microversion: 2.1 time: 0.818663 Apr 09 21:16:55.708510 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2586/5218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:54 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1507 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:55.724795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:55.725562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:55.737308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.737883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.738561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.738995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.751848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:55.752648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:55.767076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.768641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.770503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:55.772207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:55.795950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:55.979713 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-545257e1-7074-4821-a5c3-0c4b58d02799 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 204 len: 0 microversion: 2.1 time: 0.264803 Apr 09 21:16:55.980808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2633/5219] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:55 2022] DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:55.992334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:55.996018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:56.007778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.008694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.010557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.014342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.261789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:56.280545 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-be7b99ce-cb8b-498b-8c41-d5570a142b39 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 200 len: 1507 microversion: 2.1 time: 0.548868 Apr 09 21:16:56.285351 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2587/5220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:55 2022] GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:56.309592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:56.317442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:56.319002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:56.323812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2d4b7155-b4fd-419f-91c3-308b5c3babf4 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1679 microversion: 2.1 time: 0.334118 Apr 09 21:16:56.337235 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2634/5221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:55 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1679 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:56.342934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.343743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.344786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.345656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.387969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:56.571525 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-000558e4-556a-429c-995a-345fcccc126d tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 204 len: 0 microversion: 2.1 time: 0.271069 Apr 09 21:16:56.572510 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2588/5222] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:56 2022] DELETE /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:56.582433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:56.583491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:56.594472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.597959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.601280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.601772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.648116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:16:56.791515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc91e9ad-4cf9-463f-ac43-d9aa41397749 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 204 len: 0 microversion: 2.1 time: 0.214419 Apr 09 21:16:56.793226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2635/5223] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:16:56 2022] DELETE /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:16:56.802716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:56.804080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:56.810912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.811628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:56.812574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:56.813201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:57.001496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:57.024321 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57e76698-c498-4f99-864e-0760518072e8 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 200 len: 1513 microversion: 2.1 time: 0.225964 Apr 09 21:16:57.037767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2589/5224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:56 2022] GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:57.345876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:57.346727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:57.357515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:57.361612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:57.361612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:57.361612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:57.598832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:57.610607 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e6c6780-8dfd-4a19-a2dc-7f2cf0f1a4f0 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1679 microversion: 2.1 time: 0.269151 Apr 09 21:16:57.614232 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2636/5225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:57 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:58.044658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:58.045878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:58.057665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:58.058377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:58.059359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:58.065062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:58.441482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:58.450548 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6fb79aca-ed25-4849-91b2-3dbcddcbdaad tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 200 len: 1513 microversion: 2.1 time: 0.410296 Apr 09 21:16:58.451939 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2590/5226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:58 2022] GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:58.627777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:58.628447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:58.635604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:58.643571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:58.644592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:58.645220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:59.099674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:59.113164 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab70ca27-c5e7-41e1-9e06-f3dd0f14b36c tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1679 microversion: 2.1 time: 0.489128 Apr 09 21:16:59.124048 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2637/5227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:58 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:59.469632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:16:59.470251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:16:59.483412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:59.487393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:59.489955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:59.491494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:59.749632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-34527358-185d-4f74-9665-78581c8715fc req-938a068c-1b4b-4b3c-8411-403b36efb2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac05d77b-11c5-4514-93bc-656c0b070ac8", "name": "network-vif-deleted", "tag": "a277fd70-b878-4d71-9771-62b4060f53e5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:16:59.764503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:16:59.787920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fc9f5ed-2d75-4a5c-ad5c-cd5ac79e25e7 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 200 len: 1471 microversion: 2.1 time: 0.322500 Apr 09 21:16:59.789060 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2591/5228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:16:59 2022] GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:16:59.789656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34527358-185d-4f74-9665-78581c8715fc req-938a068c-1b4b-4b3c-8411-403b36efb2bf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:16:59.790118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34527358-185d-4f74-9665-78581c8715fc req-938a068c-1b4b-4b3c-8411-403b36efb2bf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:16:59.814473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-34527358-185d-4f74-9665-78581c8715fc req-938a068c-1b4b-4b3c-8411-403b36efb2bf service nova] Creating event network-vif-deleted:a277fd70-b878-4d71-9771-62b4060f53e5 for instance ac05d77b-11c5-4514-93bc-656c0b070ac8 on nch1-master-1 Apr 09 21:16:59.825822 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-34527358-185d-4f74-9665-78581c8715fc req-938a068c-1b4b-4b3c-8411-403b36efb2bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083462 Apr 09 21:16:59.826447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2638/5229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:00.115743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f470ae51-96e6-460b-b7cf-aaa97a7dc2a5 req-943f97cf-9106-4013-895e-ed1e6db8bf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b467734c-1d03-4fa7-a389-a6e0e4188a44", "name": "network-vif-deleted", "tag": "dfa10231-bc67-45a7-ad05-5f927b62ddae"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:00.132403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:00.133640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:00.144045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.145814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.148485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.149811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.156603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f470ae51-96e6-460b-b7cf-aaa97a7dc2a5 req-943f97cf-9106-4013-895e-ed1e6db8bf77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.157073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f470ae51-96e6-460b-b7cf-aaa97a7dc2a5 req-943f97cf-9106-4013-895e-ed1e6db8bf77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.187462 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f470ae51-96e6-460b-b7cf-aaa97a7dc2a5 req-943f97cf-9106-4013-895e-ed1e6db8bf77 service nova] Creating event network-vif-deleted:dfa10231-bc67-45a7-ad05-5f927b62ddae for instance b467734c-1d03-4fa7-a389-a6e0e4188a44 on nch2-master-1 Apr 09 21:17:00.206101 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f470ae51-96e6-460b-b7cf-aaa97a7dc2a5 req-943f97cf-9106-4013-895e-ed1e6db8bf77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097846 Apr 09 21:17:00.211377 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2592/5230] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:00.334998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:00.343215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cbe2b271-f7b8-4e22-9302-029929074ccd tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1613 microversion: 2.1 time: 0.215395 Apr 09 21:17:00.353805 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2639/5231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:00 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1613 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:00.814046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:00.814910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: ac05d77b-11c5-4514-93bc-656c0b070ac8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:00.828169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.836338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.850802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.851430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.902228 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] HTTP exception thrown: Instance ac05d77b-11c5-4514-93bc-656c0b070ac8 could not be found. Apr 09 21:17:00.918205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Returning 404 to user: Instance ac05d77b-11c5-4514-93bc-656c0b070ac8 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:00.920255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6ef0e2fc-6973-4fb1-8dc8-0d528ad51a31 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8" status: 404 len: 111 microversion: 2.1 time: 0.113808 Apr 09 21:17:00.926181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2593/5232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:00 2022] GET /compute/v2.1/servers/ac05d77b-11c5-4514-93bc-656c0b070ac8 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:00.934653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:00.936046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:00.954617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.956125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:00.961941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:00.962717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:01.040768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:01.041307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:01.041890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lazy-loading 'fault' on Instance uuid b467734c-1d03-4fa7-a389-a6e0e4188a44 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:17:01.142058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5145fae3fdfd41f0ad5f1e1fe59558f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7525a2e03c554c339134407c220d5499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:01.151335 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41d8bafd-9e31-41da-9700-4a9b41b368d3 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 200 len: 1308 microversion: 2.1 time: 0.220688 Apr 09 21:17:01.154525 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2640/5233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:00 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:01.371062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:01.372091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:01.385351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:01.386085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:01.389359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:01.390952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:01.466923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:01.467938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:01.468641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lazy-loading 'fault' on Instance uuid 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:17:01.624755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6dcb8344fde4e4580e73efc09e633a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f38b2c41e34e73bd6baa83478dddfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:01.644277 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbf624ef-edc7-4dfb-983a-0eca65831e2b tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 200 len: 1331 microversion: 2.1 time: 0.276697 Apr 09 21:17:01.646301 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2594/5234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:01 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 1331 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:02.178208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:02.181587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] [instance: b467734c-1d03-4fa7-a389-a6e0e4188a44] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:02.196774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:02.198306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:02.200191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:02.207421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:02.231668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b295d306-8f0c-48d7-abd9-bf2ac5f2c93e req-03e787b4-4281-48fe-8a61-d6153517ace6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f677bb6-c97f-4574-9104-3a2fb5dd4ae6", "name": "network-vif-deleted", "tag": "9fd8a7ed-acf3-4312-8c33-6e136c187474"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:02.242400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] HTTP exception thrown: Instance b467734c-1d03-4fa7-a389-a6e0e4188a44 could not be found. Apr 09 21:17:02.243774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] Returning 404 to user: Instance b467734c-1d03-4fa7-a389-a6e0e4188a44 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:02.245553 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-786ebf27-ce45-4bae-a4ff-bf324088d520 tempest-MultipleCreateTestJSON-1254161371 tempest-MultipleCreateTestJSON-1254161371-project] 10.222.0.30 "GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44" status: 404 len: 111 microversion: 2.1 time: 0.076739 Apr 09 21:17:02.248708 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2641/5235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:02 2022] GET /compute/v2.1/servers/b467734c-1d03-4fa7-a389-a6e0e4188a44 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:02.255130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b295d306-8f0c-48d7-abd9-bf2ac5f2c93e req-03e787b4-4281-48fe-8a61-d6153517ace6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:02.255396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b295d306-8f0c-48d7-abd9-bf2ac5f2c93e req-03e787b4-4281-48fe-8a61-d6153517ace6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:02.285588 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b295d306-8f0c-48d7-abd9-bf2ac5f2c93e req-03e787b4-4281-48fe-8a61-d6153517ace6 service nova] Creating event network-vif-deleted:9fd8a7ed-acf3-4312-8c33-6e136c187474 for instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 on nch2-master-1 Apr 09 21:17:02.302532 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b295d306-8f0c-48d7-abd9-bf2ac5f2c93e req-03e787b4-4281-48fe-8a61-d6153517ace6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074859 Apr 09 21:17:02.304274 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2595/5236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:02.664578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:02.665532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:02.680073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:02.680537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:02.684704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:02.685266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:02.777365 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. Apr 09 21:17:02.778091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:02.779018 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7941776-3dc6-4470-a34d-de560a3ad68d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 404 len: 111 microversion: 2.1 time: 0.120196 Apr 09 21:17:02.799935 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2642/5237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:02 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:02.805700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-07188138-81ce-4684-8455-273b5b09ef82 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '.version_select at 0x7fb08db19ca0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:02.857412 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-07188138-81ce-4684-8455-273b5b09ef82 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939155403" status: 202 len: 0 microversion: 2.1 time: 0.050911 Apr 09 21:17:02.859091 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2596/5238] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:17:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939155403 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:17:06.496661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:06.497434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:06.517688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:06.518502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:06.519328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:06.519767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:06.558292 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. Apr 09 21:17:06.558292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:06.565395 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a69ed6ca-e756-4a4b-bf59-a1b1b7451180 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 404 len: 111 microversion: 2.1 time: 0.072767 Apr 09 21:17:06.565902 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2643/5239] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:17:06 2022] DELETE /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:06.576620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:06.577361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:06.592065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:06.594392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:06.595456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:06.597569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:06.633293 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. Apr 09 21:17:06.633921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:06.634791 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5eb8f030-54f8-492a-92e0-9ac3a63adf3f tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6" status: 404 len: 111 microversion: 2.1 time: 0.062933 Apr 09 21:17:06.636227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2597/5240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:06 2022] GET /compute/v2.1/servers/1f677bb6-c97f-4574-9104-3a2fb5dd4ae6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:07.889910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:07.890421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:07.905916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:07.906369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:07.907183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:07.915370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:07.970831 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. Apr 09 21:17:07.972055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:07.973749 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3ccd05d-36c8-40ef-879b-3b11a0e5d851 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 404 len: 111 microversion: 2.1 time: 0.089119 Apr 09 21:17:07.976824 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2644/5241] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:17:07 2022] DELETE /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:07.985505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:07.987047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: d4d6dee3-586e-4cbc-85af-69d9f3a4a151] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:07.999911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.004945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.006095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.008732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.038740 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. Apr 09 21:17:08.039351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance d4d6dee3-586e-4cbc-85af-69d9f3a4a151 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:08.047371 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d205b734-b350-4928-83f2-4025b56f5306 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151" status: 404 len: 111 microversion: 2.1 time: 0.065767 Apr 09 21:17:08.057674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:08.058430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:08.070786 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2598/5242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:07 2022] GET /compute/v2.1/servers/d4d6dee3-586e-4cbc-85af-69d9f3a4a151 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:08.074546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.077622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.082779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.083767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.104258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. Apr 09 21:17:08.110196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:08.111603 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c0334ba-77a7-42e7-8755-a3f067e46b78 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 404 len: 111 microversion: 2.1 time: 0.058087 Apr 09 21:17:08.112474 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2645/5243] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:17:08 2022] DELETE /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:08.128647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:08.130349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:08.142388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.143107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.145118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:08.145651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.147124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.152547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: a4b53be2-baae-4a03-89e1-7c4b2637308b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:08.160675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.166927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.168198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:08.168856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:08.205986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. Apr 09 21:17:08.207054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance a4b53be2-baae-4a03-89e1-7c4b2637308b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:08.208483 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1a5a39d-519d-4973-bdbe-a7f5720e6b47 tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b" status: 404 len: 111 microversion: 2.1 time: 0.073453 Apr 09 21:17:08.209332 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2646/5244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:08 2022] GET /compute/v2.1/servers/a4b53be2-baae-4a03-89e1-7c4b2637308b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:08.259749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-25050560-8048-4605-b07c-af74bdb41ec8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action" status: 200 len: 24568 microversion: 2.1 time: 0.134717 Apr 09 21:17:08.273947 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2599/5245] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:17:08 2022] POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action => generated 24568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:17:09.501468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:09.501468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:09.506991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.507697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:09.509109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.509780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:09.559074 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3bf24787-0418-44d3-9251-f8efc9bcf7e9 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065147 Apr 09 21:17:09.560266 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2647/5246] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Apr 9 21:17:09 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:09.641567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:09.642735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:09.650960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.651609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:09.652557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.652998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:09.685707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:17:09.841436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ffa9d108-b267-4728-b9ac-314d1896362c tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 204 len: 0 microversion: 2.20 time: 0.203697 Apr 09 21:17:09.842770 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2600/5247] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:17:09 2022] DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:17:09.856343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:09.857741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:09.871233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.872020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:09.873545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:09.874992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:10.097911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:10.121750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:10.125024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:10.130793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9550aa80-79a1-4d7a-ad29-cb631b58b2f7 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.279592 Apr 09 21:17:10.132459 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2648/5248] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:09 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:17:10.594938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:10.596355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:10.630348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:10.633509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:10.648623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:10.649554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:10.702908 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. Apr 09 21:17:10.703609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:10.704546 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c40d2b58-fc2a-4c79-8a23-897d2a418d6d tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 404 len: 111 microversion: 2.1 time: 0.129023 Apr 09 21:17:10.713629 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2601/5249] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:17:10 2022] DELETE /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:10.721546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:10.722319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] [instance: 0f8926ba-de0b-42ed-9343-4f06f614270f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:10.741857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:10.743342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:10.746107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:10.747222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:10.794868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] HTTP exception thrown: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. Apr 09 21:17:10.797484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] Returning 404 to user: Instance 0f8926ba-de0b-42ed-9343-4f06f614270f could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:10.799584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53cb227e-6ac8-4bc8-af66-2e818265a04a tempest-AttachVolumeNegativeTest-1154334807 tempest-AttachVolumeNegativeTest-1154334807-project] 10.222.0.30 "GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f" status: 404 len: 111 microversion: 2.1 time: 0.082251 Apr 09 21:17:10.801869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2649/5250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:10 2022] GET /compute/v2.1/servers/0f8926ba-de0b-42ed-9343-4f06f614270f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:17:11.150545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:11.151422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:11.164261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:11.166043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:11.168134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:11.170753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:12.200359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:12.225189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:12.238856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:12.240119 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e62501d7-121f-4a8f-bb1a-58bb8b7312a3 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 1.093989 Apr 09 21:17:12.258737 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2602/5251] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:11 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:17:13.264143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:13.264808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:13.277150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:13.277833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:13.278947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:13.279670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:14.036228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:14.056922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:14.064069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:14.065943 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f2a8b97-79c5-46b3-ada4-3356c9724111 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1722 microversion: 2.20 time: 0.806738 Apr 09 21:17:14.067789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2650/5252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:13 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1722 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:17:14.175396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: .version_select at 0x7fb08daf81f0>, body: {"keypair": {"name": "tempest-keypair-622713950"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:14.214024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:17:14.226709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:17:14.804931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:17:14.818608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:17:14.857273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-388b8847-c485-45b2-90f2-2fb3bd8dadfc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.115373 Apr 09 21:17:14.860409 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2603/5253] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:17:13 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:15.100719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:15.102140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:15.124806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:15.127924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:15.130224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:15.135338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:15.359655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:15.378666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:15.381913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:15.383867 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-826749d0-b4d1-4bcf-b269-e97308ac7176 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1655 microversion: 2.20 time: 0.301227 Apr 09 21:17:15.388290 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2651/5254] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:15 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1655 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:17:15.811592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-940b7160-6d4b-4428-bae0-4efd68cb5205 req-dfd7897a-886a-4b03-ba5a-bde787d8846f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80d6f9b-c4bf-4bde-8951-0118a622c5b3", "name": "network-vif-deleted", "tag": "7a7699d2-2d21-4cd2-aff6-6d6e2901324e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:15.835785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-940b7160-6d4b-4428-bae0-4efd68cb5205 req-dfd7897a-886a-4b03-ba5a-bde787d8846f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:15.836856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-940b7160-6d4b-4428-bae0-4efd68cb5205 req-dfd7897a-886a-4b03-ba5a-bde787d8846f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:15.884722 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-940b7160-6d4b-4428-bae0-4efd68cb5205 req-dfd7897a-886a-4b03-ba5a-bde787d8846f service nova] Creating event network-vif-deleted:7a7699d2-2d21-4cd2-aff6-6d6e2901324e for instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 on nch1-master-1 Apr 09 21:17:15.899910 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-940b7160-6d4b-4428-bae0-4efd68cb5205 req-dfd7897a-886a-4b03-ba5a-bde787d8846f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092711 Apr 09 21:17:15.901831 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2604/5255] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:16.403922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:16.406422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:16.434924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:16.449018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:16.451271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:16.461010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:16.639884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:16.641880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:16.643328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lazy-loading 'fault' on Instance uuid a80d6f9b-c4bf-4bde-8951-0118a622c5b3 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:17:16.968203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:16.985968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:16.989023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2809b3bcbea4d2eb9ab6b360669fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a1102e4f4e441b947116441b3e330d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:16.989887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c418cbc0-7a88-4dff-8f9d-13e6a934b136 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 200 len: 1371 microversion: 2.20 time: 0.590474 Apr 09 21:17:16.991870 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2652/5256] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:16 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 1371 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:17:18.012499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:18.013950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:18.039376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:18.042302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:18.045451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:18.046531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:18.098569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. Apr 09 21:17:18.104976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:18.105897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3720f709-ecc9-490a-9b02-0b341d6cfe29 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 404 len: 111 microversion: 2.20 time: 0.100489 Apr 09 21:17:18.111027 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2605/5257] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:18 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:17:18.121977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c78ea281-388a-4883-ac56-c5c83ba93bc8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '.version_select at 0x7fb08db65310>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:18.161166 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c78ea281-388a-4883-ac56-c5c83ba93bc8 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766988564" status: 204 len: 0 microversion: 2.20 time: 0.044297 Apr 09 21:17:18.164699 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2653/5258] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Apr 9 21:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766988564 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:17:19.374811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:19.375436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:19.393253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:19.393625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:19.394438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:19.394977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:20.249988 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-214fa389-a03b-47bc-845b-47991d3fe317 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1834 microversion: 2.1 time: 0.878876 Apr 09 21:17:20.268493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2606/5259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:19 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1834 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:20.274905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:20.276550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:20.296472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:20.298748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:20.304303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:20.304757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:21.941794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:21.952014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0569184d-8357-4b72-9838-ba24c95f723b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1683 microversion: 2.1 time: 1.681944 Apr 09 21:17:21.967978 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2654/5260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:20 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1683 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:22.289749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:22.297966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:22.309400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.312361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:22.313117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.313356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:22.314469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.317551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.325737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.329854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.330758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.331207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.356135 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. Apr 09 21:17:22.356996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:22.366276 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca814b17-34e0-4583-b587-d54afcfd834d tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 404 len: 111 microversion: 2.20 time: 0.083155 Apr 09 21:17:22.367122 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2607/5261] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:17:22 2022] DELETE /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:17:22.377224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:22.378082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a80d6f9b-c4bf-4bde-8951-0118a622c5b3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:22.391062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.394527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.395602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.397998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.418588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53d3a149-424c-4c64-9994-8ea666739886 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action" status: 200 len: 32642 microversion: 2.1 time: 0.110450 Apr 09 21:17:22.419700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2655/5262] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:17:22 2022] POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action => generated 32642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:17:22.430875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. Apr 09 21:17:22.434016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a80d6f9b-c4bf-4bde-8951-0118a622c5b3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:22.435222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0ceb25b3-60ec-4e93-9d77-164341322bc4 tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3" status: 404 len: 111 microversion: 2.20 time: 0.062663 Apr 09 21:17:22.451681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2608/5263] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:22 2022] GET /compute/v2.1/servers/a80d6f9b-c4bf-4bde-8951-0118a622c5b3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:17:22.585429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:22.586102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:22.597614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.608606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.616735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:22.621982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:22.699114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f9202e7a69af4d7aba0bdf5982972be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05fb2ff69eb4e3e8464952cacd62c77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:22.700113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] flavor_id is None. Assuming migration. {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 09 21:17:22.700843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:17:22.971268 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87d9c239-9d80-430e-946b-b3f8798bcaea tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action" status: 202 len: 0 microversion: 2.1 time: 0.390019 Apr 09 21:17:22.973960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2656/5264] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:17:22 2022] POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:17:22.986126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:22.987109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:22.999231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:23.000727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:23.002626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:23.006058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:24.197777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-285609053", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe7136e7-da4e-4ad5-bb48-0519f1b05f75"}], "security_groups": [{"name": "tempest-securitygroup--1546253140"}], "key_name": "tempest-keypair-622713950", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:24.218876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:24.232766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5ae6da0-e028-4985-b974-c664f0b8b1e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1692 microversion: 2.1 time: 1.249747 Apr 09 21:17:24.261608 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2609/5265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:22 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1692 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:24.838685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] validate_networks() for [('fe7136e7-da4e-4ad5-bb48-0519f1b05f75', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:17:24.851998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:24.852522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:24.870118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:24.870587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:24.871405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:24.873944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:24.910526 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. Apr 09 21:17:24.912368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:24.913940 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2af1e12-f441-4e6e-bcc4-1ca6d0255d6b tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 404 len: 111 microversion: 2.20 time: 0.076720 Apr 09 21:17:24.914974 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2610/5266] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:17:24 2022] DELETE /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 09 21:17:24.931032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:24.931663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] [instance: a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:24.953565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:24.954288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:24.959118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:24.961719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:24.999656 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] HTTP exception thrown: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. Apr 09 21:17:25.000545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] Returning 404 to user: Instance a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:25.002395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cad201ba-62e5-4ae6-9e79-840f6d5b72ba tempest-AttachVolumeShelveTestJSON-1751174024 tempest-AttachVolumeShelveTestJSON-1751174024-project] 10.222.0.30 "GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3" status: 404 len: 111 microversion: 2.20 time: 0.081307 Apr 09 21:17:25.003610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2611/5267] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:17:24 2022] GET /compute/v2.1/servers/a78cad15-c709-4b9f-a8aa-0b2b14c9b3a3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:17:25.276237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:25.278541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:25.298702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:25.301311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:25.303672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:25.305289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:25.957716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:25.966710 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3e8c8167-e9ee-4009-ae0e-252be98bf462 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1692 microversion: 2.1 time: 0.701466 Apr 09 21:17:25.979851 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2612/5268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:25 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1692 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:26.539789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:17:26.540389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:17:26.540848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:17:26.541509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:17:26.542114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:17:26.557226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:26.558007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:26.559011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:26.559661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:26.605393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:17:26.611122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:17:26.624653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:17:26.627389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:17:26.762580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-98500e25-1662-44ea-a9dc-509256aada82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.565182 Apr 09 21:17:26.766922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2657/5269] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:17:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:17:26.778108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a951ff4b-b1e2-4b9a-8bd4-e5a27e673fa2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:26.779538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a951ff4b-b1e2-4b9a-8bd4-e5a27e673fa2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:26.905669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a951ff4b-b1e2-4b9a-8bd4-e5a27e673fa2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:26.919816 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a951ff4b-b1e2-4b9a-8bd4-e5a27e673fa2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1237 microversion: 2.1 time: 0.145411 Apr 09 21:17:26.922879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2613/5270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:26 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:26.988642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:26.990550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:27.012155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:27.012621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:27.016234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:27.016715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:27.928508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:27.936316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f87546e1-00e0-4ab1-b3c4-8f0901c16ddd tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1692 microversion: 2.1 time: 0.954326 Apr 09 21:17:27.945308 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2658/5271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:26 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1692 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:27.952770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:27.953608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:27.984238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:27.986017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:27.987618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:27.991918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:28.172649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:28.187389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0708f711-d8e7-42d8-8aca-70892c4191e5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1289 microversion: 2.1 time: 0.252366 Apr 09 21:17:28.189082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2614/5272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:27 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1289 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:28.958949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:28.960395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:28.982127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:28.982724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:28.986838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:28.989457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:29.207970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:29.209531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:29.225998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:29.226530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:29.229127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:29.231391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:29.533970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:29.553098 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93656feb-8d7d-4c62-ba2e-ebe11bb887df tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1295 microversion: 2.1 time: 0.348644 Apr 09 21:17:29.554370 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2615/5273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:29 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1295 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:29.652730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:29.660624 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb346626-880b-42b2-ba24-2d848ced8c60 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1692 microversion: 2.1 time: 0.709351 Apr 09 21:17:29.668368 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2659/5274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:28 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1692 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:30.573575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:30.574558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:30.624824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:30.628193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:30.631421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:30.633463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:30.684854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:30.685601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:30.703971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:30.709204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:30.710246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:30.711937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:30.986464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:30.996830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b8deac5-1a05-4e1c-a373-bfc18a18fcce tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1295 microversion: 2.1 time: 0.429390 Apr 09 21:17:31.006111 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2616/5275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:30 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1295 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:31.421991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:31.430193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d999194-fb81-423c-8196-f02e424bc08d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.749251 Apr 09 21:17:31.430874 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2660/5276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:30 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:32.013672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:32.014303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:32.022060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:32.022520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:32.023334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:32.023800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:32.448959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:32.450170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:32.463967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:32.469472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:32.472819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:32.476763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:33.243946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:33.260128 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a8c9e148-bf1b-4f80-80e8-f005c274c617 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 1.250347 Apr 09 21:17:33.262447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2617/5277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:32 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:33.348814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:33.364731 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-870d72b4-4512-43c1-8f8c-66fa64fbe977 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.917132 Apr 09 21:17:33.367560 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2661/5278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:32 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:34.278817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:34.280143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:34.307974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:34.308775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:34.310334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:34.310987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:34.383913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:34.385178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:34.392700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:34.393278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:34.394111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:34.394745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:35.054707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:35.056031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:35.077819 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0926e2e2-0aaf-4cd4-a94f-e4eefd9cf7c2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.697768 Apr 09 21:17:35.078963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b9a4c46a-19ce-48a5-890c-8fd37aff5524 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.798040 Apr 09 21:17:35.090478 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2618/5279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:34 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:35.093371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2662/5280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:34 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:35.108130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:35.108853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:35.119482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6f16e9d3-0169-4e92-9fbe-fe568e5b4379 req-cb8be97a-aea4-4ed6-9466-f1e134c2f66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:35.141668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:35.142176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:35.145566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:35.148138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:35.155421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6f16e9d3-0169-4e92-9fbe-fe568e5b4379 req-cb8be97a-aea4-4ed6-9466-f1e134c2f66b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:35.157076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6f16e9d3-0169-4e92-9fbe-fe568e5b4379 req-cb8be97a-aea4-4ed6-9466-f1e134c2f66b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:35.189668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6f16e9d3-0169-4e92-9fbe-fe568e5b4379 req-cb8be97a-aea4-4ed6-9466-f1e134c2f66b service nova] Creating event network-changed:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:17:35.202920 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6f16e9d3-0169-4e92-9fbe-fe568e5b4379 req-cb8be97a-aea4-4ed6-9466-f1e134c2f66b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087740 Apr 09 21:17:35.206450 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2663/5281] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:35.227740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:17:35.456715 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 204 len: 0 microversion: 2.1 time: 0.352572 Apr 09 21:17:35.462916 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2619/5282] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:17:35 2022] DELETE /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:17:35.468617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:35.469394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:35.491859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:35.492578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:35.495406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:35.496129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:36.096709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:36.097449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:36.110965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:36.113657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:36.114812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:36.117741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:36.208082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:36.219299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f8bdb639-24e4-4cbb-801b-d9035700f273 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1579 microversion: 2.1 time: 0.755601 Apr 09 21:17:36.220635 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2664/5283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:35 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1579 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:36.227174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:36.228203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:36.235846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:36.238186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:36.239517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:36.240181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:36.761409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:36.783907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:36.793137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4211dec-f909-420b-b7fc-710f7ff922ec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.566189 Apr 09 21:17:36.794617 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e595aa1e-6839-43c8-adcb-8579df285f5e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.700332 Apr 09 21:17:36.796136 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2665/5284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:36 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:36.806030 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2620/5285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:36 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:37.239147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:37.239872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:37.251397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.252204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.253267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.255135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.258582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-039baeb8-d152-45f2-8395-f39941a08b91 req-26b9f4ee-7ad2-4dfb-b33f-c22f432be374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:37.270986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-039baeb8-d152-45f2-8395-f39941a08b91 req-26b9f4ee-7ad2-4dfb-b33f-c22f432be374 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.275601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-039baeb8-d152-45f2-8395-f39941a08b91 req-26b9f4ee-7ad2-4dfb-b33f-c22f432be374 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.318628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-039baeb8-d152-45f2-8395-f39941a08b91 req-26b9f4ee-7ad2-4dfb-b33f-c22f432be374 service nova] Creating event network-changed:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:17:37.348329 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-039baeb8-d152-45f2-8395-f39941a08b91 req-26b9f4ee-7ad2-4dfb-b33f-c22f432be374 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092165 Apr 09 21:17:37.350915 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2621/5286] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:37.618638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:37.628174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-998d7b4b-abab-4c76-85d2-7d5788879b0d tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1579 microversion: 2.1 time: 0.394078 Apr 09 21:17:37.631841 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2666/5287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:37 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1579 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:37.812478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:37.813836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:37.822638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.823689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:37.825212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:37.825717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.828049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.833821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.838514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.839279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:37.840320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:37.841195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:38.524209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:38.531796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5b875921-5ee1-4cb7-9f51-95d0f9e3468b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.723594 Apr 09 21:17:38.549545 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2622/5288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:37 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:38.570496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:38.581571 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-26946fbb-d53b-4bbd-bc60-5ed760eaa6d2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.762712 Apr 09 21:17:38.582169 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2667/5289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:37 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:38.648005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:38.648943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:38.660914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:38.662153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:38.665682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:38.668465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:39.092026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8303163dfe6c44dc8552919975c72eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e537a0863d43df811118a31e20609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:39.103200 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea6b3b5f-c393-4cca-b661-15395e13323c tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 200 len: 1579 microversion: 2.1 time: 0.459183 Apr 09 21:17:39.107868 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2623/5290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:38 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 1579 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:39.556689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:39.557336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:39.584611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:39.585548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:39.591202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:39.592947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:40.294148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4c54b132-7af6-450d-859e-dc1f294ffd83 req-e621b255-36d3-4318-be38-84d435dcb3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec9d8f4-ad73-4137-b9b7-882a94996671", "name": "network-vif-deleted", "tag": "07eecfd5-c561-41ce-aafc-0176e0404d3f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:40.317696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c54b132-7af6-450d-859e-dc1f294ffd83 req-e621b255-36d3-4318-be38-84d435dcb3fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:40.318914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c54b132-7af6-450d-859e-dc1f294ffd83 req-e621b255-36d3-4318-be38-84d435dcb3fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:40.961221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:40.971670 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fddb2fcc-fbe7-48e1-b063-231e7f8bc34f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 1.424615 Apr 09 21:17:40.975532 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2668/5291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:40.983007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:40.983851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:40.999126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:40.999889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:41.001460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:41.003735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:41.151708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4c54b132-7af6-450d-859e-dc1f294ffd83 req-e621b255-36d3-4318-be38-84d435dcb3fb service nova] Creating event network-vif-deleted:07eecfd5-c561-41ce-aafc-0176e0404d3f for instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 on nch2-master-1 Apr 09 21:17:41.172860 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4c54b132-7af6-450d-859e-dc1f294ffd83 req-e621b255-36d3-4318-be38-84d435dcb3fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.595223 Apr 09 21:17:41.173531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2624/5292] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:41.179305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:41.180291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] [instance: 4ec9d8f4-ad73-4137-b9b7-882a94996671] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:41.191578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:41.196725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:41.197648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:41.198302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:41.233117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] HTTP exception thrown: Instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 could not be found. Apr 09 21:17:41.233905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Returning 404 to user: Instance 4ec9d8f4-ad73-4137-b9b7-882a94996671 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:17:41.234907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d9be743-149b-449c-a84e-9e7d2aeba012 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671" status: 404 len: 111 microversion: 2.1 time: 0.060032 Apr 09 21:17:41.235662 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2625/5293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:41 2022] GET /compute/v2.1/servers/4ec9d8f4-ad73-4137-b9b7-882a94996671 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:17:41.708010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aae422d2-1672-4e0a-9775-f963ff620d09 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] Calling method '.version_select at 0x7fb08db305e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:41.768986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aae422d2-1672-4e0a-9775-f963ff620d09 tempest-TestVolumeBackupRestore-1877640871 tempest-TestVolumeBackupRestore-1877640871-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2036262543" status: 202 len: 0 microversion: 2.1 time: 0.065778 Apr 09 21:17:41.776391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2626/5294] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Apr 9 21:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2036262543 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:17:41.790093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:41.815995 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-44dac792-bfb9-4f7f-8585-3d3172831d4c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.838969 Apr 09 21:17:41.834593 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2669/5295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:40 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:41.994701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:41.995576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:42.012665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:42.015262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:42.016962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:42.019685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:42.463355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:42.482732 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a0b62fa-7601-4190-8b5b-1c8b9187f069 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.494478 Apr 09 21:17:42.484818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2627/5296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:41 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:42.840304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:42.847001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:42.886453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:42.887122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:42.889390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:42.891471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:43.271035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:43.286103 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e75dc384-bf62-4d5f-8d28-296cc9ff6418 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.448923 Apr 09 21:17:43.290776 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2670/5297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:42 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:43.512752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:43.514109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:43.538223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:43.541378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:43.542257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:43.542712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:43.749874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-77287d0d-0119-418b-9b9e-e44b8b28ca4d req-a745ea20-bb9a-4ede-8929-80e6c0eda648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-plugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:43.815568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-77287d0d-0119-418b-9b9e-e44b8b28ca4d req-a745ea20-bb9a-4ede-8929-80e6c0eda648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:43.817094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-77287d0d-0119-418b-9b9e-e44b8b28ca4d req-a745ea20-bb9a-4ede-8929-80e6c0eda648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:43.850943 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-77287d0d-0119-418b-9b9e-e44b8b28ca4d req-a745ea20-bb9a-4ede-8929-80e6c0eda648 service nova] Creating event network-vif-plugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:17:43.858776 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-77287d0d-0119-418b-9b9e-e44b8b28ca4d req-a745ea20-bb9a-4ede-8929-80e6c0eda648 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116578 Apr 09 21:17:43.860426 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2671/5298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:43.969512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:43.983753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a71dac3-0fb9-42a8-9343-e62f8c6d8629 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.482831 Apr 09 21:17:43.984388 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2628/5299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:43 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:44.310808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:44.311924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:44.323760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:44.324538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:44.325727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:44.326211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:44.808681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:44.823004 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4fcbf8b1-d0d9-44c8-8dce-0c7dc85c5478 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.518179 Apr 09 21:17:44.824215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2672/5300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:44 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:45.000837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:45.001627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:45.009357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:45.009813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:45.010619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:45.011055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:45.247083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:45.256172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-001a10a6-abed-4cd9-b7d1-179252c18e05 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1363 microversion: 2.1 time: 0.259103 Apr 09 21:17:45.256770 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2629/5301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:44 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:45.841651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:45.842372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:45.856310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:45.856764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:45.857769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:45.858370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:46.273603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:46.274883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:46.286216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:46.287128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:46.288218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:46.288886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:46.325174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:46.333299 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a0939b1-9bf0-49d8-9546-fd35417136f4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1697 microversion: 2.1 time: 0.495543 Apr 09 21:17:46.340580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2673/5302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:45 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1697 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:46.645688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:46.658863 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-45a179da-119c-480f-95fc-a7325f9d9953 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1550 microversion: 2.1 time: 0.389600 Apr 09 21:17:46.659540 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2630/5303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1550 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:46.678795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:46.679301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:46.687841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:46.688305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:46.689139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:46.697180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:46.902590 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f4d77a1-bf76-4b89-a8f2-aa0fddc6b3a9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226727 Apr 09 21:17:46.906274 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2674/5304] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:17:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:47.351582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:47.353884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:47.370411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:47.373000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:47.375973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:47.376616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:47.895087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:47.924534 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-746657d7-20a5-45f6-b648-42f7ef491cbe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1696 microversion: 2.1 time: 0.574109 Apr 09 21:17:47.926893 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2631/5305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:47 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1696 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:48.554023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:48.580381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:48.581198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:48.613139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] Creating event network-vif-unplugged:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch2-master-1 Apr 09 21:17:48.636729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:17:48.665397 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ac75f153-4593-4630-a740-de9135356206 req-8405c2da-f576-410c-8959-6dc2889fca85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116507 Apr 09 21:17:48.666336 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2675/5306] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:17:48.946379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:48.947658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:48.961908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:48.963580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:48.966858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:48.968582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:49.579342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:49.586972 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b868e37c-e6d3-4ac1-a478-6cd72bc5dd9e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1696 microversion: 2.1 time: 0.646550 Apr 09 21:17:49.587570 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2632/5307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:48 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1696 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:50.604741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:50.606131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:50.614092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:50.615487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:50.616954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:50.618260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:50.995188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:51.010663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:51.014033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:51.041145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] Creating event network-changed:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch2-master-1 Apr 09 21:17:51.050955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:17:51.058374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:51.074310 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60fd54fb-58db-4117-896b-33122692ef56 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1696 microversion: 2.1 time: 0.473621 Apr 09 21:17:51.085905 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2676/5308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:50 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1696 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:51.111298 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3e51524b-bc2c-4e12-b826-82b07b4ecb2e req-6713430e-dcf1-49e8-b756-69445bacd505 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119782 Apr 09 21:17:51.111935 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2633/5309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:51.283839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:51.284728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:51.297748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:51.298400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:51.301361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:51.302029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:51.313601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-52e55d49-8e08-431d-8b27-5e6f9d680962 req-fcea3a7f-9f25-42a9-aa8b-37a0ee0dd4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:51.337862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-52e55d49-8e08-431d-8b27-5e6f9d680962 req-fcea3a7f-9f25-42a9-aa8b-37a0ee0dd4ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:51.340420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-52e55d49-8e08-431d-8b27-5e6f9d680962 req-fcea3a7f-9f25-42a9-aa8b-37a0ee0dd4ea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:51.408222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-52e55d49-8e08-431d-8b27-5e6f9d680962 req-fcea3a7f-9f25-42a9-aa8b-37a0ee0dd4ea service nova] Creating event network-changed:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:17:51.440215 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-52e55d49-8e08-431d-8b27-5e6f9d680962 req-fcea3a7f-9f25-42a9-aa8b-37a0ee0dd4ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127039 Apr 09 21:17:51.441564 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2634/5310] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:17:52.104966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:52.106628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:52.121772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:52.122619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:52.123664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:52.124309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:52.785663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:52.800381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d70c42c5-a132-42ca-a8e3-9867b801c33b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1550 microversion: 2.1 time: 1.521375 Apr 09 21:17:52.802034 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2677/5311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:51 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1550 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:52.826681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:52.827846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:52.842364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:52.844792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:52.849427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:52.851118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:53.130724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:53.140507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2f352f2-b6b6-48bb-9d0c-8e8ccf5c8e28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1696 microversion: 2.1 time: 1.040122 Apr 09 21:17:53.141268 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2635/5312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:52 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1696 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:53.768927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:53.780801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e66783e6-788b-4764-88c4-88c938d0ff4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1550 microversion: 2.1 time: 0.960599 Apr 09 21:17:53.795677 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2678/5313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:52 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1550 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:54.160160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:54.161359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:54.193252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:54.194569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:54.206237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:54.209308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:54.637410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-450226044", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:54.706438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:17:55.384144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:55.393929 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35cb36a2-b017-41cf-807e-b4e02a623abe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1696 microversion: 2.1 time: 1.239467 Apr 09 21:17:55.394577 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2636/5314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:54 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1696 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:55.400698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:55.401341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:55.414623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:55.415080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:55.416713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:55.417190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:56.123470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:17:56.125610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:17:56.126257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:17:56.126859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:17:56.127286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:17:56.137875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:56.138334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:56.140449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:56.141135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:56.157416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:56.170737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Getting quotas for project 55bfa8219d074eb1b2e1f2469053cd8f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:17:56.173962 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3be57734-9249-43de-94a1-06d479ee264c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1550 microversion: 2.1 time: 0.777608 Apr 09 21:17:56.177010 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2637/5315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:55 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1550 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:56.181563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Getting quotas for user 10418f53ef434172ba24367322166d33 and project 55bfa8219d074eb1b2e1f2469053cd8f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:17:56.196708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:17:56.199856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:17:56.248575 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dbbc0416-e295-476f-9413-baa7d3d7f9e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615012 Apr 09 21:17:56.254679 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2679/5316] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:17:56.262170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20c76c43-c941-4da7-849a-9c751a8244d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:56.262973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-20c76c43-c941-4da7-849a-9c751a8244d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:56.371563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-20c76c43-c941-4da7-849a-9c751a8244d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:56.382431 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20c76c43-c941-4da7-849a-9c751a8244d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1214 microversion: 2.1 time: 0.125282 Apr 09 21:17:56.383923 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2638/5317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:56 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:56.420482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:56.421501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:56.433060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:56.433706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:56.434435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:56.434882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:56.980350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:56.992085 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f991104-4ac5-4c5a-bef3-a3e99285eca7 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1694 microversion: 2.1 time: 0.584252 Apr 09 21:17:56.992781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2680/5318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:56 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1694 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:57.206197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:57.213566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:57.224979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:57.225854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:57.228536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:57.229501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:57.400061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:57.400796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:57.412015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:57.413247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:57.414490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:57.417231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:57.912450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:57.923470 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0dd1347c-4bbd-4a13-81c3-1624970318e0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1210 microversion: 2.1 time: 0.527250 Apr 09 21:17:57.931836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2681/5319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:57 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1210 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:58.233017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:58.241934 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d40e9793-a42d-4a34-bf06-e17045b3164d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 1.052406 Apr 09 21:17:58.246164 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2639/5320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:57 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:58.264636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:58.265497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:58.276939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.277578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:58.278537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.279126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:58.459827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:58.460447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:58.470027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.477366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:58.482282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.490920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:58.939944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:58.951913 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82635b59-adc5-4d36-959f-c90b340ac335 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.690745 Apr 09 21:17:58.953283 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2640/5321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:58 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:17:58.960928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:58.962183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:58.974262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.974948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:58.977664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:58.980001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.258271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:59.266388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a27212e-1283-40e5-bfd8-4fd13cb4833d tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1272 microversion: 2.1 time: 0.311856 Apr 09 21:17:59.271738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:17:59.274451 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2641/5322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:58 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:59.279894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1922474585"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:59.281012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:59.285649 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-332903a5-157e-4763-ad92-60cfe5d094bf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1691 microversion: 2.1 time: 1.273203 Apr 09 21:17:59.286562 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2682/5323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:58 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1691 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:17:59.303845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:17:59.305267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:59.317347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.319619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.323260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.325608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.332315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.338415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.343557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.346992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.619086 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-300b0570-13d4-4bd5-b2b0-37399d5655ff tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action" status: 202 len: 0 microversion: 2.1 time: 0.319763 Apr 09 21:17:59.620744 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2683/5324] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:17:59 2022] POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:17:59.631537 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:17:59.634021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:17:59.646572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.647987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:17:59.649967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:17:59.650630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:00.056091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-570ca62e-a944-4f00-b4ec-00cdec844888 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.779845 Apr 09 21:18:00.057117 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2642/5325] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:17:59 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 09 21:18:00.114388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-plugged", "status": "completed", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:00.147203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:00.147770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:00.208148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] Creating event network-vif-plugged:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch2-master-1 Apr 09 21:18:00.238080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:18:00.253216 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-46b35721-0f29-43c7-96f3-2d217a6ab4c5 req-72680a3c-4dbf-448d-a5c8-d2e038fce43a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142666 Apr 09 21:18:00.254447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2643/5326] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:00.316145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:00.329305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:00.338149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:00.338816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:00.340817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:00.341483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:00.579214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:00.591601 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d811e929-0feb-4284-82d2-c72af7682127 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1272 microversion: 2.1 time: 0.289894 Apr 09 21:18:00.593217 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2644/5327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:00 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:00.662971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:00.674625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-09b77fc7-c777-4e24-87d2-7957eb916619 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 1.048864 Apr 09 21:18:00.697421 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2684/5328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:17:59 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:01.609416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:01.611194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:01.637849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:01.639877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:01.642517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:01.643178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:01.692374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:01.693791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:01.729572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:01.731955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:01.733337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:01.735406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:02.825514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:02.833497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b3e1a10-93b8-4fad-8d4c-b76a485ebedf tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 1.228091 Apr 09 21:18:02.849267 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2645/5329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:01 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:02.899582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:02.910732 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d406257c-b83f-4a1f-8d9d-5aee11ed8824 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 1.222643 Apr 09 21:18:02.912690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2685/5330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:01 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:03.864041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:03.867842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:03.883272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:03.883931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:03.885337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:03.888918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:03.933090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:03.935272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:03.950547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:03.951255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:03.954080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:03.955878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:05.226190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:05.234619 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0bef588e-3712-4849-8e9a-3b85d83c9899 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 1.383506 Apr 09 21:18:05.248186 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2646/5331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:03 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:05.262274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fd71c466-dafb-4f7b-b683-567d2423ec93 req-02adbd7f-4ad1-4ad4-b50b-157fe7f28df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25547687-7c47-48a7-a6a4-032cc057cb23", "tag": "d7c5bc27-a30f-40c3-90ed-faa98edc286b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:05.277015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fd71c466-dafb-4f7b-b683-567d2423ec93 req-02adbd7f-4ad1-4ad4-b50b-157fe7f28df5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:05.278045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fd71c466-dafb-4f7b-b683-567d2423ec93 req-02adbd7f-4ad1-4ad4-b50b-157fe7f28df5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:05.292919 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fd71c466-dafb-4f7b-b683-567d2423ec93 req-02adbd7f-4ad1-4ad4-b50b-157fe7f28df5 service nova] Creating event network-changed:d7c5bc27-a30f-40c3-90ed-faa98edc286b for instance 25547687-7c47-48a7-a6a4-032cc057cb23 on nch2-master-1 Apr 09 21:18:05.302148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fd71c466-dafb-4f7b-b683-567d2423ec93 req-02adbd7f-4ad1-4ad4-b50b-157fe7f28df5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051381 Apr 09 21:18:05.303460 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2647/5332] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:05.400685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:05.411622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7936f4a-92e2-47fd-90a1-0586ce4f2f55 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 1.483431 Apr 09 21:18:05.412554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2686/5333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:03 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:18:05.883005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b4f8c438-6576-48f2-aec6-6bd8c8324351 req-df791057-42f4-4961-bfe5-96934cd83b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-plugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:05.923454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b4f8c438-6576-48f2-aec6-6bd8c8324351 req-df791057-42f4-4961-bfe5-96934cd83b1c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:05.949120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b4f8c438-6576-48f2-aec6-6bd8c8324351 req-df791057-42f4-4961-bfe5-96934cd83b1c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:06.035950 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b4f8c438-6576-48f2-aec6-6bd8c8324351 req-df791057-42f4-4961-bfe5-96934cd83b1c service nova] Creating event network-vif-plugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:18:06.061718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b4f8c438-6576-48f2-aec6-6bd8c8324351 req-df791057-42f4-4961-bfe5-96934cd83b1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197320 Apr 09 21:18:06.073614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2648/5334] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:06.258780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:06.259448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:06.267654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:06.268553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:06.269748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:06.270636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:06.435782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:06.437820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:06.448855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:06.449420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:06.450482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:06.451181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:08.255191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:08.282611 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d45f9577-6093-45f9-92a8-7ddcc661c738 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 2.027781 Apr 09 21:18:08.283924 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2687/5335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:06 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:08.298396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:08.320326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:08.323109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:08.340208 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] Creating event network-vif-unplugged:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:18:08.348221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:18:08.362487 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-532967e2-1d0d-4592-9a23-e1ed41aedae5 req-8b24d7b2-177a-4ab2-991f-bece55893397 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076902 Apr 09 21:18:08.363967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2688/5336] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:08.426701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:08.438725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae8ccff4-fce1-4290-8bb2-7b1f9066ac03 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 2.010887 Apr 09 21:18:08.443582 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2649/5337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:06 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:09.302128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:09.303463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:09.313921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:09.314707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:09.316717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:09.317556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:09.503013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:09.506195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:09.535205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:09.536035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:09.536947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:09.543017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:10.234555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:10.244701 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6bdf467e-88b1-496d-9df1-6fd8d2b6983c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 0.773487 Apr 09 21:18:10.251019 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2650/5338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:09 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:10.305926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:10.316176 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fb68826-6430-47d1-8956-b852916892d0 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 1.019957 Apr 09 21:18:10.331715 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2689/5339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:09 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:10.475059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:10.518475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:10.519191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:10.603004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] Creating event network-changed:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:18:10.625048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:18:10.664550 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7f585789-33df-4520-a538-bae31fe93354 req-e482f1bb-4bbb-4106-8235-755b5e4bde37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193261 Apr 09 21:18:10.667910 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2651/5340] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:11.270726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:11.271837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:11.281186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:11.281645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:11.282436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:11.282867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:11.340247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:11.341283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:11.352711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:11.353545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:11.354592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:11.358491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:12.158180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:12.175741 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f77d6997-7840-48a0-8735-af412ba9e54b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 0.908363 Apr 09 21:18:12.178406 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2690/5341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:11 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:12.493980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:12.517050 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3bd0040d-cb17-4623-a95b-8efd904e239c tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 1.167925 Apr 09 21:18:12.520056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2652/5342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:11 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:18:13.195161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:13.195776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:13.203887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:13.204341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:13.205150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:13.205589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:13.537174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:13.537822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:13.555572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:13.556050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:13.556861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:13.557333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:15.642748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:15.654581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e0828aa6-55e9-4a6c-aec2-f0fa00518e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1690 microversion: 2.1 time: 2.463246 Apr 09 21:18:15.670724 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2691/5343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:13 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1690 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:15.689919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cf963236-b56b-402e-91e1-5fcd0e2dfb2a req-161d0e69-ffc6-460d-bf9a-4f939fb1fb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25547687-7c47-48a7-a6a4-032cc057cb23", "name": "network-vif-plugged", "status": "completed", "tag": "d7c5bc27-a30f-40c3-90ed-faa98edc286b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:15.712803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cf963236-b56b-402e-91e1-5fcd0e2dfb2a req-161d0e69-ffc6-460d-bf9a-4f939fb1fb0c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:15.713621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cf963236-b56b-402e-91e1-5fcd0e2dfb2a req-161d0e69-ffc6-460d-bf9a-4f939fb1fb0c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:15.738302 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cf963236-b56b-402e-91e1-5fcd0e2dfb2a req-161d0e69-ffc6-460d-bf9a-4f939fb1fb0c service nova] Creating event network-vif-plugged:d7c5bc27-a30f-40c3-90ed-faa98edc286b for instance 25547687-7c47-48a7-a6a4-032cc057cb23 on nch2-master-1 Apr 09 21:18:15.756411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-cf963236-b56b-402e-91e1-5fcd0e2dfb2a req-161d0e69-ffc6-460d-bf9a-4f939fb1fb0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083933 Apr 09 21:18:15.757528 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2692/5344] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:15.879436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:15.892381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3455df7b-b330-491f-bccf-ec6f2b29a913 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 2.359310 Apr 09 21:18:15.893309 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2653/5345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:13 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:18:16.676017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:16.676917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:16.706776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:16.707673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:16.708786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:16.712410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:16.910406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:16.911719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:16.941175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:16.941844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:16.944094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:16.946077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:17.920171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:17.921352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:17.931386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ada4e22b-6bbd-490d-a232-ed59d34357b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1683 microversion: 2.1 time: 1.259605 Apr 09 21:18:17.931762 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2693/5346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:16 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1683 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:17.945248 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2d462eb-a9e5-44fb-9903-4fafa98e7454 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1314 microversion: 2.1 time: 1.038852 Apr 09 21:18:17.945930 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2654/5347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:16 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:18.963333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:18.963958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:18.981312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:18.981776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:18.982600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:18.983038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:19.540664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:19.548549 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e218ce0-329c-4e90-ad7d-ce18991bad6b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1463 microversion: 2.1 time: 0.589160 Apr 09 21:18:19.558045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2694/5348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:18 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1463 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:19.653533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:19.654341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:19.670218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:19.676461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:19.677446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:19.683952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:19.770259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:18:20.035269 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f5c796a9-47f8-4d0b-be8f-4ac542709d75 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "DELETE /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 204 len: 0 microversion: 2.1 time: 0.385918 Apr 09 21:18:20.037250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2655/5349] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:18:19 2022] DELETE /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:18:20.049356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:20.050781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:20.060444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:20.061284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:20.066024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:20.067420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:20.295869 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9050beee-6c6c-4312-8224-68a4e58ffffa req-5575718d-3f5d-41e8-92d0-120174e38e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-plugged", "status": "completed", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:20.312098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9050beee-6c6c-4312-8224-68a4e58ffffa req-5575718d-3f5d-41e8-92d0-120174e38e1f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:20.313207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9050beee-6c6c-4312-8224-68a4e58ffffa req-5575718d-3f5d-41e8-92d0-120174e38e1f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:20.330018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9050beee-6c6c-4312-8224-68a4e58ffffa req-5575718d-3f5d-41e8-92d0-120174e38e1f service nova] Creating event network-vif-plugged:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:18:20.340073 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9050beee-6c6c-4312-8224-68a4e58ffffa req-5575718d-3f5d-41e8-92d0-120174e38e1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062293 Apr 09 21:18:20.341542 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2656/5350] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:20.644452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:20.656602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8914ed83-6b75-4639-9e84-3bc5040375da tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1469 microversion: 2.1 time: 0.614669 Apr 09 21:18:20.660740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2695/5351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:20 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:18:21.681427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:21.683061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:21.698991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:21.699605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:21.702198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:21.702809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:22.085305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:22.095069 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e61a393-804c-415b-a178-59cfe231f9ba tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1469 microversion: 2.1 time: 0.420289 Apr 09 21:18:22.101069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2657/5352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:21 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:23.116018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:23.116653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:23.129734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:23.130492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:23.131455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:23.133958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:23.601829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-bb40c1cf-2ac9-4f6d-b7ca-257e3f358fe6 req-daacc017-3ff3-4630-914e-df33e7695c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25547687-7c47-48a7-a6a4-032cc057cb23", "name": "network-vif-deleted", "tag": "d7c5bc27-a30f-40c3-90ed-faa98edc286b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:23.623384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bb40c1cf-2ac9-4f6d-b7ca-257e3f358fe6 req-daacc017-3ff3-4630-914e-df33e7695c3e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:23.635916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bb40c1cf-2ac9-4f6d-b7ca-257e3f358fe6 req-daacc017-3ff3-4630-914e-df33e7695c3e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:23.670402 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bb40c1cf-2ac9-4f6d-b7ca-257e3f358fe6 req-daacc017-3ff3-4630-914e-df33e7695c3e service nova] Creating event network-vif-deleted:d7c5bc27-a30f-40c3-90ed-faa98edc286b for instance 25547687-7c47-48a7-a6a4-032cc057cb23 on nch2-master-1 Apr 09 21:18:23.680047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-bb40c1cf-2ac9-4f6d-b7ca-257e3f358fe6 req-daacc017-3ff3-4630-914e-df33e7695c3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082640 Apr 09 21:18:23.682153 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2658/5353] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:18:23.726157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10418f53ef434172ba24367322166d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bfa8219d074eb1b2e1f2469053cd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:23.743288 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd687034-2c9c-43e7-a2de-6cc00cb2411b tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 200 len: 1469 microversion: 2.1 time: 0.631443 Apr 09 21:18:23.751189 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2696/5354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:23 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:24.763832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:24.768840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] [instance: 25547687-7c47-48a7-a6a4-032cc057cb23] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:24.785631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:24.798597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:24.800026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:24.802312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:24.841581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] HTTP exception thrown: Instance 25547687-7c47-48a7-a6a4-032cc057cb23 could not be found. Apr 09 21:18:24.848365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] Returning 404 to user: Instance 25547687-7c47-48a7-a6a4-032cc057cb23 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:18:24.854074 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-498ac984-502c-411a-b35d-cd4e044fa290 tempest-VolumesNegativeTest-1076657774 tempest-VolumesNegativeTest-1076657774-project] 10.222.0.30 "GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23" status: 404 len: 111 microversion: 2.1 time: 0.095230 Apr 09 21:18:24.862028 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2659/5355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:24 2022] GET /compute/v2.1/servers/25547687-7c47-48a7-a6a4-032cc057cb23 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:18:27.634325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:27.634950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:27.652820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:27.653358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:27.654152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:27.654872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:27.811367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:27.820177 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c311d95c-c388-43cd-bf1f-a81ddb01795c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.191498 Apr 09 21:18:27.821371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2697/5356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:27 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:28.849151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:28.850971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:28.870281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:28.872034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:28.874340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:28.874984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:29.502451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:29.517493 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdc24682-6ece-4d69-a1f6-b519ca5a36fa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.681530 Apr 09 21:18:29.518549 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2660/5357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:28 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:29.540126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-62330561"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:29.542258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:29.561640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:29.567894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:29.569357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:29.570412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:30.045928 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e451c330-aaea-4fb3-9b8d-cb06345279bb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.510718 Apr 09 21:18:30.077408 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2698/5358] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:18:29 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 09 21:18:31.702459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fa750540-dba7-4382-934a-9f5e0b282bd9 req-a782ae2a-06dd-4e1c-bd6d-abcb2981949e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:31.717787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fa750540-dba7-4382-934a-9f5e0b282bd9 req-a782ae2a-06dd-4e1c-bd6d-abcb2981949e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:31.718149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fa750540-dba7-4382-934a-9f5e0b282bd9 req-a782ae2a-06dd-4e1c-bd6d-abcb2981949e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:31.760368 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fa750540-dba7-4382-934a-9f5e0b282bd9 req-a782ae2a-06dd-4e1c-bd6d-abcb2981949e service nova] Creating event network-vif-unplugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:18:31.770119 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fa750540-dba7-4382-934a-9f5e0b282bd9 req-a782ae2a-06dd-4e1c-bd6d-abcb2981949e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072747 Apr 09 21:18:31.775243 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2661/5359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:18:36.268383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6bb4e49a-648d-40f5-8f24-4b20aa68d296 req-dc47edb5-6251-4218-8206-a88c9bcc1bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-plugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:36.284283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6bb4e49a-648d-40f5-8f24-4b20aa68d296 req-dc47edb5-6251-4218-8206-a88c9bcc1bec service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:36.284733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6bb4e49a-648d-40f5-8f24-4b20aa68d296 req-dc47edb5-6251-4218-8206-a88c9bcc1bec service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:36.316005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6bb4e49a-648d-40f5-8f24-4b20aa68d296 req-dc47edb5-6251-4218-8206-a88c9bcc1bec service nova] Creating event network-vif-plugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:18:36.333752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6bb4e49a-648d-40f5-8f24-4b20aa68d296 req-dc47edb5-6251-4218-8206-a88c9bcc1bec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069640 Apr 09 21:18:36.334653 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2699/5360] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:18:42.358410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:42.360236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:42.367181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:42.369344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:42.372162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:42.372868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:42.491773 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2de6afe7-8971-4993-bbc9-d46d31f048f8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action" status: 200 len: 63116 microversion: 2.1 time: 0.138678 Apr 09 21:18:42.511533 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2662/5361] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:18:42 2022] POST /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361/action => generated 63116 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:18:49.348696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:49.350392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:49.363434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:49.365707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:49.368632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:49.369565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:51.717646 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b804e45-c0f9-46f5-8590-563d441ef2ae tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1834 microversion: 2.1 time: 2.864729 Apr 09 21:18:51.718482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2700/5362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:48 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1834 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:55.235424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:55.236015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:55.255703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6b0a7852-131e-4d89-855a-0ffc87a2cfa3 req-9b8dd70d-f3c4-4e7c-9303-618c6513f2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:18:55.266087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:55.266434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:55.267303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:55.267738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:55.287254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6b0a7852-131e-4d89-855a-0ffc87a2cfa3 req-9b8dd70d-f3c4-4e7c-9303-618c6513f2d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:55.287728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6b0a7852-131e-4d89-855a-0ffc87a2cfa3 req-9b8dd70d-f3c4-4e7c-9303-618c6513f2d7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:55.324964 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6b0a7852-131e-4d89-855a-0ffc87a2cfa3 req-9b8dd70d-f3c4-4e7c-9303-618c6513f2d7 service nova] Creating event network-changed:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:18:55.361537 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6b0a7852-131e-4d89-855a-0ffc87a2cfa3 req-9b8dd70d-f3c4-4e7c-9303-618c6513f2d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109477 Apr 09 21:18:55.362150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2701/5363] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:18:55.381403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:18:55.622685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8878e80c-1cca-458b-a83b-0874e2f65dfe tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 204 len: 0 microversion: 2.1 time: 0.393735 Apr 09 21:18:55.626766 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2663/5364] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:18:55 2022] DELETE /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:18:55.636060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:55.636775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:55.652245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:55.652630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:55.653454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:55.653895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:57.131477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:57.139405 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-80881281-f105-4a1b-89d6-7ca3d893d264 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1689 microversion: 2.1 time: 1.507884 Apr 09 21:18:57.140001 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2702/5365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:55 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1689 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:18:58.161540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:18:58.163082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:18:58.193000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:58.196636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:58.198863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:18:58.201574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:18:59.007382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:18:59.018733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-37e9a084-1fe4-45d7-a8c4-79a4a5c8f709 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1689 microversion: 2.1 time: 0.861947 Apr 09 21:18:59.021805 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2664/5366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:18:58 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1689 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:00.041095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:00.041560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:00.052441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:00.057633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:00.058945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:00.060423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:00.686590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:00.687865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:00.698908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:00.700086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:00.701105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:00.701704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:00.914666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:00.933163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d3c1f30-131e-4480-a9eb-aac2b619be1e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 200 len: 1570 microversion: 2.1 time: 0.895840 Apr 09 21:19:00.934506 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2703/5367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:00 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 1570 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:00.939697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-78e5357e-b0fe-40ae-b0be-381c001d61bf req-ea62164f-94c3-49d3-a66d-301217daaa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442daeb-b015-4ffb-8dd5-da2b31c20361", "name": "network-vif-deleted", "tag": "cf0d9111-1b29-4137-bef5-aea063d0fe04"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:00.972721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-78e5357e-b0fe-40ae-b0be-381c001d61bf req-ea62164f-94c3-49d3-a66d-301217daaa86 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:00.973443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-78e5357e-b0fe-40ae-b0be-381c001d61bf req-ea62164f-94c3-49d3-a66d-301217daaa86 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:00.992798 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-78e5357e-b0fe-40ae-b0be-381c001d61bf req-ea62164f-94c3-49d3-a66d-301217daaa86 service nova] Creating event network-vif-deleted:cf0d9111-1b29-4137-bef5-aea063d0fe04 for instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 on nch1-master-1 Apr 09 21:19:00.998678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-78e5357e-b0fe-40ae-b0be-381c001d61bf req-ea62164f-94c3-49d3-a66d-301217daaa86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062648 Apr 09 21:19:01.000828 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2704/5368] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:01.154567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:01.170720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b9a71ee-1fba-482f-859d-ec3da0d4d996 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.489006 Apr 09 21:19:01.172234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2665/5369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:00 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:01.191269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1874491319"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:01.193720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:01.211166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.211870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:01.220762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.221328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:01.933591 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad37a540-546c-4867-b2d2-f4d07eb33a6e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.742286 Apr 09 21:19:01.935214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2705/5370] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:19:01 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 09 21:19:01.943321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:01.944503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:01.958493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.959592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:01.961270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.961972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:01.963601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:01.964635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 4442daeb-b015-4ffb-8dd5-da2b31c20361] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:01.980749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.981413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:01.983469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:01.984475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:02.031392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] HTTP exception thrown: Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 could not be found. Apr 09 21:19:02.032004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Returning 404 to user: Instance 4442daeb-b015-4ffb-8dd5-da2b31c20361 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:19:02.032852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8b338cc4-7e3e-46e9-a587-e79d897dd1ef tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361" status: 404 len: 111 microversion: 2.1 time: 0.082482 Apr 09 21:19:02.041288 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2706/5371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:01 2022] GET /compute/v2.1/servers/4442daeb-b015-4ffb-8dd5-da2b31c20361 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:19:02.729834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:02.743776 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3315c39d-e121-438d-bb0b-19c0c18c4174 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.804619 Apr 09 21:19:02.745347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2666/5372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:01 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:03.761121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:03.762292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:03.769562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:03.780191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:03.781301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:03.781894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:04.718706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ef786c7f-54b5-4867-93d7-3c521c7025a7 req-f2735655-2511-4baf-9324-fad8869a6f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:04.737842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ef786c7f-54b5-4867-93d7-3c521c7025a7 req-f2735655-2511-4baf-9324-fad8869a6f69 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:04.739398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ef786c7f-54b5-4867-93d7-3c521c7025a7 req-f2735655-2511-4baf-9324-fad8869a6f69 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:04.754190 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ef786c7f-54b5-4867-93d7-3c521c7025a7 req-f2735655-2511-4baf-9324-fad8869a6f69 service nova] Creating event network-vif-unplugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:19:04.761579 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ef786c7f-54b5-4867-93d7-3c521c7025a7 req-f2735655-2511-4baf-9324-fad8869a6f69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051296 Apr 09 21:19:04.763780 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2667/5373] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:05.422643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:05.432611 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-70e4748c-3391-4de9-b0a5-7bc77514ab19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1687 microversion: 2.1 time: 1.675324 Apr 09 21:19:05.444973 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2707/5374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:03 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1687 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:06.479085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:06.480446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:06.498812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:06.499508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:06.500729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:06.502710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:07.040171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:07.052866 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9a6fd006-2745-4710-8f0e-2728d820166e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.593383 Apr 09 21:19:07.058267 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2668/5375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:06 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:08.077052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:08.078223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:08.092137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:08.092860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:08.094544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:08.096402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:08.925594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:08.934304 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5fe0c81-9b18-48d1-9e13-8c71df34b852 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.861977 Apr 09 21:19:08.945445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2708/5376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:08 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:09.380582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e8ae244f-dd84-48d2-81a4-373668faedc6 req-bd2bcc37-390f-4156-a2fb-a83dc40ca17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-plugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:09.398663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8ae244f-dd84-48d2-81a4-373668faedc6 req-bd2bcc37-390f-4156-a2fb-a83dc40ca17c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:09.399360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8ae244f-dd84-48d2-81a4-373668faedc6 req-bd2bcc37-390f-4156-a2fb-a83dc40ca17c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:09.429480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e8ae244f-dd84-48d2-81a4-373668faedc6 req-bd2bcc37-390f-4156-a2fb-a83dc40ca17c service nova] Creating event network-vif-plugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:19:09.473542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e8ae244f-dd84-48d2-81a4-373668faedc6 req-bd2bcc37-390f-4156-a2fb-a83dc40ca17c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096755 Apr 09 21:19:09.480453 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2669/5377] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:09.951843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:09.952470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:09.964918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:09.965391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:09.966207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:09.966647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:11.356242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:11.365721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60888d8a-e1a8-4f41-9a9e-9c698a39e0eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 1.418028 Apr 09 21:19:11.385568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2709/5378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:09 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:12.403402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:12.404097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:12.429799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:12.430157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:12.430949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:12.431382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:12.560587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0d31a67b-8d76-43a2-88d2-7e2bc91100cf tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-989041762", "availability_zone": "foo_zone"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:12.562135 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:12.562135 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:12.563066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.aggregate [None req-0d31a67b-8d76-43a2-88d2-7e2bc91100cf tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Generated uuid 74812eb0-b7f8-4e18-9981-60a8852b8376 for aggregate {{(pid=141819) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 09 21:19:12.642170 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0d31a67b-8d76-43a2-88d2-7e2bc91100cf tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.780416 Apr 09 21:19:12.643085 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2670/5379] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Apr 9 21:19:11 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:12.654057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5fe52f18-6d24-4581-995c-f2595b5a55c0 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:12.655338 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:12.655338 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:12.717681 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5fe52f18-6d24-4581-995c-f2595b5a55c0 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.067741 Apr 09 21:19:12.719651 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2671/5380] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 21:19:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:12.728700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:12.730550 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:12.730550 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:12.732265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:12.732265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:12.733544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:12.733544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:12.794741 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94ba9d25-274d-4628-899b-6f4e503718e2 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069557 Apr 09 21:19:12.795742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2672/5381] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Apr 9 21:19:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:12.806189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8602b557-e69c-49b1-86fe-fd4545d6497b tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:12.806879 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:12.806879 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:12.827344 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8602b557-e69c-49b1-86fe-fd4545d6497b tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.024791 Apr 09 21:19:12.833318 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2673/5382] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Apr 9 21:19:12 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:12.838476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-227b824e-76f5-4346-8f65-22839523fba4 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:12.847133 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:12.847133 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:12.864171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-227b824e-76f5-4346-8f65-22839523fba4 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:12.865562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-227b824e-76f5-4346-8f65-22839523fba4 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:13.115440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:13.126362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-691b7faf-2c6f-4f8a-a6dd-b34d968f60c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.727899 Apr 09 21:19:13.141871 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2710/5383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:12 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:13.778570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-227b824e-76f5-4346-8f65-22839523fba4 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.943782 Apr 09 21:19:13.782726 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2674/5384] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 21:19:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:13.793470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-44f45bec-fe38-45b2-8264-048a137410ad tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:13.795568 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:13.795568 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:19:13.816210 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-44f45bec-fe38-45b2-8264-048a137410ad tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.026328 Apr 09 21:19:13.823125 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2711/5385] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:19:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:13.833291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7388c959-4aa3-4183-8489-f0a872a0f04a tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-743384642", "availability_zone": "foo_zone"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:13.835259 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:13.835259 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:13.956349 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7388c959-4aa3-4183-8489-f0a872a0f04a tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.126777 Apr 09 21:19:13.966359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2675/5386] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Apr 9 21:19:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:13.968366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-153f2249-3105-45a7-8c60-540763bf1fb0 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:13.969865 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:13.969865 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:19:14.051789 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-153f2249-3105-45a7-8c60-540763bf1fb0 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.088102 Apr 09 21:19:14.055659 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2712/5387] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 21:19:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:14.067051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6f223b6-86d3-4e7a-8907-23160f5eb783 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:14.068218 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:14.068218 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:14.084461 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6f223b6-86d3-4e7a-8907-23160f5eb783 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.021079 Apr 09 21:19:14.087065 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2676/5388] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Apr 9 21:19:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:14.098173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66d01a96-c064-4950-8ea1-487afd307738 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:14.099636 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:14.099636 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:19:14.120358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d01a96-c064-4950-8ea1-487afd307738 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:14.124610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66d01a96-c064-4950-8ea1-487afd307738 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:14.155148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:14.156398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:14.167429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:14.168158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:14.171444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:14.172183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:14.844718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:14.856301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66d01a96-c064-4950-8ea1-487afd307738 tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.762546 Apr 09 21:19:14.860942 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-74dd128b-e918-48ac-82e1-8023d73bc7e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1686 microversion: 2.1 time: 0.710606 Apr 09 21:19:14.869120 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2713/5389] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Apr 9 21:19:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:14.869912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2677/5390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:14 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1686 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:14.881166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e4c3d51-b36c-4a74-a583-d0066ba8a95a tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:14.888249 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:14.888249 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:19:14.970476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e4c3d51-b36c-4a74-a583-d0066ba8a95a tempest-TestAggregatesBasicOps-907616581 tempest-TestAggregatesBasicOps-907616581-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.094779 Apr 09 21:19:14.972111 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2714/5391] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Apr 9 21:19:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 09 21:19:15.885540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:15.886422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:15.912985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:15.913394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:15.919811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:15.923964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:17.922388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:17.940311 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06dc6c58-d9ff-44b2-ab79-678d6fb02875 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 2.060191 Apr 09 21:19:17.963264 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2678/5392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:15 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:18.960142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:18.960721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:18.983424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:18.983900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:18.984722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:18.994070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:19.641225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:19.653471 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4fa80371-65cf-404e-a661-dc197bb88129 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.697286 Apr 09 21:19:19.656969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2715/5393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:18 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:19.832364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-63972ce2-ed8a-4975-b15b-8ba4f1479f7a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '.version_select at 0x7fb08e24a940>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:19.898798 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-63972ce2-ed8a-4975-b15b-8ba4f1479f7a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1525650353" status: 202 len: 0 microversion: 2.1 time: 0.070594 Apr 09 21:19:19.903008 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2679/5394] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1525650353 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:19:19.938876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: .version_select at 0x7fb08db43700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1956582168"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:19.974950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:19:20.002617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:19:20.324572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:19:20.337397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:19:20.376271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d600c808-7676-4b22-a35d-85818a2d4f46 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.441617 Apr 09 21:19:20.381081 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2716/5395] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:19:19 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:20.674174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:20.674910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:20.691321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:20.692993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:20.697329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:20.697809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:22.719433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:22.767021 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e74c6c7c-3a6e-4439-bcef-42f7f948ac24 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 2.097397 Apr 09 21:19:22.785057 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2680/5396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:20 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:23.790127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:23.790867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:23.813223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:23.816992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:23.821206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:23.821664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:24.708899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:24.720039 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ddadde9-db48-480d-91ed-09d5c07f8b0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.935199 Apr 09 21:19:24.726654 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2717/5397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:23 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:25.739228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:25.740957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:25.755194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:25.760245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:25.763679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:25.766526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:26.518666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:26.526804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d68a3ff9-33d7-4624-b1fb-82f0946d85b5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.792325 Apr 09 21:19:26.534925 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2681/5398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:25 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:27.553153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:27.555272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:27.568679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:27.571765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:27.573128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:27.574973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:28.245505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:28.260249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a60218b5-40f5-4993-9449-e3f920a955da tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.708421 Apr 09 21:19:28.265153 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2718/5399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:27 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:29.091969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Calling method '.version_select at 0x7fb08e2715e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:29.093574 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:19:29.093574 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:19:29.095332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:29.097817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:29.140958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:29.141994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:29.155321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:29.156175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:29.164967 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dce426f4-071e-4e36-b7e9-4c55ee40da36 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1675822214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.453734 Apr 09 21:19:29.166367 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2682/5400] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:19:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:29.279376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:29.280825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:29.310752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:29.314362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:29.317786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:29.320245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:30.080498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:30.088524 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-43e79fd5-9270-4441-aafa-fb2914a50914 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.814422 Apr 09 21:19:30.094552 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2719/5401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:29 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:31.112300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:31.112930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:31.127500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:31.127969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:31.128783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:31.129289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:31.952362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:31.966511 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd0c911e-084b-4b60-b93c-4665f4b9320b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 0.858202 Apr 09 21:19:31.968945 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2683/5402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:31 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:32.987984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:32.989777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:33.003715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:33.006316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:33.007534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:33.008139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:34.020920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:34.036484 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3176dbc6-0590-40b9-a841-501bad248dd7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1682 microversion: 2.1 time: 1.051112 Apr 09 21:19:34.040788 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2720/5403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:32 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1682 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:35.055299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:35.056793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:35.070019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:35.071816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:35.074036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:35.077726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:35.669656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:35.684198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2830326c-e850-44ed-a742-53e4a3292ac4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.633171 Apr 09 21:19:35.687548 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2684/5404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:35 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:35.808479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:35.809936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:35.829095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:35.830261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:35.834812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:35.835478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:37.287965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:37.299472 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0533b0e2-8c14-4cf7-8a08-340526412ebd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 1.495281 Apr 09 21:19:37.300083 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2721/5405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:35 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:39.311403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:39.315702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:39.332609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:39.339811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:39.341963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:39.345353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:39.764924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:39.774262 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-04ac830c-fd4c-40c1-8cf2-3a31d45076b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.471215 Apr 09 21:19:39.774361 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2685/5406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:39.803202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:39.804104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:39.820247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:39.822275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:39.823222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:39.823777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:39.983381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a6b894bb-3088-49d0-b350-e93ddffdc488 req-5d97b4f8-d7bd-47dd-b7df-20eb4fa004a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:40.003101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a6b894bb-3088-49d0-b350-e93ddffdc488 req-5d97b4f8-d7bd-47dd-b7df-20eb4fa004a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:40.012392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a6b894bb-3088-49d0-b350-e93ddffdc488 req-5d97b4f8-d7bd-47dd-b7df-20eb4fa004a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:40.038275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a6b894bb-3088-49d0-b350-e93ddffdc488 req-5d97b4f8-d7bd-47dd-b7df-20eb4fa004a9 service nova] Creating event network-vif-unplugged:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:19:40.064006 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a6b894bb-3088-49d0-b350-e93ddffdc488 req-5d97b4f8-d7bd-47dd-b7df-20eb4fa004a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084644 Apr 09 21:19:40.065912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2686/5407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:19:40.729105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:40.744251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ffbe3e9-2585-430e-bf9d-22419c0319eb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.955091 Apr 09 21:19:40.745112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2722/5408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:40.762271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:40.763597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:40.770141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:40.770832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:40.771782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:40.772368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:41.479137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:41.487421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35608b22-9a7a-4078-9016-3baa8a26e311 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.730331 Apr 09 21:19:41.504214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:41.505226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:41.510240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2687/5409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:41.513322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:41.513949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:41.515118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:41.515589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:41.620290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-91754ab0-27a9-4fd4-8a91-aac28a2af3bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.120014 Apr 09 21:19:41.626597 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2723/5410] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:19:41 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:19:41.642654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:41.644611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:41.669690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:41.686436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:41.688257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:41.693976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:42.786856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:42.813708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7accae1f-a15c-4f3b-816f-e58728f6fd2d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1671 microversion: 2.1 time: 1.175251 Apr 09 21:19:42.817178 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2688/5411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:41 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1671 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:43.718896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-929326752", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "34592f59-2890-4469-bed7-9956df7ee951"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1956582168", "security_groups": [{"name": "tempest-secgroup-smoke-146611863"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:43.834516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:43.835725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:43.850359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:43.852943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:43.853949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:43.854957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:44.318611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:44.329922 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-035b67bd-0426-4ce6-89cf-ede0c5e3ac54 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1671 microversion: 2.1 time: 0.499483 Apr 09 21:19:44.344490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2689/5412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:43 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1671 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:44.600200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] validate_networks() for [('34592f59-2890-4469-bed7-9956df7ee951', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:19:45.351954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:45.353428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:45.363625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:45.364533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:45.367740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:45.368479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:46.645655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:46.661982 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-32238302-476b-4324-bfd4-15089f57fc39 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1671 microversion: 2.1 time: 1.316629 Apr 09 21:19:46.665917 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2690/5413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:45 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1671 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:47.328135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:19:47.329484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:19:47.332716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:19:47.333540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:19:47.334201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:19:47.363732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:47.364485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:47.365528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:47.366276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:47.388084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:19:47.395764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:19:47.419881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:19:47.423048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:19:47.487573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f284816a-e590-42f9-b795-ab44c319a3eb tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.774021 Apr 09 21:19:47.488615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2724/5414] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:19:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 3776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:19:47.500096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a8908f13-000a-4b93-8aca-678403214451 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:47.500714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a8908f13-000a-4b93-8aca-678403214451 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:47.637420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a8908f13-000a-4b93-8aca-678403214451 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:47.645363 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a8908f13-000a-4b93-8aca-678403214451 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1266 microversion: 2.1 time: 0.150657 Apr 09 21:19:47.658260 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2691/5415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:47 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:47.680179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:47.680794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:47.692891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:47.693650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:47.694855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:47.695948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.197989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:48.207718 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-933f408d-e2e5-42d1-a18a-5952b44b3ec4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.531410 Apr 09 21:19:48.211862 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2725/5416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:47 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:48.227407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:48.228880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:48.243794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.244541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.245667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.248203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.325159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b3a96d2-9ae3-4aec-a966-70c83c4a0cad tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 200 len: 322 microversion: 2.1 time: 0.101884 Apr 09 21:19:48.331805 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2692/5417] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:19:48 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:48.338945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:48.339512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:48.354713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.355181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.355994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.360498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.664195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:48.665759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:48.682808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.685760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.686836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.690724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.757555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:48.774020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db835a4c-783d-439d-afdb-a00315b43a85 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.440837 Apr 09 21:19:48.775949 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2726/5418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:48 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:48.794235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:48.795380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:48.811120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.811991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:48.814395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:48.816133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:49.037611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:49.046598 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a3ed4bb-e46b-4f67-8948-8e42556bb4a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1318 microversion: 2.1 time: 0.387640 Apr 09 21:19:49.058443 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2693/5419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:48 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:49.251617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:49.262256 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a1eedc6-3e2c-4add-b6f1-17a9e9256a0f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.474247 Apr 09 21:19:49.271842 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2727/5420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:48 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:49.279519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:49.280132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:49.287887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:49.288340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:49.302704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:49.308948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:49.668774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:49.691567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c4d9fb6-7d77-4cd7-8f53-9973208de55c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.415858 Apr 09 21:19:49.693506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2694/5421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:49 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:49.708409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:49.709013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:49.721074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:49.722603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:49.723696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:49.724978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:50.064874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:50.065903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:50.081630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:50.083405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:50.084810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:50.086107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:50.527635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:50.549118 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ac4101d-d0c2-4db9-a73e-17b13964282e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.844448 Apr 09 21:19:50.591216 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2728/5422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:49 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:50.659962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:50.672647 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a0b61c04-d280-4b9e-952c-60a7238941fa tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1324 microversion: 2.1 time: 0.610913 Apr 09 21:19:50.672647 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2695/5423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:50 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:50.798874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1677233940", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "fe7136e7-da4e-4ad5-bb48-0519f1b05f75"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:50.893744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] validate_networks() for [('fe7136e7-da4e-4ad5-bb48-0519f1b05f75', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:19:51.692740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:51.694772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:51.704141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:51.705505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:51.706644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:51.707985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:52.668706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:52.688823 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-347bf9e2-2eb2-4c0d-88a1-af2fd5f03199 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.999810 Apr 09 21:19:52.691144 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2696/5424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:51 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:53.274340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:19:53.275755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:19:53.277507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:19:53.278337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:19:53.279194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:19:53.295964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:53.296720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:53.300552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:53.301394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:53.330311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:19:53.338394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:19:53.362404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:19:53.368259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:19:53.482503 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76e649b9-eddf-40a5-8e60-4260ae62d102 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688655 Apr 09 21:19:53.488284 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2729/5425] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:19:53.494768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57a2dbd3-1445-4847-b119-83c17a217f30 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:53.495394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57a2dbd3-1445-4847-b119-83c17a217f30 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:53.702087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57a2dbd3-1445-4847-b119-83c17a217f30 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:53.707442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:53.708065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:53.717687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:53.718153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:53.718958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:53.719400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:53.722202 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57a2dbd3-1445-4847-b119-83c17a217f30 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1215 microversion: 2.1 time: 0.230690 Apr 09 21:19:53.728354 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2697/5426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:53 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:54.503267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:54.512621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d77da1a-aa60-471a-a13a-d1968246db34 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.809120 Apr 09 21:19:54.522482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2730/5427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:53 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:19:54.748448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:54.749874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:54.764528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:54.769076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:54.770918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:54.771530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:55.037018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:55.053510 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bfa73d4f-9958-4fe1-82db-15a0b9bc3480 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1267 microversion: 2.1 time: 0.313569 Apr 09 21:19:55.060722 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2698/5428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:54 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:55.464655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-310d02f2-753f-4960-b9ad-ca13314afafe req-ed11a7f7-9cb9-4f17-a9d5-0985ea400781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:19:55.485764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-310d02f2-753f-4960-b9ad-ca13314afafe req-ed11a7f7-9cb9-4f17-a9d5-0985ea400781 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:55.486275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-310d02f2-753f-4960-b9ad-ca13314afafe req-ed11a7f7-9cb9-4f17-a9d5-0985ea400781 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:55.521199 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-310d02f2-753f-4960-b9ad-ca13314afafe req-ed11a7f7-9cb9-4f17-a9d5-0985ea400781 service nova] Creating event network-changed:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:19:55.539940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:55.540576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:55.544988 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-310d02f2-753f-4960-b9ad-ca13314afafe req-ed11a7f7-9cb9-4f17-a9d5-0985ea400781 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085211 Apr 09 21:19:55.549235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:55.549695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:55.550498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:55.550945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:55.554808 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2731/5429] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:19:56.088480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:56.090560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:56.118117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:56.118851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:56.119775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:56.120095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:56.409674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:56.417726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22ea232d-ad71-437d-949f-4b571e17d4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1273 microversion: 2.1 time: 0.343546 Apr 09 21:19:56.418319 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2732/5430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:56 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:56.884779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:56.902711 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3268f199-bd5d-4a1c-a9c2-609ecd4926fc tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 1.367169 Apr 09 21:19:56.904652 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2699/5431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:55 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:57.435258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:57.436651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:57.444541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:57.445180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:57.446543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:57.447424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:57.739160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:57.760150 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3efca795-1a0e-47d5-b6ce-e847ebd1cce3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1273 microversion: 2.1 time: 0.327149 Apr 09 21:19:57.762635 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2733/5432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:57 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:57.920044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:57.921338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:57.935740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:57.947607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:57.952081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:57.952694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:58.486798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:58.495501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3218fbdc-3396-42fb-a2f1-0d7dc812da61 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.579452 Apr 09 21:19:58.505686 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2700/5433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:57 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:19:58.776249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:58.776871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:58.784166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:58.784918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:58.785961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:58.787287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:59.522303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:19:59.528289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:19:59.550585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:59.551309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:59.552861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:19:59.553519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:19:59.727342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:19:59.736733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e91e484-f46b-4660-8191-67b7b7fa7ba7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.964276 Apr 09 21:19:59.743332 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2734/5434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:58 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:00.547148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:00.557170 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-906dfe7b-dd1a-4a18-ab50-0d798a52e408 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 1.038606 Apr 09 21:20:00.563598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2701/5435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:19:59 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:00.760038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:00.761737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:00.775053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:00.776827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:00.777921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:00.781864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:01.352773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ecf80501-12d2-4354-85e4-54a67291c145 req-486e327c-ed2b-4f50-8b3e-f0028ef33563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d3d125-8793-4775-bc5a-4b81540bfadf", "tag": "835fc95d-b81f-432d-935d-e56a67be480d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:01.363593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ecf80501-12d2-4354-85e4-54a67291c145 req-486e327c-ed2b-4f50-8b3e-f0028ef33563 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:01.364042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ecf80501-12d2-4354-85e4-54a67291c145 req-486e327c-ed2b-4f50-8b3e-f0028ef33563 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:01.399643 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ecf80501-12d2-4354-85e4-54a67291c145 req-486e327c-ed2b-4f50-8b3e-f0028ef33563 service nova] Creating event network-changed:835fc95d-b81f-432d-935d-e56a67be480d for instance 17d3d125-8793-4775-bc5a-4b81540bfadf on nch1-master-1 Apr 09 21:20:01.404765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ecf80501-12d2-4354-85e4-54a67291c145 req-486e327c-ed2b-4f50-8b3e-f0028ef33563 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058521 Apr 09 21:20:01.407061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2702/5436] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:20:01.582439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:01.585636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:01.617086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:01.617799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:01.619757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:01.620966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:01.864109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:01.872886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81cbd4c6-3191-4d0d-a841-8bbe2166aaac tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 1.117165 Apr 09 21:20:01.873746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2735/5437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:00 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:02.427520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:02.491449 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a05ebbb2-0754-48f6-a885-c28a84ed402b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.918058 Apr 09 21:20:02.492988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2703/5438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:01 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:20:02.890127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:02.890743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:02.908305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:02.908758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:02.909584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:02.910014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:03.287676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:03.299685 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da41662f-b673-4b84-8f28-cbbd1cd0545b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.413324 Apr 09 21:20:03.300296 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2736/5439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:02 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:03.515974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:03.517212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:03.527148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:03.528294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:03.529283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:03.532973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:03.880990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:03.894696 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6e5bd65-afef-4f28-a5b4-36b0695c5b48 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.388656 Apr 09 21:20:03.896271 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2704/5440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:03 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:04.316393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:04.317934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:04.329104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:04.330048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:04.331342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:04.332080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:04.554645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fbcdb0d5-c902-4de7-a997-de965132361d req-d27930ee-4514-468c-9e88-75d422d643e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "name": "network-vif-plugged", "status": "completed", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:04.569520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fbcdb0d5-c902-4de7-a997-de965132361d req-d27930ee-4514-468c-9e88-75d422d643e7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:04.570500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fbcdb0d5-c902-4de7-a997-de965132361d req-d27930ee-4514-468c-9e88-75d422d643e7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:04.588112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fbcdb0d5-c902-4de7-a997-de965132361d req-d27930ee-4514-468c-9e88-75d422d643e7 service nova] Creating event network-vif-plugged:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:20:04.594109 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fbcdb0d5-c902-4de7-a997-de965132361d req-d27930ee-4514-468c-9e88-75d422d643e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043999 Apr 09 21:20:04.595478 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2705/5441] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:20:04.750018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:04.765872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93ee6cb8-c87a-4fe0-bd4e-55ca5e4caa33 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.453402 Apr 09 21:20:04.767029 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2737/5442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:04 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:04.913872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:04.914899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:04.946716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:04.949817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:04.950684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:04.951135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:05.726410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:05.737152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-830482d8-27c3-4841-955b-13ea34be3a15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1391 microversion: 2.1 time: 0.828027 Apr 09 21:20:05.742093 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2706/5443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:04 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1391 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:05.784343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:05.785367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:05.793941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:05.794585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:05.796703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:05.797614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:06.607529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:06.619496 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d0936fb-8fa1-43f8-84b0-bb03b2081357 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.837919 Apr 09 21:20:06.621869 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2738/5444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:05 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:06.754244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:06.754868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:06.761742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:06.762202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:06.762998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:06.763437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:07.177622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:07.195828 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc85e1c0-686c-4ad1-b429-4e05688db607 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1564 microversion: 2.1 time: 0.445452 Apr 09 21:20:07.206503 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2707/5445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:06 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1564 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:07.212468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:07.213096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:07.231853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:07.232580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:07.233476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:07.234132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:07.517587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:07.526249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f90ba9aa-ee45-4e33-aefd-eda55e2baa12 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1564 microversion: 2.1 time: 0.317845 Apr 09 21:20:07.530002 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2739/5446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:07 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1564 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:07.642061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:07.642663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:07.660353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:07.661130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:07.662163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:07.662650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:08.177791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:08.185833 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-35017907-f08f-4dfd-b62c-c2dd96564c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.548360 Apr 09 21:20:08.199109 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2708/5447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:07 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:09.207246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:09.208844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:09.217778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:09.218884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:09.219946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:09.220598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:09.958385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f759aa7b-40af-46a1-8af1-f63d66511722 req-f4c62666-9b1d-4492-85b4-e9620e77a43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d3d125-8793-4775-bc5a-4b81540bfadf", "name": "network-vif-plugged", "status": "completed", "tag": "835fc95d-b81f-432d-935d-e56a67be480d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:09.994806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f759aa7b-40af-46a1-8af1-f63d66511722 req-f4c62666-9b1d-4492-85b4-e9620e77a43b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:09.995508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f759aa7b-40af-46a1-8af1-f63d66511722 req-f4c62666-9b1d-4492-85b4-e9620e77a43b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:10.023504 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f759aa7b-40af-46a1-8af1-f63d66511722 req-f4c62666-9b1d-4492-85b4-e9620e77a43b service nova] Creating event network-vif-plugged:835fc95d-b81f-432d-935d-e56a67be480d for instance 17d3d125-8793-4775-bc5a-4b81540bfadf on nch1-master-1 Apr 09 21:20:10.029110 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f759aa7b-40af-46a1-8af1-f63d66511722 req-f4c62666-9b1d-4492-85b4-e9620e77a43b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074933 Apr 09 21:20:10.030343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2709/5448] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:20:10.232705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:10.250084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e5acd6ef-d8d7-40ea-b5a7-256a09c1fe4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 1.047145 Apr 09 21:20:10.250898 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2740/5449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:09 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:11.269556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:11.272533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:11.281434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:11.283395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:11.284467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:11.285209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:11.600177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:11.610153 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c24abeae-3f31-46b3-b01e-11f24d85de4c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1315 microversion: 2.1 time: 0.346867 Apr 09 21:20:11.620055 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2710/5450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:11 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:12.630046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:12.631476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:12.643007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:12.643785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:12.649976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:12.654022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.065022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:13.074248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6926bffc-5b1b-415b-8b08-059e9e919e4f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1502 microversion: 2.1 time: 0.449848 Apr 09 21:20:13.074831 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2741/5451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:12 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:13.092029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0976e50a-7b8c-483c-a3af-cb7fa87ea38c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:13.100458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0976e50a-7b8c-483c-a3af-cb7fa87ea38c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.100991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0976e50a-7b8c-483c-a3af-cb7fa87ea38c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.124705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0976e50a-7b8c-483c-a3af-cb7fa87ea38c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:20:13.178212 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0976e50a-7b8c-483c-a3af-cb7fa87ea38c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf/action" status: 202 len: 0 microversion: 2.1 time: 0.089807 Apr 09 21:20:13.179043 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2711/5452] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:13 2022] POST /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:20:13.193871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:13.194839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:13.203219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.204128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.205725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.206531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.463451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:13.464523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:13.472553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.473637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.474446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.475101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.484222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:13.494412 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88481d80-9e4a-4a4d-a19f-cac24fc8cab7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.308326 Apr 09 21:20:13.497758 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2742/5453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:13 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:13.509830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d94d1255-b489-4d44-afc7-8d6653e33dcb req-aa826d45-ac40-4ffa-be86-33d90bb88aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:13.518874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d94d1255-b489-4d44-afc7-8d6653e33dcb req-aa826d45-ac40-4ffa-be86-33d90bb88aa6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:13.519583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d94d1255-b489-4d44-afc7-8d6653e33dcb req-aa826d45-ac40-4ffa-be86-33d90bb88aa6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:13.531490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d94d1255-b489-4d44-afc7-8d6653e33dcb req-aa826d45-ac40-4ffa-be86-33d90bb88aa6 service nova] Creating event network-changed:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:20:13.537493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d94d1255-b489-4d44-afc7-8d6653e33dcb req-aa826d45-ac40-4ffa-be86-33d90bb88aa6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Apr 09 21:20:13.538748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2743/5454] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:20:13.988805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:14.005128 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8cdcdd05-f207-49ca-9ba8-03e1c3612658 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1564 microversion: 2.1 time: 0.545826 Apr 09 21:20:14.008695 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2712/5455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:13 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1564 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:14.513267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:14.514627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:14.524908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:14.537882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:14.539044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:14.539639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:14.912574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:14.926335 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ed427eb-4526-452e-b0e0-7df6885e7bc3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.418131 Apr 09 21:20:14.927565 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2744/5456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:14 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:15.949930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:15.951600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:15.960771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:15.961723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:15.963401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:15.964081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:16.214874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:16.237419 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21218e7e-8840-4aa3-a8ab-ce17003a3aa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.294210 Apr 09 21:20:16.239199 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2713/5457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:15 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:17.257518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:17.260194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:17.285016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:17.285858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:17.286895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:17.288423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:17.682991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:17.696780 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfab69f9-b3c0-42c7-b5ea-78dd47907d2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.444851 Apr 09 21:20:17.697422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2745/5458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:17 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:18.714372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:18.714958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:18.725943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:18.727212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:18.728669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:18.729416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:19.189820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:19.205104 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d707a8d3-141b-4b95-b338-10c7ab8d6d3d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.494617 Apr 09 21:20:19.206190 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2714/5459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:18 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:20.225018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:20.227246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:20.245547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:20.248140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:20.249637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:20.250450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:20.572514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:20.580974 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cad416d0-7fd4-48b1-a895-57de3c09a8d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.362397 Apr 09 21:20:20.596113 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2746/5460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:20 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:21.606185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:21.606979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:21.622032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:21.623100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:21.624595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:21.626262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:22.060310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:22.068746 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12572652-f018-4c04-b88d-dd324b7cbc50 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.467814 Apr 09 21:20:22.072676 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2715/5461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:21 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:23.090030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:23.090648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:23.104953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:23.108400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:23.109784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:23.110386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:23.952617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:23.962537 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-afe17262-3b85-4bb1-9725-b298456f0106 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.877523 Apr 09 21:20:23.963342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2747/5462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:23 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:24.980400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:24.981063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:24.997235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:24.998021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:25.000532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:25.002643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:25.587680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:25.599720 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-217584e9-bdbe-403e-8fb3-a1d8a8f09b95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.623290 Apr 09 21:20:25.601316 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2716/5463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:24 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:26.621287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:26.621287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:26.655724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:26.656370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:26.657206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:26.657647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:26.995263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:27.006719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3cc6782c-79fe-4eb2-aaf8-582014ecc0be tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.393663 Apr 09 21:20:27.007909 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2748/5464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:26 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:28.024910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:28.027092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:28.039189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:28.040080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:28.041649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:28.042313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:28.494351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:28.517484 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a06fa803-1396-4a6a-9d89-f76612f14cbc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.497278 Apr 09 21:20:28.521237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2717/5465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:28 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:29.536600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:29.537819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:29.545543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:29.546159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:29.547122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:29.547812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:29.841456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:29.858884 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb3e5185-fb93-4ff0-ad5c-81b60b4296c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.326324 Apr 09 21:20:29.869646 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2749/5466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:29 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:30.876229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:30.877345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:30.893011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:30.894210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:30.895125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:30.895649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:31.255332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:31.271411 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4d4fd8a3-2ade-4d47-b249-2f90b6dfdeae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.398678 Apr 09 21:20:31.272285 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2718/5467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:30 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:20:32.291397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:32.293785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:32.306843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:32.316225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:32.318575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:32.319756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:32.678558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:32.690186 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-079c3767-fa54-4493-a42e-01ad69b9a279 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.403924 Apr 09 21:20:32.690552 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2750/5468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:32 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:33.713937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:33.715247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:33.724254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:33.724925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:33.726068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:33.726721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:34.091141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:34.099903 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b321f460-0157-45a8-a785-acb99a01f650 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.395617 Apr 09 21:20:34.110447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2719/5469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:33 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:35.119109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:35.119869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:35.126142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:35.126648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:35.127674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:35.128125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:35.415128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:35.423596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e8dc2d80-84e8-4ae7-a38a-7513052debca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.309644 Apr 09 21:20:35.424776 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2751/5470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:35 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:36.441505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:36.442190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:36.459693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:36.460167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:36.461283 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:36.461720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:36.723102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:36.733619 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5966dd5-1428-45b0-86fe-6c1aac4de1f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.296682 Apr 09 21:20:36.735361 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2720/5471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:36 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:37.755831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:37.756419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:37.764542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:37.765019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:37.766074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:37.766630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:37.983353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:37.992410 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9dfc6f63-5fa2-400f-8b36-5e33533cdb57 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1512 microversion: 2.1 time: 0.240596 Apr 09 21:20:38.004224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2752/5472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:37 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:39.011114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:39.011762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:39.023859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.024426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.025286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.025742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.316912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:39.330400 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-729c2a8a-59c1-46e3-bfd4-82179f7e50bd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1489 microversion: 2.1 time: 0.323351 Apr 09 21:20:39.331483 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2721/5473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:39 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1489 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:39.348251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:39.350149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:39.357666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.358396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.360292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.360921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.432589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-264a78a4-252d-4b04-b9c2-07ae3bb0ea6a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 200 len: 154 microversion: 2.1 time: 0.087415 Apr 09 21:20:39.442504 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2753/5474] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:39 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 154 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:20:39.455802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:39.456555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:39.467943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.472302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.476690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.480446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.792381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:39.807476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3941496-0071-42de-8765-30b120747b13 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.363324 Apr 09 21:20:39.808585 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2722/5475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:20:39.837353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:39.838460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:39.846008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.846793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:39.847902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:39.848553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:40.046281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:40.056049 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df8244b6-ba01-4c24-a181-6f0ec88959f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.222991 Apr 09 21:20:40.067146 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2754/5476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:40.072379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:40.073604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:40.080829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:40.081314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:40.082101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:40.082710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:40.286572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:40.295145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ddf78bf-98e5-4638-8260-164f1a4401f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.226447 Apr 09 21:20:40.295757 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2723/5477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:40.313302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:40.315245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:40.323631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:40.324290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:40.325543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:40.326854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:40.643251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:40.652387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-47f95f26-1584-4a47-9da2-7793908c597f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.343067 Apr 09 21:20:40.653102 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2755/5478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:40.800143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-573696821", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "fe7136e7-da4e-4ad5-bb48-0519f1b05f75"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:40.877562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] validate_networks() for [('fe7136e7-da4e-4ad5-bb48-0519f1b05f75', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:20:42.257945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:20:42.259441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:20:42.260089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:20:42.260664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:20:42.261684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:20:42.277328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:42.278055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:42.279330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:42.279933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:42.301565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:20:42.307629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:20:42.326005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:20:42.328659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:20:42.399476 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a40bb4a3-9c48-43e5-947f-a6d3e0e88bde tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605334 Apr 09 21:20:42.400824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2724/5479] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:20:42.417841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6c8e178-7606-4f7b-8ae6-cb7099a1d5a2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:42.418470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6c8e178-7606-4f7b-8ae6-cb7099a1d5a2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:42.647425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6c8e178-7606-4f7b-8ae6-cb7099a1d5a2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:42.655737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6c8e178-7606-4f7b-8ae6-cb7099a1d5a2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1214 microversion: 2.1 time: 0.241763 Apr 09 21:20:42.661960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2756/5480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:42 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:42.706829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:42.707841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:42.725232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:42.725683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:42.726689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:42.727291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:42.817672 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1917dc21-c86c-4c03-a965-38cfb48244f5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action" status: 200 len: 24572 microversion: 2.1 time: 0.115701 Apr 09 21:20:42.819295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2725/5481] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:42 2022] POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action => generated 24572 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:20:43.672458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:43.673391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:43.702024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:43.702546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:43.703335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:43.703766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:43.872156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:43.887448 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1900802b-7df4-468d-ad3e-663934ea3972 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1266 microversion: 2.1 time: 0.214997 Apr 09 21:20:43.897133 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2757/5482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:43 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:44.912738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:44.914086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:44.925455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:44.927515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:44.928573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:44.931144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:45.060490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:45.071274 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21ee4872-ff9b-4891-afe2-5b80325b5037 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1272 microversion: 2.1 time: 0.165349 Apr 09 21:20:45.083449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2726/5483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:44 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:46.093799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:46.096162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:46.118918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:46.124218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:46.126617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:46.129445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:46.385290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:46.395061 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0713b06c-66c4-4007-8fbe-d205d363948c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.306779 Apr 09 21:20:46.398484 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2758/5484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:46 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:47.415201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:47.416379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:47.426748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:47.427399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:47.428366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:47.432267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:47.716336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:47.724814 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-303eb531-33d3-44d9-b778-4831001f64c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.313709 Apr 09 21:20:47.725439 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2727/5485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:47 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:48.137553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-08d04da2-8825-4dcd-99b8-608a9f35f308 req-bd47c1fb-161f-4d48-910f-001de8a1f92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308e8aed-6ba1-430a-9dd6-df71cb7944dc", "tag": "5d28bac7-8d0f-4df8-9193-73d2a35e3756"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:48.155637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-08d04da2-8825-4dcd-99b8-608a9f35f308 req-bd47c1fb-161f-4d48-910f-001de8a1f92a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:48.156249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-08d04da2-8825-4dcd-99b8-608a9f35f308 req-bd47c1fb-161f-4d48-910f-001de8a1f92a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:48.171060 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-08d04da2-8825-4dcd-99b8-608a9f35f308 req-bd47c1fb-161f-4d48-910f-001de8a1f92a service nova] Creating event network-changed:5d28bac7-8d0f-4df8-9193-73d2a35e3756 for instance 308e8aed-6ba1-430a-9dd6-df71cb7944dc on nch2-master-1 Apr 09 21:20:48.177524 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-08d04da2-8825-4dcd-99b8-608a9f35f308 req-bd47c1fb-161f-4d48-910f-001de8a1f92a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043581 Apr 09 21:20:48.179016 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2759/5486] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:20:48.742507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:48.743715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:48.752922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:48.753502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:48.754522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:48.755322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:48.940951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:48.964379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b081269-0b48-445a-bb54-647d3445167a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.225760 Apr 09 21:20:48.976692 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2728/5487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:48 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:49.982970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:49.983658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:49.990747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:49.991217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:49.992947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:49.992947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:50.351896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:50.360946 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fc0d7a0-dc6f-4305-bbf4-701734c25978 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.383063 Apr 09 21:20:50.362036 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2760/5488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:49 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:51.378033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:51.379640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:51.387529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:51.388249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:51.389268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:51.389982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:51.630688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:51.641641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0531aace-1750-4eec-a32b-164f04b43621 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.267467 Apr 09 21:20:51.642269 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2729/5489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:51 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:20:52.660792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:52.662095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:52.673354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:52.675788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:52.676622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:52.677089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:53.111226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:53.118870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e79cc916-cd06-4a06-8f84-f180a3514f2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.463443 Apr 09 21:20:53.119739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2761/5490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:52 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:54.140036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:54.140867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:54.156143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:54.156577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:54.161778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:54.162833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:54.679556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:54.688875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3049919b-b2c2-43ff-83d5-9b0200fccc06 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.556336 Apr 09 21:20:54.692085 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2730/5491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:54 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:55.158018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-29503a44-9836-4850-8190-f61c6fb6aeb9 req-9f4fb285-e256-4a56-89b8-63e6b2298f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308e8aed-6ba1-430a-9dd6-df71cb7944dc", "name": "network-vif-plugged", "status": "completed", "tag": "5d28bac7-8d0f-4df8-9193-73d2a35e3756"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:55.193612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-29503a44-9836-4850-8190-f61c6fb6aeb9 req-9f4fb285-e256-4a56-89b8-63e6b2298f95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:55.194458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-29503a44-9836-4850-8190-f61c6fb6aeb9 req-9f4fb285-e256-4a56-89b8-63e6b2298f95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:55.209005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-29503a44-9836-4850-8190-f61c6fb6aeb9 req-9f4fb285-e256-4a56-89b8-63e6b2298f95 service nova] Creating event network-vif-plugged:5d28bac7-8d0f-4df8-9193-73d2a35e3756 for instance 308e8aed-6ba1-430a-9dd6-df71cb7944dc on nch2-master-1 Apr 09 21:20:55.216572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-29503a44-9836-4850-8190-f61c6fb6aeb9 req-9f4fb285-e256-4a56-89b8-63e6b2298f95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345392 Apr 09 21:20:55.217807 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2762/5492] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:20:55.712144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:55.713011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:55.724086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:55.724831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:55.726025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:55.731745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:56.000050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:56.010807 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8b53635-5f95-4c43-9f24-93f98d33353e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1314 microversion: 2.1 time: 0.305889 Apr 09 21:20:56.013468 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2731/5493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:55 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:57.031137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:20:57.031757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:57.061365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:57.061807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:57.062946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:57.063715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:57.377625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:20:57.388557 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-017bff1e-fb6c-46fa-b7c9-252ed1023dd1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1501 microversion: 2.1 time: 0.362310 Apr 09 21:20:57.390309 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2763/5494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:20:57 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:20:57.409315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:57.410360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:57.416804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:57.417285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:57.418205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:57.418643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:57.479981 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-55349914-f61b-4400-ab08-1f5b3bda2153 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.076868 Apr 09 21:20:57.482661 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2732/5495] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:57 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:20:58.493961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:58.495126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:58.508271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:58.508727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:58.510190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:58.510631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:58.553117 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66394bc8-8218-4235-910a-b1f7b9e8c7c9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.062288 Apr 09 21:20:58.554257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2764/5496] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:58 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:20:59.564854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:20:59.566331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:20:59.578371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:59.586244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:59.587217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:20:59.587720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:20:59.661638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64daac0c-aed1-4a48-a30a-5bec3a24d4f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.100932 Apr 09 21:20:59.662917 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2733/5497] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:20:59 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:00.673621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:00.674646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:00.691678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:00.692139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:00.692937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:00.693402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:00.760361 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c358c2f3-fb08-4d1f-8eb3-666c42803c9c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.090802 Apr 09 21:21:00.765369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2765/5498] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:00 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:01.776448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:01.778391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:01.788332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:01.789273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:01.790393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:01.791052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:01.841531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea14bd2f-fa99-4124-a088-178e853e9b7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.070879 Apr 09 21:21:01.844740 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2734/5499] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:01 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:02.853675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:02.854717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:02.866011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:02.866474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:02.884440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:02.894590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:02.978950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f96b2a9-4149-454b-b57c-d29332f30f55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.129457 Apr 09 21:21:02.982466 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2766/5500] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:02 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:03.993904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:03.995219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:04.007123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:04.007580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:04.008383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:04.008818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:04.074957 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7498d993-22ef-4393-a3ed-5caa7bc35216 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.088377 Apr 09 21:21:04.076322 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2735/5501] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:03 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:05.086758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:05.087778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:05.099036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:05.099484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:05.100277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:05.100708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:05.166007 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-17f7db52-5521-40f3-b462-5650f2413c00 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.083179 Apr 09 21:21:05.167337 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2767/5502] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:05 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:06.178627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:06.182075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:06.243796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:06.245466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:06.247634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:06.248094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:06.333693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-502632d8-5799-48b7-b930-d9303fb48965 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.156014 Apr 09 21:21:06.337102 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2736/5503] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:06 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:07.346851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:07.348036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:07.365706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:07.366171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:07.367140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:07.367577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:07.443441 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e145734f-7c49-4a93-b261-fb06e1e292fe tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.101137 Apr 09 21:21:07.444238 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2768/5504] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:07 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:08.454778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:08.455921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:08.463419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:08.464742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:08.465362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:08.466066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:08.536254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d9f1f806-9df4-4017-869d-963c8f4ed3ba tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 14 microversion: 2.1 time: 0.085866 Apr 09 21:21:08.537651 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2737/5505] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:08 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:21:09.550398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:09.551788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:09.561350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:09.561801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:09.562589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:09.563033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:09.616805 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fe2f64e-e7ce-4461-b0c0-0a9fbb7eb050 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action" status: 200 len: 8206 microversion: 2.1 time: 0.072569 Apr 09 21:21:09.621783 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2769/5506] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:09 2022] POST /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc/action => generated 8206 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:09.627935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:09.628769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:09.639984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:09.643092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:09.644075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:09.646227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:10.174537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:10.184798 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f830b34-3c83-48b7-9198-9155b58b4f83 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.561287 Apr 09 21:21:10.185535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2738/5507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:09 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:10.204342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:10.205572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:10.212928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:10.213805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:10.214777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:10.215402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:10.692355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:10.713538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4643f4c-64a3-4fdd-a286-68b6d6e8020d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.513508 Apr 09 21:21:10.715043 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2770/5508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:10 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:10.732076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:10.732956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:10.746038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:10.746687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:10.751857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:10.758335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:11.777553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:11.791017 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3ef06b8-d17d-4133-aa85-11cccef799e1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 1.060752 Apr 09 21:21:11.791355 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2739/5509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:10 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:11.808393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:11.809380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:11.817902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:11.818820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:11.820105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:11.820771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:12.266227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:12.277814 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ba4df41-5f7a-4919-894c-e59c7fc414f8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.471991 Apr 09 21:21:12.278750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2771/5510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:11 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:12.294568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:12.296028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:12.312006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:12.312896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:12.314176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:12.314653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:12.394062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Locking {{(pid=141819) lock /opt/stack/nova/nova/compute/api.py:4698}} Apr 09 21:21:12.552119 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-418a4882-c224-457c-a131-03f2c1eaa44b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.261557 Apr 09 21:21:12.553832 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2740/5511] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:12 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:12.565504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:12.565504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:12.575284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:12.575795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:12.576660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:12.577235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.311754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:13.325319 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aac58489-a5f5-4542-9c3c-15046f2ab943 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.767952 Apr 09 21:21:13.326639 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2772/5512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:12 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:13.344763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:13.354600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.355150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.390406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance c80f5bf1-19c1-477a-928a-d19693346060 is locked Apr 09 21:21:13.391620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 409 to user: Instance c80f5bf1-19c1-477a-928a-d19693346060 is locked {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:21:13.393328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eb0bd9cf-dfcb-4e03-adce-593249f593c4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 409 len: 107 microversion: 2.1 time: 0.054957 Apr 09 21:21:13.395102 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2741/5513] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:13 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 107 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 21:21:13.405336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:13.406109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:13.414775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.415692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.416709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.417413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.479659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Unlocking {{(pid=141818) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 09 21:21:13.561660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-33b62404-f720-4d87-bba4-e8976876f6f1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.161987 Apr 09 21:21:13.562717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2773/5514] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:13 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:13.570924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3beb0d6c-b7d9-46e9-9152-8e1f546f9930 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:13.579068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3beb0d6c-b7d9-46e9-9152-8e1f546f9930 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.579578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3beb0d6c-b7d9-46e9-9152-8e1f546f9930 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.675591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3beb0d6c-b7d9-46e9-9152-8e1f546f9930 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:21:13.799737 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3beb0d6c-b7d9-46e9-9152-8e1f546f9930 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.232779 Apr 09 21:21:13.801223 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2742/5515] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:13 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:13.824490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:13.828671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:13.861403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.862124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:13.863316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:13.877369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:14.190304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:14.200870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-65921fc3-c8be-4a37-89b5-c24af07ed0b2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.394367 Apr 09 21:21:14.202482 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2774/5516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:13 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:15.219355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:15.221175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:15.242608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:15.243306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:15.244537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:15.245736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:15.600125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:15.616084 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-47aa024a-6a71-430d-8ed5-b9fca4a44c19 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.399030 Apr 09 21:21:15.628234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2743/5517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:15 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:16.634988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:16.635592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:16.643024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:16.643483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:16.644276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:16.644722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:16.963106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:16.971110 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3a13e83-aa4e-4370-8dc8-affe855e653e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.340233 Apr 09 21:21:16.971672 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2775/5518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:16 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:17.989193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:17.990367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:18.003412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:18.003829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:18.009147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:18.009663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:18.308997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:18.327266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa124c7f-07d9-4f02-b123-2fa382fef98d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.342072 Apr 09 21:21:18.328567 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2744/5519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:17 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:19.349658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:19.350602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:19.358054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:19.358556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:19.359332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:19.359777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:19.745906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:19.757581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-424c2cc1-7bcc-4939-8263-cf2c280174de tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.416371 Apr 09 21:21:19.762377 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2776/5520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:19 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:20.778764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:20.779628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:20.794982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:20.795921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:20.798120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:20.798976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:21.197009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:21.207192 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02709f90-d423-4bae-b2b6-d19ef5ebe95a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.435699 Apr 09 21:21:21.208621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2745/5521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:20 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:21.882965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:21.884188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:21.894550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:21.895791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:21.897076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:21.897619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.229489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:22.230774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:22.240945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.241443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.242529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.242975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.251543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:22.261613 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7b69001-31eb-41de-8407-2d9ea6482118 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1682 microversion: 2.1 time: 0.382580 Apr 09 21:21:22.262527 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2777/5522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:21 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:22.385108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:22.386202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:22.396735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.397555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.398027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.398515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.492452 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ef48b18-89cc-461e-864d-eae804f58197 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action" status: 200 len: 32639 microversion: 2.1 time: 0.110521 Apr 09 21:21:22.494305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2778/5523] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:22 2022] POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action => generated 32639 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 21:21:22.567381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:22.576958 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-917fcb8d-2ced-4fc2-9b5e-51f88907124a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.354072 Apr 09 21:21:22.578315 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2746/5524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:22 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:22.675683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:22.678048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:22.696134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.697163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:22.700471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:22.701291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:23.053574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-66c704d8-8458-401e-9fa1-bd034bb5a47c tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1833 microversion: 2.1 time: 0.381745 Apr 09 21:21:23.055526 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2779/5525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:22 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1833 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:23.077862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:23.079879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:23.096221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:23.096681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:23.099369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:23.100240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:23.161678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lazy-loading 'flavor' on Instance uuid 562e6455-67e6-46c1-9afa-b53b520131d2 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:21:23.178363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Going to try to live migrate instance to another host {{(pid=141819) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 09 21:21:23.599908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:23.601588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:23.618080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:23.620977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:23.623660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:23.625784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:24.240289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:24.252074 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-062a1308-7d2f-4251-9c31-fa5af347714e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.657695 Apr 09 21:21:24.268074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2780/5526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:23 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:25.319285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:25.324030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:25.364641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:25.365802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:25.370154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:25.374688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:26.022399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:26.075480 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db52bf11-e271-4c97-9b5d-bc360f57b2d0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1656 microversion: 2.1 time: 0.794514 Apr 09 21:21:26.088466 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2781/5527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:25 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1656 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:26.114000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae63c227-81b0-4bfb-b36a-9c0ed28ceb2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:26.132261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae63c227-81b0-4bfb-b36a-9c0ed28ceb2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:26.133570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae63c227-81b0-4bfb-b36a-9c0ed28ceb2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:26.160501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65a383a6-755f-4cb2-a5b0-75f49c26f7cd tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action" status: 202 len: 0 microversion: 2.1 time: 3.093064 Apr 09 21:21:26.162227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2747/5528] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:23 2022] POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action => generated 0 bytes in 3096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:26.174881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:26.175517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:26.213417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:26.217424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:26.222533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:26.223094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:26.255426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae63c227-81b0-4bfb-b36a-9c0ed28ceb2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Going to try to start instance {{(pid=141818) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:21:26.374595 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae63c227-81b0-4bfb-b36a-9c0ed28ceb2b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.280315 Apr 09 21:21:26.376750 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2782/5529] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:26 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:26.397666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:26.398348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:26.418614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:26.421551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:26.422677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:26.423500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:27.578586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:27.591813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f47dc75-08e1-4b7c-9b71-526d2b3e12f3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 1.422647 Apr 09 21:21:27.593693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2748/5530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:26 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:27.620597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:27.629315 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-864398df-36f2-4b85-a9d9-8a129d1bda6f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1665 microversion: 2.1 time: 1.249077 Apr 09 21:21:27.639324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2783/5531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:26 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1665 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:28.611204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:28.612005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:28.624769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:28.629940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:28.630934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:28.631486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:28.646978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:28.647598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:28.662611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:28.663070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:28.663880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:28.664321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:29.316777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:29.326643 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6897965-0625-496d-a2ca-22c7914e1292 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1665 microversion: 2.1 time: 0.683484 Apr 09 21:21:29.333344 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2784/5532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:28 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1665 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:29.452831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:29.462007 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0efa7fef-3508-44ab-a1e5-dac35aa0d15e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.854893 Apr 09 21:21:29.462592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2749/5533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:28 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:30.243443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-46a4e3f7-45af-490e-b537-54815660f3b8 req-8b12c54a-95d6-4666-b6ca-cc2f76c28efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "name": "network-vif-unplugged", "status": "completed", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:30.262367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-46a4e3f7-45af-490e-b537-54815660f3b8 req-8b12c54a-95d6-4666-b6ca-cc2f76c28efd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:30.262832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-46a4e3f7-45af-490e-b537-54815660f3b8 req-8b12c54a-95d6-4666-b6ca-cc2f76c28efd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:30.282250 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-46a4e3f7-45af-490e-b537-54815660f3b8 req-8b12c54a-95d6-4666-b6ca-cc2f76c28efd service nova] Creating event network-vif-unplugged:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:21:30.296371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-46a4e3f7-45af-490e-b537-54815660f3b8 req-8b12c54a-95d6-4666-b6ca-cc2f76c28efd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.355022 Apr 09 21:21:30.297071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2785/5534] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:21:30.350083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:30.350843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:30.362476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:30.365115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:30.369280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:30.370342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:30.482557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:30.483482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:30.490484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:30.491285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:30.492388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:30.493212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:30.963423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:30.988030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:30.996972 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07783b3c-e281-4101-8525-1a1b497c8391 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.520226 Apr 09 21:21:31.004073 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2786/5535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:30 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:31.004500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd9664c4-7c51-4293-91de-c365109d503d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.657881 Apr 09 21:21:31.013087 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2750/5536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:30 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:31.046283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:31.047066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:31.054784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:31.055593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:31.056792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:31.058093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:31.712666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f828cf85-37fb-4b9f-ab18-4bf57abc8712 req-9043ddcf-cb79-47be-9780-6bc4acd50777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "name": "network-vif-plugged", "status": "completed", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:31.730965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f828cf85-37fb-4b9f-ab18-4bf57abc8712 req-9043ddcf-cb79-47be-9780-6bc4acd50777 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:31.732313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f828cf85-37fb-4b9f-ab18-4bf57abc8712 req-9043ddcf-cb79-47be-9780-6bc4acd50777 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:31.759972 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f828cf85-37fb-4b9f-ab18-4bf57abc8712 req-9043ddcf-cb79-47be-9780-6bc4acd50777 service nova] Creating event network-vif-plugged:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:21:31.770232 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f828cf85-37fb-4b9f-ab18-4bf57abc8712 req-9043ddcf-cb79-47be-9780-6bc4acd50777 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061431 Apr 09 21:21:31.771627 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2751/5537] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:21:31.994760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:32.006669 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d9156bd-914b-41bc-95e4-4f22ee64c47d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.989711 Apr 09 21:21:32.012150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2787/5538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:31 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:32.022073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:32.023140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:32.028055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:32.029395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:32.033581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.034257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.035241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.035864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.047620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.048357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.049743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.050402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.127147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Unlocking {{(pid=141818) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 09 21:21:32.307017 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd1bc49e-147d-466f-a160-19fa6630c9b8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.286523 Apr 09 21:21:32.308387 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2788/5539] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:32 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:32.323304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:32.324214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:32.348312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.350501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.351539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.352592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.423091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:32.448555 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b20c4987-46e6-4211-885d-7dfa67306853 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.431702 Apr 09 21:21:32.451448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2752/5540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:32 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:32.458658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-0aee06e0-e7c9-40fc-b94e-738320a25487 req-7a2f804b-41a6-44d6-b50f-586c7368e973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:32.483275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0aee06e0-e7c9-40fc-b94e-738320a25487 req-7a2f804b-41a6-44d6-b50f-586c7368e973 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.485163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-0aee06e0-e7c9-40fc-b94e-738320a25487 req-7a2f804b-41a6-44d6-b50f-586c7368e973 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.520061 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-0aee06e0-e7c9-40fc-b94e-738320a25487 req-7a2f804b-41a6-44d6-b50f-586c7368e973 service nova] Creating event network-changed:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:21:32.535574 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-0aee06e0-e7c9-40fc-b94e-738320a25487 req-7a2f804b-41a6-44d6-b50f-586c7368e973 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082144 Apr 09 21:21:32.536445 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2753/5541] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:21:32.708116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:32.717218 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-890849e1-3f8b-4ecc-a687-44a191f2ca2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.398678 Apr 09 21:21:32.722234 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2789/5542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:32 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:32.740018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:32.743855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:32.760258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.761085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:32.763341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:32.766933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:33.467521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:33.468141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:33.482171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:33.482976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:33.484062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:33.485211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:33.691380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:33.706769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f76b8e3-90e4-4e0a-b68c-1acc15500f88 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.971290 Apr 09 21:21:33.707405 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2754/5543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:32 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:33.725853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:33.726480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:33.745091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:33.746448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:33.749311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:33.750389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:33.808750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:33.816509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9f91774-07ff-4ec1-acd8-3006f66aa0a9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.354635 Apr 09 21:21:33.821831 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2790/5544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:33 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:34.058691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:34.067806 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe6dffcb-ba96-4710-b5c3-5c34eed070cc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.345877 Apr 09 21:21:34.073775 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2755/5545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:33 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:34.092156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:34.092967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:34.109291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.109945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:34.110949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.111394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:34.227273 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2365d6f-1a95-4373-8aed-b17d15406529 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.138953 Apr 09 21:21:34.228788 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2791/5546] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:34 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:34.237048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:34.238081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:34.248990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.249718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:34.250706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.251332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:34.726263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:34.742080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b333609-2a44-4b30-b9e1-3e1cc7e74d7f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1674 microversion: 2.1 time: 0.508973 Apr 09 21:21:34.742856 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2756/5547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:34 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1674 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:34.841226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:34.842454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:34.864267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.872878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:34.880154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:34.880712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:35.291216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:35.307205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-27f09c46-9668-4905-b587-8d4888e4f322 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.472198 Apr 09 21:21:35.314275 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2792/5548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:34 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:35.759961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:35.760589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:35.767853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:35.768310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:35.769327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:35.769770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.043759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:36.051610 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff50f4c4-6224-425f-9ad5-62972a9110d9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1654 microversion: 2.1 time: 0.295598 Apr 09 21:21:36.052213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2757/5549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:35 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1654 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:36.076509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:36.078492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:36.089109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.093640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.094974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.095607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.327976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:36.328612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:36.341984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.342128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.346856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.347375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.568038 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1cddeca3-af78-42be-af67-3b52c2ae6c7d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.497769 Apr 09 21:21:36.568779 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2793/5550] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:36 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:21:36.579382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:36.580752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:36.591994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.593567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.596010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:36.596898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:36.701552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:36.721436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ae71014-5cd4-4b1d-a417-32247cfb921a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.398104 Apr 09 21:21:36.736202 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2758/5551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:36 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:37.004041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:37.021721 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2851f076-2c1f-4b5d-94df-f7ebd4b2ddcb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1661 microversion: 2.1 time: 0.447738 Apr 09 21:21:37.022662 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2794/5552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:36 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1661 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:37.740072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:37.740703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:37.757132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:37.758019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:37.758833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:37.759477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:37.764760 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:21:37.765201 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:21:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 (ip 10.222.0.30) !!! Apr 09 21:21:38.051146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:38.052675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:38.077638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:38.078240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:38.079275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:38.079916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:38.268698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:38.280049 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-615e4ca6-ef4f-4f15-a365-ff61b8b58329 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.543783 Apr 09 21:21:38.285424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2759/5553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:37 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:38.293674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6200d3ab-7dfe-4981-ac45-244ac4fd7e5c req-ce96ddf0-d464-4a82-9773-d7bbb9bdfc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "name": "network-vif-unplugged", "status": "completed", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:38.310168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6200d3ab-7dfe-4981-ac45-244ac4fd7e5c req-ce96ddf0-d464-4a82-9773-d7bbb9bdfc45 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:38.310697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6200d3ab-7dfe-4981-ac45-244ac4fd7e5c req-ce96ddf0-d464-4a82-9773-d7bbb9bdfc45 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:38.324810 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6200d3ab-7dfe-4981-ac45-244ac4fd7e5c req-ce96ddf0-d464-4a82-9773-d7bbb9bdfc45 service nova] Creating event network-vif-unplugged:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch2-master-1 Apr 09 21:21:38.350421 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6200d3ab-7dfe-4981-ac45-244ac4fd7e5c req-ce96ddf0-d464-4a82-9773-d7bbb9bdfc45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062050 Apr 09 21:21:38.351608 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2760/5554] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:21:39.247876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:39.258313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-412b9101-d03d-4bbb-a7d2-5a8f65cbd516 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 1.223044 Apr 09 21:21:39.259866 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2795/5555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:38 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:39.276477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:39.277386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:39.286845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.287299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:39.290550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.291455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:39.302639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:39.303747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:39.314428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.314911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:39.318887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.319427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:39.766482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:39.777077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-61211020-7234-4594-9641-1df7d03bc14e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.478594 Apr 09 21:21:39.789362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2796/5556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:39 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:21:39.851122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:39.862700 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a57a6d1d-7f91-410e-8204-9ab8c61b09ca tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.590771 Apr 09 21:21:39.863340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2761/5557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:39.882985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:39.884086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:39.894016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.895276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:39.897554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:39.901171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.327331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:40.338371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4a941d2-6852-43f3-a862-9b2969148444 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.461895 Apr 09 21:21:40.344975 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2797/5558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:39 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:40.363373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:40.364128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:40.375161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.376081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.377496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.378045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.712331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:40.759349 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5d33dab-b9f6-4f2b-b6fd-3658f95e0e67 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.397866 Apr 09 21:21:40.760549 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2762/5559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:40.778744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:40.779369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:40.787046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.796767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:40.797416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:40.799930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.800991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.801523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.812609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.818906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:40.819768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:40.820216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:41.369153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:41.381638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-66877d8b-1c09-4c2b-b5a9-817e95423e0e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1692 microversion: 2.1 time: 0.588338 Apr 09 21:21:41.383268 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2763/5560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:40 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1692 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:41.388637 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:21:41.389144 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 (ip 10.222.0.30) !!! Apr 09 21:21:41.432462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:41.463432 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f952f8eb-42e8-44a3-a20c-935ac08c81ae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.688545 Apr 09 21:21:41.465288 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2798/5561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:41.482717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:41.483721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:41.493439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:41.494195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:41.497366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:41.506410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:41.783060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:41.790929 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4764d635-b3e9-4dc1-b1dd-107c10cd3294 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.314009 Apr 09 21:21:41.791526 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2764/5562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:41 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:42.400154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:42.400779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:42.408912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:42.409408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:42.410320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:42.410765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:42.806855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:42.817490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90a4a0a9-4d47-455b-8597-9caf83ca4a84 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1682 microversion: 2.1 time: 0.421481 Apr 09 21:21:42.819021 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2799/5563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:42 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1682 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:42.837251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:42.837927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:42.851548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:42.854258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:42.855218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:42.857449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:43.305268 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-233492b7-e23d-4102-b9de-d98c6ae251e8 tempest-TestNetworkAdvancedServerOps-214140696 tempest-TestNetworkAdvancedServerOps-214140696-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1833 microversion: 2.1 time: 0.468767 Apr 09 21:21:43.310145 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2765/5564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:42 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1833 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:43.324712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:43.326094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:43.335654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:43.337497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:43.338709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:43.339248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:43.752194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:43.770155 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e70b79c5-2d46-4017-ad0e-6dae076bb4a6 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1682 microversion: 2.1 time: 0.449890 Apr 09 21:21:43.788319 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2800/5565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:43 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1682 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:43.992025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:43.992967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:44.006169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:44.006819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:44.010354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:44.010979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:44.097625 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb386557-97ef-49a4-871f-8571f73453a2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action" status: 200 len: 38403 microversion: 2.1 time: 0.106127 Apr 09 21:21:44.097625 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2766/5566] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:21:43 2022] POST /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2/action => generated 38403 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:21:47.721326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:47.721902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:47.738983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:47.742288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:47.743187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:47.747962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:47.759560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-591448db-0156-4265-adc7-c5404c85cf34 req-87dbbfbf-c1bf-4492-9312-77d3d0fa48e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:47.774037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-591448db-0156-4265-adc7-c5404c85cf34 req-87dbbfbf-c1bf-4492-9312-77d3d0fa48e2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:47.781103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-591448db-0156-4265-adc7-c5404c85cf34 req-87dbbfbf-c1bf-4492-9312-77d3d0fa48e2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:47.803616 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-591448db-0156-4265-adc7-c5404c85cf34 req-87dbbfbf-c1bf-4492-9312-77d3d0fa48e2 service nova] Creating event network-changed:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch1-master-1 Apr 09 21:21:47.813801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-591448db-0156-4265-adc7-c5404c85cf34 req-87dbbfbf-c1bf-4492-9312-77d3d0fa48e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058206 Apr 09 21:21:47.821598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:21:47.841021 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2767/5567] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:21:47.968760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-633d4fb8-f83b-4bfd-9fe8-5c0bbf0092d4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 204 len: 0 microversion: 2.1 time: 0.251847 Apr 09 21:21:47.969838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2801/5568] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:21:47 2022] DELETE /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:21:47.979745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:47.980443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:47.992017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:47.997519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:47.998732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:47.999301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:48.264201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:48.275027 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2ae00530-6615-4cc3-ae3d-d1e7e7a2ff15 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1688 microversion: 2.1 time: 0.297705 Apr 09 21:21:48.275691 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2768/5569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:47 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1688 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:49.309744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:49.310521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:49.323915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:49.324635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:49.325759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:49.326547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:49.514388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:49.529600 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-800fce8e-4bad-4250-a785-3e4f084abaf0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 200 len: 1503 microversion: 2.1 time: 0.234452 Apr 09 21:21:49.531016 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2802/5570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:49 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:49.854554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-72257858-1a96-4a85-af1b-69368daccaee req-b20b9fd0-d473-4a5b-bd62-e5316cfa26a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e6455-67e6-46c1-9afa-b53b520131d2", "name": "network-vif-deleted", "tag": "7edd251d-10ff-45f1-a768-c72521d40cc1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:49.883294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72257858-1a96-4a85-af1b-69368daccaee req-b20b9fd0-d473-4a5b-bd62-e5316cfa26a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:49.885756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-72257858-1a96-4a85-af1b-69368daccaee req-b20b9fd0-d473-4a5b-bd62-e5316cfa26a3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:49.937750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-72257858-1a96-4a85-af1b-69368daccaee req-b20b9fd0-d473-4a5b-bd62-e5316cfa26a3 service nova] Creating event network-vif-deleted:7edd251d-10ff-45f1-a768-c72521d40cc1 for instance 562e6455-67e6-46c1-9afa-b53b520131d2 on nch1-master-1 Apr 09 21:21:49.952758 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-72257858-1a96-4a85-af1b-69368daccaee req-b20b9fd0-d473-4a5b-bd62-e5316cfa26a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103442 Apr 09 21:21:49.960812 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2769/5571] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:21:50.547983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:50.548614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 562e6455-67e6-46c1-9afa-b53b520131d2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:50.555934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:50.556689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:50.558042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:50.558686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:50.592339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] HTTP exception thrown: Instance 562e6455-67e6-46c1-9afa-b53b520131d2 could not be found. Apr 09 21:21:50.597745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Returning 404 to user: Instance 562e6455-67e6-46c1-9afa-b53b520131d2 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:21:50.599770 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a90891fd-f774-40e8-ae8f-f8780b7e6919 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2" status: 404 len: 111 microversion: 2.1 time: 0.055723 Apr 09 21:21:50.600361 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2803/5572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:50 2022] GET /compute/v2.1/servers/562e6455-67e6-46c1-9afa-b53b520131d2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:21:51.407430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1918259675", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "b4b7a3ab-b3cc-492d-828a-29903c6d882c"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:51.503795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] validate_networks() for [('b4b7a3ab-b3cc-492d-828a-29903c6d882c', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:21:52.786713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:21:52.787354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:21:52.787605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:21:52.788216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:21:52.788810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:21:52.812349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:52.813160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:52.815120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:52.821353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:52.860523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Getting quotas for project 4542400bc91449e09c44d33b478c731e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:21:52.868537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Getting quotas for user 7c0b068a444b461cb5190024544c1291 and project 4542400bc91449e09c44d33b478c731e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:21:52.925543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:21:52.928206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:21:53.119751 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f66c884a-e890-4210-97d6-e9e728202ff8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.718456 Apr 09 21:21:53.128956 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2770/5573] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:21:53.143560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26c83c62-884e-4b01-b51f-dc200d71de76 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:53.145453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-26c83c62-884e-4b01-b51f-dc200d71de76 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:53.750399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-26c83c62-884e-4b01-b51f-dc200d71de76 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:53.764969 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-26c83c62-884e-4b01-b51f-dc200d71de76 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1214 microversion: 2.1 time: 0.628224 Apr 09 21:21:53.774369 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2804/5574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:53 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1214 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:54.787226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:54.788352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:54.804307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:54.805454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:54.806472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:54.807180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:55.034696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:55.056928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-759cae1e-b9bb-4740-baa4-0642f1783bb8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1274 microversion: 2.1 time: 0.272020 Apr 09 21:21:55.061534 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2771/5575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:54 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:56.075801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:56.076588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:56.097629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:56.098564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:56.100350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:56.101412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:56.776504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:56.793850 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40ad7ff3-c22c-4901-aa7c-028c2e3ca919 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1272 microversion: 2.1 time: 0.723056 Apr 09 21:21:56.794714 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2805/5576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:56 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1272 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:57.812428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:57.813937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:57.826773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:57.831504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:57.832872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:57.833817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:58.407599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:21:58.435231 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85a88eed-4aa3-4428-8965-05ebeea5e39b tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.621521 Apr 09 21:21:58.436650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2772/5577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:57 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:21:59.452188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:21:59.456395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:21:59.482430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:59.484132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:59.485729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:59.486463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:21:59.955549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-af01c7b0-e7d2-4f96-843c-a3b99029ec19 req-19ac7154-cdf4-47fb-9e4b-1a8880271076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24543ae-98a2-4ec3-883a-199fa081976b", "tag": "88fc6a45-26f7-4cf8-8146-b9abc219ea8e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:21:59.973589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-af01c7b0-e7d2-4f96-843c-a3b99029ec19 req-19ac7154-cdf4-47fb-9e4b-1a8880271076 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:21:59.976427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-af01c7b0-e7d2-4f96-843c-a3b99029ec19 req-19ac7154-cdf4-47fb-9e4b-1a8880271076 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:00.003846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-af01c7b0-e7d2-4f96-843c-a3b99029ec19 req-19ac7154-cdf4-47fb-9e4b-1a8880271076 service nova] Creating event network-changed:88fc6a45-26f7-4cf8-8146-b9abc219ea8e for instance a24543ae-98a2-4ec3-883a-199fa081976b on nch2-master-1 Apr 09 21:22:00.017289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-af01c7b0-e7d2-4f96-843c-a3b99029ec19 req-19ac7154-cdf4-47fb-9e4b-1a8880271076 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064897 Apr 09 21:22:00.017953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2773/5578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:22:00.037591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:00.046936 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba6894e6-3371-41a1-86c8-da2aea89f3f3 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.598702 Apr 09 21:22:00.047516 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2806/5579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:21:59 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:01.067123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:01.068453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:01.075116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:01.077288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:01.078386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:01.079028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:01.167628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-360cd249-cf48-42cf-b173-71cf60cbaf01 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '.version_select at 0x7fb08dad8e50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:01.227890 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-360cd249-cf48-42cf-b173-71cf60cbaf01 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1956582168" status: 202 len: 0 microversion: 2.1 time: 0.065642 Apr 09 21:22:01.230141 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2807/5580] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1956582168 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:22:01.270770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: .version_select at 0x7fb08db30af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1416929189"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:01.307490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:01.321930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:01.524763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:01.581816 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0cfede68-f73c-406f-9c85-1bf28474fd57 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.520637 Apr 09 21:22:01.591215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2774/5581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:01 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:02.212774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:02.225814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:02.251177 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-090808d2-6675-458d-b3ed-d23cea8de77c tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.984422 Apr 09 21:22:02.252329 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2808/5582] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:22:01 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:02.602330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:02.602949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:02.627630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:02.628105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:02.631886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:02.632747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:02.674467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Action: 'create', calling method: .version_select at 0x7fb08f038430>, body: {"keypair": {"name": "tempest-TestServerBasicOps-934123988"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:02.696969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for project 605e203fc5c04ed781bf67d309905d81. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:02.703178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for user 81497a47682c4a89ad792ee59c13fc6e and project 605e203fc5c04ed781bf67d309905d81. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:02.936407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:02.945656 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-517084be-814f-43d6-8d13-8b120f6fb36d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.347169 Apr 09 21:22:02.948164 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2809/5583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:02 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:03.207394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for project 605e203fc5c04ed781bf67d309905d81. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:03.215056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for user 81497a47682c4a89ad792ee59c13fc6e and project 605e203fc5c04ed781bf67d309905d81. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:03.232408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6480763-ca26-4405-bd21-a729781caf24 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.856199 Apr 09 21:22:03.233369 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2775/5584] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:22:02 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:03.976758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:03.978628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:03.988990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:03.991402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:03.992585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:03.993633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:04.341637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:04.354382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6eda9b4a-22d1-4aaf-96d1-4d5fb09d3107 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.392963 Apr 09 21:22:04.357185 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2810/5585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:03 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:05.377006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:05.378026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:05.386921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:05.387231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:05.389304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:05.389916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:05.988484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:06.003565 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b04aceb-9c83-4fe7-8a4d-4e12339664fe tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.633500 Apr 09 21:22:06.019325 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2776/5586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:05 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:06.095829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-17768807", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-934123988", "security_groups": [{"name": "tempest-secgroup-smoke-535686997"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0391f0d4-fa04-493b-a06d-d7825f459d86"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:06.384535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] validate_networks() for [('0391f0d4-fa04-493b-a06d-d7825f459d86', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:22:07.026312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:07.027900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:07.044190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:07.046580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:07.048043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:07.048654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:07.361253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for project 605e203fc5c04ed781bf67d309905d81. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:07.371141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for user 81497a47682c4a89ad792ee59c13fc6e and project 605e203fc5c04ed781bf67d309905d81. Resources: dict_keys(['metadata_items']) {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:07.404103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:22:07.404849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:22:07.405575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:22:07.406179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:22:07.406776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:22:07.420820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:07.421498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:07.426375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:07.427192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:07.471168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for project 605e203fc5c04ed781bf67d309905d81. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:07.487629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Getting quotas for user 81497a47682c4a89ad792ee59c13fc6e and project 605e203fc5c04ed781bf67d309905d81. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:07.508366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:22:07.511714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:22:07.520610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:07.532795 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d705d313-a0d1-438a-8399-9900221c6a0a tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.510306 Apr 09 21:22:07.533525 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2777/5587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:07 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:07.634675 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85450959-684d-4c86-bc65-5aa50f1ea881 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.543015 Apr 09 21:22:07.635348 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2811/5588] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:22:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:22:07.647131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d3a5a36-d6c3-43ad-b827-db231552df75 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:07.648141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d3a5a36-d6c3-43ad-b827-db231552df75 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:07.855402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d3a5a36-d6c3-43ad-b827-db231552df75 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:07.869981 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d3a5a36-d6c3-43ad-b827-db231552df75 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1300 microversion: 2.1 time: 0.225121 Apr 09 21:22:07.871678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2778/5589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:07 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:08.454809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:08.457379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:08.465866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.468050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.469584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.470259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.550504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:08.551755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:08.569242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.570123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.571044 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.571577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.631619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93672132-8188-4556-af9f-54cf2fc9fe64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.183048 Apr 09 21:22:08.632264 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2812/5590] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:22:08 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:22:08.640988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:08.641735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:08.656873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.664217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.665359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:08.665816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:08.987909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:08.997279 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-640eadfd-d7d1-4f6d-ae6d-c1cc4b5636c7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.451411 Apr 09 21:22:09.002557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2779/5591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:08 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:09.007828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:09.008775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:09.031117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:09.033558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:09.034644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:09.037252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:09.294325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:09.318791 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a3c1e2d5-edb9-4225-8716-8957c9af6c49 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1671 microversion: 2.1 time: 0.678401 Apr 09 21:22:09.322022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2813/5592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:08 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1671 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:09.345423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-73a7cbd6-c354-48eb-bbdd-a1246de10ee3 req-086e3c88-7cd2-4238-8ee3-b4577a5c2bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24543ae-98a2-4ec3-883a-199fa081976b", "name": "network-vif-plugged", "status": "completed", "tag": "88fc6a45-26f7-4cf8-8146-b9abc219ea8e"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:09.371079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-73a7cbd6-c354-48eb-bbdd-a1246de10ee3 req-086e3c88-7cd2-4238-8ee3-b4577a5c2bf9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:09.372033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-73a7cbd6-c354-48eb-bbdd-a1246de10ee3 req-086e3c88-7cd2-4238-8ee3-b4577a5c2bf9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:09.398133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-73a7cbd6-c354-48eb-bbdd-a1246de10ee3 req-086e3c88-7cd2-4238-8ee3-b4577a5c2bf9 service nova] Creating event network-vif-plugged:88fc6a45-26f7-4cf8-8146-b9abc219ea8e for instance a24543ae-98a2-4ec3-883a-199fa081976b on nch2-master-1 Apr 09 21:22:09.409392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-73a7cbd6-c354-48eb-bbdd-a1246de10ee3 req-086e3c88-7cd2-4238-8ee3-b4577a5c2bf9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076035 Apr 09 21:22:09.410748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2814/5593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:09.460195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:09.474046 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dc44e7ce-f83c-4247-b93a-c73907f21620 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1352 microversion: 2.1 time: 0.470030 Apr 09 21:22:09.475919 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2780/5594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:09 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1352 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:10.016203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:10.017118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:10.034459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.035811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.038017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.038676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.338458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:10.339192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:10.348923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.352230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.354429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.356764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.645669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:10.666705 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0b7550db-b46c-4947-b7d8-b6dc87f7f672 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.655488 Apr 09 21:22:10.674965 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2815/5595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:10 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:10.680083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:10.689584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:10.704577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.708600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.714968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:10.719526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:10.861797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:10.870114 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d3357d6-5050-4d3e-8547-46cebee855ca tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1358 microversion: 2.1 time: 0.193789 Apr 09 21:22:10.874477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2816/5596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:10 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:10.913649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:10.921322 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c95f02f-60b4-4eb3-8057-e0c90dc91910 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1671 microversion: 2.1 time: 0.586815 Apr 09 21:22:10.925802 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2781/5597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:10 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1671 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:11.688360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:11.689170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:11.714284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:11.716831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:11.721050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:11.721774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:11.894197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:11.896592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:11.906619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:11.907573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:11.908719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:11.909549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:12.201126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:12.210475 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85deeefd-1a77-4e20-8e54-1ff19db34a45 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1314 microversion: 2.1 time: 0.527322 Apr 09 21:22:12.213224 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2817/5598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:11 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:12.220885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:12.234095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:12.241494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:12.241967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:12.242642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:12.243090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:12.766915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:12.787654 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a60397b-e7aa-41cd-affa-4d950edb5244 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.899396 Apr 09 21:22:12.800573 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2782/5599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:11 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:13.035901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:13.051486 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0baef15f-3849-4372-98f4-b4715b2390d5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.836778 Apr 09 21:22:13.055555 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2818/5600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:12 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:13.239050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:13.243024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:13.251994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:13.252816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:13.257112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:13.257794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:13.531561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:13.545755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0cb6f98-af11-479f-9b06-09df294d6a81 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1499 microversion: 2.1 time: 0.315769 Apr 09 21:22:13.547787 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2783/5601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:13 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1499 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:13.738554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-8d03ba9a-1e0c-4d07-b661-82c05b6b30f9 req-8fb749dd-b778-4e16-8920-9714dcf61861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584ed9de-6598-458b-bdc5-118c7ca85c48", "tag": "4c7b21e8-849b-46e4-a86f-7e4c0cea2745"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:13.779271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8d03ba9a-1e0c-4d07-b661-82c05b6b30f9 req-8fb749dd-b778-4e16-8920-9714dcf61861 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:13.804831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8d03ba9a-1e0c-4d07-b661-82c05b6b30f9 req-8fb749dd-b778-4e16-8920-9714dcf61861 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:13.815487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:13.816411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:13.825948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:13.828608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:13.829743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:13.830415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:13.843790 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-8d03ba9a-1e0c-4d07-b661-82c05b6b30f9 req-8fb749dd-b778-4e16-8920-9714dcf61861 service nova] Creating event network-changed:4c7b21e8-849b-46e4-a86f-7e4c0cea2745 for instance 584ed9de-6598-458b-bdc5-118c7ca85c48 on nch1-master-1 Apr 09 21:22:13.859938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-8d03ba9a-1e0c-4d07-b661-82c05b6b30f9 req-8fb749dd-b778-4e16-8920-9714dcf61861 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125359 Apr 09 21:22:13.861561 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2819/5602] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:14.271452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:14.286287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b6f0d499-5220-42c5-9dac-21b7b33de4e2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.473250 Apr 09 21:22:14.288603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2784/5603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:13 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:14.337729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:14.338330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:14.350905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:14.351713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:14.352668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:14.353292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:14.382469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:22:14.545427 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aca0355d-877d-43ac-af7b-8145230711dd tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 204 len: 0 microversion: 2.1 time: 0.212059 Apr 09 21:22:14.546022 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2820/5604] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:22:14 2022] DELETE /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:22:14.570574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:14.572050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:14.591069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:14.591794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:14.593235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:14.594214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:14.785108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:14.795677 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-86b4d87a-c455-4e69-be5a-6f11866a3563 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1505 microversion: 2.1 time: 0.242636 Apr 09 21:22:14.805827 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2785/5605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:14 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:15.310395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:15.314719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:15.328885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:15.336561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:15.339365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:15.339930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:15.704163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:15.714868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4df097a4-7a57-44f9-9afa-ef02d6eb140f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.414283 Apr 09 21:22:15.726028 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2821/5606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:15 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:15.813846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:15.814579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:15.825022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:15.829725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:15.830565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:15.831003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:16.173107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-716343780", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "ea5bab77-15e0-4728-ad80-51ef38574660"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1416929189", "security_groups": [{"name": "tempest-secgroup-smoke-1988449099"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:16.215350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:16.227475 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd8e65ba-f408-4251-8b24-c9da7ce44da7 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1505 microversion: 2.1 time: 0.417186 Apr 09 21:22:16.228809 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2786/5607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:15 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:16.401665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] validate_networks() for [('ea5bab77-15e0-4728-ad80-51ef38574660', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:22:16.647060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e7fb2c18-e191-4a6e-bc50-fb3c3b9271fd req-fc7366af-b9e3-4136-9ccd-f5f6ed9fb849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24543ae-98a2-4ec3-883a-199fa081976b", "name": "network-vif-deleted", "tag": "88fc6a45-26f7-4cf8-8146-b9abc219ea8e"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:16.662761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7fb2c18-e191-4a6e-bc50-fb3c3b9271fd req-fc7366af-b9e3-4136-9ccd-f5f6ed9fb849 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:16.666062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7fb2c18-e191-4a6e-bc50-fb3c3b9271fd req-fc7366af-b9e3-4136-9ccd-f5f6ed9fb849 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:16.691106 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e7fb2c18-e191-4a6e-bc50-fb3c3b9271fd req-fc7366af-b9e3-4136-9ccd-f5f6ed9fb849 service nova] Creating event network-vif-deleted:88fc6a45-26f7-4cf8-8146-b9abc219ea8e for instance a24543ae-98a2-4ec3-883a-199fa081976b on nch2-master-1 Apr 09 21:22:16.697827 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e7fb2c18-e191-4a6e-bc50-fb3c3b9271fd req-fc7366af-b9e3-4136-9ccd-f5f6ed9fb849 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054396 Apr 09 21:22:16.698838 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2787/5608] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:16.734563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:16.735674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:16.749833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:16.751524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:16.754502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:16.755251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.261305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:17.272350 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8b9d647-7ad2-438b-8f17-f3ebc6c4e25a tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.542296 Apr 09 21:22:17.277414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2788/5609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:16 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:17.301799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:17.303204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:17.313438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:17.314187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.315371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:17.316258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.407641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:17.411356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.412272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lazy-loading 'fault' on Instance uuid a24543ae-98a2-4ec3-883a-199fa081976b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:22:17.552686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:17.558077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:22:17.561136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:22:17.561773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:22:17.562252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:22:17.562731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:22:17.564574 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00962f9a-6f5f-422c-a7b7-3f5f369e3b1d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 200 len: 1304 microversion: 2.1 time: 0.282972 Apr 09 21:22:17.565328 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2789/5610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:17 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 1304 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:17.590373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:17.590932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.592564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:17.599571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:17.641268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:17.648178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Getting quotas for user b5534646a6384067bda99af7c864d494 and project 0cbaded0b4ad4c4587cc36402e326750. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:17.662821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:22:17.666437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:22:17.734920 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a61f70c-b389-48be-96b2-9bb24103c10a tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.565357 Apr 09 21:22:17.736352 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2822/5611] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:22:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:22:17.747636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03c6a9fc-f193-4cb7-8c64-85860a88512e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:17.748303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03c6a9fc-f193-4cb7-8c64-85860a88512e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:17.917796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-03c6a9fc-f193-4cb7-8c64-85860a88512e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:17.929752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03c6a9fc-f193-4cb7-8c64-85860a88512e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1266 microversion: 2.1 time: 0.187317 Apr 09 21:22:17.930664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2790/5612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:17 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:18.297473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:18.298371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:18.309670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.310810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:18.312412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.313208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:18.582475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:18.583103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a24543ae-98a2-4ec3-883a-199fa081976b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:18.593481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.594779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:18.602482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.603212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:18.632191 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] HTTP exception thrown: Instance a24543ae-98a2-4ec3-883a-199fa081976b could not be found. Apr 09 21:22:18.632826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Returning 404 to user: Instance a24543ae-98a2-4ec3-883a-199fa081976b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:22:18.642162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3bae85d0-e37a-4c95-9171-b9f8a494399e tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b" status: 404 len: 111 microversion: 2.1 time: 0.063600 Apr 09 21:22:18.643092 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2791/5613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:18 2022] GET /compute/v2.1/servers/a24543ae-98a2-4ec3-883a-199fa081976b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:22:18.827682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:18.840079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2106283623", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "b4b7a3ab-b3cc-492d-828a-29903c6d882c"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:18.850350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-996ae5f4-85d1-41d4-93ca-3b8a510a6a46 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.558917 Apr 09 21:22:18.857384 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2823/5614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:18 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:18.909396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] validate_networks() for [('b4b7a3ab-b3cc-492d-828a-29903c6d882c', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:22:18.946155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:18.947501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:18.958770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.959589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:18.961081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:18.961759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:19.126850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:19.137580 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-280a415d-e51b-4609-8399-2bcd514ff366 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1318 microversion: 2.1 time: 0.195249 Apr 09 21:22:19.138188 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2824/5615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:18 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:19.517546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:22:19.517975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:22:19.518447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:22:19.518856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:22:19.519264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:22:19.530567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:19.531016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:19.531948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:19.533102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:19.553211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Getting quotas for project 4542400bc91449e09c44d33b478c731e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:19.561964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Getting quotas for user 7c0b068a444b461cb5190024544c1291 and project 4542400bc91449e09c44d33b478c731e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:19.594711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:22:19.599975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:22:19.654749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e03a238-de73-4fcf-8193-41763d8e72ce tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819008 Apr 09 21:22:19.660529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2792/5616] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:22:19.666865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-229a664d-e56c-41f9-b7ac-efb18a58125c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:19.667751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-229a664d-e56c-41f9-b7ac-efb18a58125c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:19.756689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-229a664d-e56c-41f9-b7ac-efb18a58125c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:19.768884 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-229a664d-e56c-41f9-b7ac-efb18a58125c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1214 microversion: 2.1 time: 0.106120 Apr 09 21:22:19.769727 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2825/5617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:19 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:19.871662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:19.872647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:19.903324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:19.905587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:19.915182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:19.916255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:20.046112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-10d5e96b-cfc5-4c47-ae26-76c3d3674eb7 req-a35c8363-a0e7-4b21-8915-1f997c1a2b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ed9de-6598-458b-bdc5-118c7ca85c48", "name": "network-vif-plugged", "status": "completed", "tag": "4c7b21e8-849b-46e4-a86f-7e4c0cea2745"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:20.070504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-10d5e96b-cfc5-4c47-ae26-76c3d3674eb7 req-a35c8363-a0e7-4b21-8915-1f997c1a2b91 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:20.071821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-10d5e96b-cfc5-4c47-ae26-76c3d3674eb7 req-a35c8363-a0e7-4b21-8915-1f997c1a2b91 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:20.101851 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-10d5e96b-cfc5-4c47-ae26-76c3d3674eb7 req-a35c8363-a0e7-4b21-8915-1f997c1a2b91 service nova] Creating event network-vif-plugged:4c7b21e8-849b-46e4-a86f-7e4c0cea2745 for instance 584ed9de-6598-458b-bdc5-118c7ca85c48 on nch1-master-1 Apr 09 21:22:20.115392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-10d5e96b-cfc5-4c47-ae26-76c3d3674eb7 req-a35c8363-a0e7-4b21-8915-1f997c1a2b91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069716 Apr 09 21:22:20.116380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2826/5618] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:22:20.163011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:20.163754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:20.179210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:20.179667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:20.180462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:20.180895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:20.283959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:20.295215 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9a528d63-2662-4118-888a-0f5e6df053f2 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.432087 Apr 09 21:22:20.296401 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2793/5619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:19 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:20.332298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:20.345498 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f7ef098-5037-4668-b61a-254889253f82 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1324 microversion: 2.1 time: 0.193675 Apr 09 21:22:20.346371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2827/5620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:20 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:20.786890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:20.787505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:20.802121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:20.804743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:20.805786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:20.807464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:21.029123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:21.043757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75da0d02-e8eb-4ff3-a343-d0d7fa137a46 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1266 microversion: 2.1 time: 0.260699 Apr 09 21:22:21.044405 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2794/5621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:20 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:21.312349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:21.313994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:21.322807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:21.323267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:21.325176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:21.325176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:21.364571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:21.365933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:21.377174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:21.380152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:21.381472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:21.388959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:21.578315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:21.590216 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a3d6e79f-40de-458f-9e92-b4b38cddd4ec tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1425 microversion: 2.1 time: 0.282043 Apr 09 21:22:21.591262 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2828/5622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:21 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1425 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:21.608588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:21.626953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3104ec27-8e48-47b2-b809-7ae907d27ad8 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.267726 Apr 09 21:22:21.632369 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2795/5623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:21 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:22.061275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:22.061868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:22.071836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.072745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.074958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.076516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.189691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:22.199734 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5529db5-d075-4a0f-823e-6f92bc141565 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1272 microversion: 2.1 time: 0.142512 Apr 09 21:22:22.210100 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2829/5624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:22 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:22.339177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-46cd1cc9-15bd-48b8-bc28-5e9df25bc0e5 req-23d163f6-8f78-414a-a6d2-3a926e5cd391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:22.362546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-46cd1cc9-15bd-48b8-bc28-5e9df25bc0e5 req-23d163f6-8f78-414a-a6d2-3a926e5cd391 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.364034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-46cd1cc9-15bd-48b8-bc28-5e9df25bc0e5 req-23d163f6-8f78-414a-a6d2-3a926e5cd391 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.386572 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-46cd1cc9-15bd-48b8-bc28-5e9df25bc0e5 req-23d163f6-8f78-414a-a6d2-3a926e5cd391 service nova] Creating event network-changed:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:22:22.393174 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-46cd1cc9-15bd-48b8-bc28-5e9df25bc0e5 req-23d163f6-8f78-414a-a6d2-3a926e5cd391 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062138 Apr 09 21:22:22.394285 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2796/5625] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:22.608231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:22.609655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:22.637505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.640103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.641821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.650776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:22.652927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:22.654503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.668486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.669581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:22.672589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:22.673604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.062142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:23.068832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75303ae7-e94a-4200-821b-c808ab50b852 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.422981 Apr 09 21:22:23.072799 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2797/5626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:22 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:23.078490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:23.089899 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29b8dc78-6586-4918-a7f3-4788258e83a3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1605 microversion: 2.1 time: 0.485795 Apr 09 21:22:23.102354 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2830/5627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:22 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1605 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:23.109683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:23.110539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:23.117247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.117926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.118884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.119495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.218370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:23.219401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:23.226263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.227016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.227980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.228601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.463612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:23.482191 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06141c2c-dbb0-4a3e-9917-a9f88dc1208e tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1605 microversion: 2.1 time: 0.372628 Apr 09 21:22:23.483595 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2798/5628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:23 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1605 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:23.507361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:23.508389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:23.518051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.518748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.519777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:23.520623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:23.550696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:23.559657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-131d20ee-9286-43b9-b1e1-91fade4b4260 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.346071 Apr 09 21:22:23.560489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2831/5629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:23 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:23.810463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:23.823757 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad501df5-e730-4a79-8ec0-2ac5332f330d tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1605 microversion: 2.1 time: 0.322631 Apr 09 21:22:23.825545 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2799/5630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:23 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1605 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:24.091249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:24.091924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:24.099994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:24.100738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:24.101751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:24.102362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:24.404969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:24.416116 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9c87f14-16a0-45da-a231-b72eae4cd7b2 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.329682 Apr 09 21:22:24.417011 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2832/5631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:24 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:24.423976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-576a0823-617e-4260-80f2-b936eba32fd8 req-d3dc6e1e-9346-4bc7-b2c1-f14011b69470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a8ce04-ceba-4fb0-9c00-50fcc75f6742", "tag": "d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:24.433293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-576a0823-617e-4260-80f2-b936eba32fd8 req-d3dc6e1e-9346-4bc7-b2c1-f14011b69470 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:24.434102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-576a0823-617e-4260-80f2-b936eba32fd8 req-d3dc6e1e-9346-4bc7-b2c1-f14011b69470 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:24.446765 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-576a0823-617e-4260-80f2-b936eba32fd8 req-d3dc6e1e-9346-4bc7-b2c1-f14011b69470 service nova] Creating event network-changed:d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f for instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 on nch2-master-1 Apr 09 21:22:24.452621 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-576a0823-617e-4260-80f2-b936eba32fd8 req-d3dc6e1e-9346-4bc7-b2c1-f14011b69470 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032273 Apr 09 21:22:24.453708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2800/5632] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:24.578317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:24.579381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:24.586939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:24.587531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:24.588991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:24.590087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:24.849256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:24.857486 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-acc52d13-b6b7-44d5-9f8f-cff5e8609963 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.284273 Apr 09 21:22:24.858673 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2833/5633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:24 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:25.436374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:25.437610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:25.452672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:25.455408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:25.456890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:25.459246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:25.747669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:25.760426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f73af69-bbe1-4301-9ed8-d13e844d226d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.330419 Apr 09 21:22:25.764272 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2801/5634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:25 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:25.875158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:25.875725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:25.888041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:25.888416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:25.889235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:25.889678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:26.166017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:26.174835 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e31ed7d-c507-4de8-9d7a-f6a75068490d tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.303617 Apr 09 21:22:26.176112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2834/5635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:25 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:26.778657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:26.779286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:26.792398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:26.793625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:26.794473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:26.794934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:27.205173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:27.205819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:27.217799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:27.219177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:27.220184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:27.220783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:27.684348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:27.697328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbc58354-ea6a-4489-973e-6b79e94d0589 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.922678 Apr 09 21:22:27.709998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2802/5636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:26 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:27.936461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:27.948192 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ebfa15da-20bc-4675-be0d-4122bb3912dc tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.760014 Apr 09 21:22:27.954115 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2835/5637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:27 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:28.716028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:28.716694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:28.730332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:28.730771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:28.731632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:28.732099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:28.971119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:28.971748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:28.993254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:28.993724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:28.994549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:28.995061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:29.219510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:29.227876 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bbde7f67-4819-4c3b-a399-cf12530763e9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.516100 Apr 09 21:22:29.228693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2803/5638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:28 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:29.233726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2653a6cb-36e7-42f5-b59f-1bb9ff34d88e req-4d060454-b599-413a-930c-972b462f3bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584ed9de-6598-458b-bdc5-118c7ca85c48", "tag": "4c7b21e8-849b-46e4-a86f-7e4c0cea2745"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:29.242796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2653a6cb-36e7-42f5-b59f-1bb9ff34d88e req-4d060454-b599-413a-930c-972b462f3bb1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:29.243247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2653a6cb-36e7-42f5-b59f-1bb9ff34d88e req-4d060454-b599-413a-930c-972b462f3bb1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:29.257128 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2653a6cb-36e7-42f5-b59f-1bb9ff34d88e req-4d060454-b599-413a-930c-972b462f3bb1 service nova] Creating event network-changed:4c7b21e8-849b-46e4-a86f-7e4c0cea2745 for instance 584ed9de-6598-458b-bdc5-118c7ca85c48 on nch1-master-1 Apr 09 21:22:29.262429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2653a6cb-36e7-42f5-b59f-1bb9ff34d88e req-4d060454-b599-413a-930c-972b462f3bb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032136 Apr 09 21:22:29.263173 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2804/5639] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:29.404652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:29.415619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe51a5b3-5442-4840-a381-5382f65ea4d0 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.449507 Apr 09 21:22:29.416400 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2836/5640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:28 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:30.246929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:30.248625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:30.255772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:30.256522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:30.257588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:30.258368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:30.433653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:30.438369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:30.463172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:30.472146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68a8b639-4707-4c70-bf4d-768d02c3cf8e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.230931 Apr 09 21:22:30.479847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:30.480857 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2805/5641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:30 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:30.484842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:30.489907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:30.493521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:30.722752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:30.731172 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e547d3b-a92c-4590-a809-f1c173e37ea8 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.302081 Apr 09 21:22:30.733195 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2837/5642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:30 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:31.498251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:31.499111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:31.514655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:31.515503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:31.518334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:31.520978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:31.748061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:31.748789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:31.761575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:31.767477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:31.768727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:31.769450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:31.961063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:31.973946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:31.984306 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97edb52f-8693-42bc-8a49-51205fbade20 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.490804 Apr 09 21:22:31.985177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2806/5643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:31 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:31.988732 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37b90e0a-2752-47fd-a0d8-288a7b79a00c tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.235417 Apr 09 21:22:31.992200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2838/5644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:31 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:32.001473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2a6a9ae6-37e2-4999-913f-4f6dcf7fc662 req-14bae62d-ddfd-4693-a07f-c0ebfa7a3341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "name": "network-vif-plugged", "status": "completed", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:32.024724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a6a9ae6-37e2-4999-913f-4f6dcf7fc662 req-14bae62d-ddfd-4693-a07f-c0ebfa7a3341 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:32.025518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2a6a9ae6-37e2-4999-913f-4f6dcf7fc662 req-14bae62d-ddfd-4693-a07f-c0ebfa7a3341 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:32.044262 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2a6a9ae6-37e2-4999-913f-4f6dcf7fc662 req-14bae62d-ddfd-4693-a07f-c0ebfa7a3341 service nova] Creating event network-vif-plugged:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:22:32.050159 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2a6a9ae6-37e2-4999-913f-4f6dcf7fc662 req-14bae62d-ddfd-4693-a07f-c0ebfa7a3341 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064026 Apr 09 21:22:32.051449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2807/5645] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:33.015884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:33.023608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:33.024975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:33.027962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:33.039099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:33.039645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:33.041265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:33.042295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:33.042801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:33.043295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:33.048131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:33.049580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:33.363960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:33.381282 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef77cb8a-77cb-401f-a451-361391e4c753 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1392 microversion: 2.1 time: 0.362668 Apr 09 21:22:33.382343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2808/5646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:33 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:33.398181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:33.410098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bafa16d6-af88-4979-8fb0-3dad7c956d48 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.400409 Apr 09 21:22:33.410701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2839/5647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:33 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:34.403057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:34.404505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:34.415710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.416439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:34.417552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.418720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:34.427279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:34.428079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:34.447220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.447685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:34.448548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.448981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:34.726136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:34.743004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:34.752856 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92b5d543-1977-4d96-b0d0-33f00bbcfcdf tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1563 microversion: 2.1 time: 0.357813 Apr 09 21:22:34.754265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1b029db-4141-47e1-884d-99ea85bd43c1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.330820 Apr 09 21:22:34.755507 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2809/5648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:34 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:34.756258 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2840/5649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:34 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:34.769529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:34.770448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:34.783541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.784318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:34.785169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:34.785621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:35.096590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:35.106745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b9c0cda-782a-4e87-8285-d6e0a89a9160 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1563 microversion: 2.1 time: 0.339311 Apr 09 21:22:35.111083 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2810/5650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:34 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1563 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:22:35.787766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:35.788250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:35.806443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:35.807335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:35.808428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:35.809084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:35.881003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-bc17817a-705a-4a67-8525-ee294d0d7655 req-17ed0aca-5902-4f68-8419-146de9bedb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a8ce04-ceba-4fb0-9c00-50fcc75f6742", "name": "network-vif-plugged", "status": "completed", "tag": "d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:35.898833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bc17817a-705a-4a67-8525-ee294d0d7655 req-17ed0aca-5902-4f68-8419-146de9bedb0a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:35.899514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bc17817a-705a-4a67-8525-ee294d0d7655 req-17ed0aca-5902-4f68-8419-146de9bedb0a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:35.920150 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bc17817a-705a-4a67-8525-ee294d0d7655 req-17ed0aca-5902-4f68-8419-146de9bedb0a service nova] Creating event network-vif-plugged:d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f for instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 on nch2-master-1 Apr 09 21:22:35.926880 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-bc17817a-705a-4a67-8525-ee294d0d7655 req-17ed0aca-5902-4f68-8419-146de9bedb0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059906 Apr 09 21:22:35.928343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2811/5651] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:36.080715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:36.099475 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b16ad876-4f37-495e-b612-153e54b57de4 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.315928 Apr 09 21:22:36.100791 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2841/5652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:35 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:37.120167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:37.120959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:37.145223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:37.145968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:37.147954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:37.149691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:37.309307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:37.317285 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c4dfa0ab-add9-4f82-8b65-608ccae87342 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1314 microversion: 2.1 time: 0.203797 Apr 09 21:22:37.317828 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2812/5653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:37 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:38.334357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:38.335617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:38.344026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:38.344474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:38.345351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:38.345722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:38.540675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:38.550300 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f2e5436-5aa4-4211-9e7a-90497ed79bdf tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1499 microversion: 2.1 time: 0.219864 Apr 09 21:22:38.555794 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2842/5654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:38 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:39.014954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:39.015680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:39.029420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.030701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.045828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.046695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.301474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f147ecca-729c-4d0b-b698-833a7e259efd req-257cf3f9-72f9-4259-be45-45ba5f2d1d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:39.312171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f147ecca-729c-4d0b-b698-833a7e259efd req-257cf3f9-72f9-4259-be45-45ba5f2d1d73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.313301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f147ecca-729c-4d0b-b698-833a7e259efd req-257cf3f9-72f9-4259-be45-45ba5f2d1d73 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.327986 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f147ecca-729c-4d0b-b698-833a7e259efd req-257cf3f9-72f9-4259-be45-45ba5f2d1d73 service nova] Creating event network-changed:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:22:39.333909 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f147ecca-729c-4d0b-b698-833a7e259efd req-257cf3f9-72f9-4259-be45-45ba5f2d1d73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301603 Apr 09 21:22:39.339118 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2843/5655] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:39.345719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:39.346643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:39.354587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.357925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.359062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.359752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.362458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:39.377531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f8f65f2-744a-4b96-a473-29a7748849a5 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1563 microversion: 2.1 time: 0.366739 Apr 09 21:22:39.378428 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2813/5656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:39 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1563 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:39.435900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:22:39.577684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f78cd0bd-3429-42da-84e5-0847ac76cb39 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 204 len: 0 microversion: 2.1 time: 0.235413 Apr 09 21:22:39.579691 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2844/5657] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:22:39 2022] DELETE /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:22:39.590872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:39.591670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:39.599993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.600772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.602448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:39.603218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:39.831986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:39.841099 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2244976-966a-4ffb-a587-be635a4066a1 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1505 microversion: 2.1 time: 0.256688 Apr 09 21:22:39.842370 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2814/5658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:39 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:40.859590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:40.860262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:40.867727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:40.868175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:40.868964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:40.869401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:41.030289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:41.043654 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68364441-24a2-4a30-b42c-0b5b8f9ae49f tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1505 microversion: 2.1 time: 0.187440 Apr 09 21:22:41.044430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2845/5659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:40 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:42.061188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:42.061814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:42.068979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:42.069504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:42.070313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:42.070876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:42.135458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0b068a444b461cb5190024544c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542400bc91449e09c44d33b478c731e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:42.143064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff37edc6-8334-4939-99ae-3f5d61160688 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 200 len: 1463 microversion: 2.1 time: 0.086325 Apr 09 21:22:42.143655 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2815/5660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:42 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 1463 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:42.162531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-16b10f7a-b2f4-4d15-987e-c14a311533ff req-471d528c-d9b5-4392-8da9-b69e4d10c995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a8ce04-ceba-4fb0-9c00-50fcc75f6742", "name": "network-vif-deleted", "tag": "d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:42.172560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-16b10f7a-b2f4-4d15-987e-c14a311533ff req-471d528c-d9b5-4392-8da9-b69e4d10c995 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:42.173009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-16b10f7a-b2f4-4d15-987e-c14a311533ff req-471d528c-d9b5-4392-8da9-b69e4d10c995 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:42.184683 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-16b10f7a-b2f4-4d15-987e-c14a311533ff req-471d528c-d9b5-4392-8da9-b69e4d10c995 service nova] Creating event network-vif-deleted:d5cb5c8f-5d55-4144-a9d4-8f3c6044bd4f for instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 on nch2-master-1 Apr 09 21:22:42.190601 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-16b10f7a-b2f4-4d15-987e-c14a311533ff req-471d528c-d9b5-4392-8da9-b69e4d10c995 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Apr 09 21:22:42.191216 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2846/5661] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:43.170765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:43.172065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] [instance: a0a8ce04-ceba-4fb0-9c00-50fcc75f6742] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:43.179411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:43.180005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:43.180815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:43.181318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:43.198119 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] HTTP exception thrown: Instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 could not be found. Apr 09 21:22:43.198862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] Returning 404 to user: Instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:22:43.199932 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5cd64191-f253-47d9-ab7c-16cbfcaf9524 tempest-VolumesActionsTest-9294775 tempest-VolumesActionsTest-9294775-project] 10.222.0.30 "GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742" status: 404 len: 111 microversion: 2.1 time: 0.043771 Apr 09 21:22:43.200680 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2816/5662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:43 2022] GET /compute/v2.1/servers/a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:22:45.463757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:45.474968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:45.495292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:45.496410 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:45.497423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:45.499041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:45.759469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:45.768861 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b29b22fb-d8ec-45c9-96b2-c76169629f82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.568626 Apr 09 21:22:45.771371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2847/5663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:45 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:45.801410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:45.803952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:45.818548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:45.819348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:45.821843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:45.825515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:46.143686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:46.156437 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cd663ae6-f8e5-41c0-802d-f85a882e9e2e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.367969 Apr 09 21:22:46.157741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2817/5664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:45 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:46.181069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:46.181730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:46.192001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:46.192467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:46.195880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:46.196330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:46.394603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:46.404769 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2946771-bedb-4f49-89a3-360b3b862246 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.229388 Apr 09 21:22:46.406089 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2848/5665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:46.424324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:46.425768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:46.435288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:46.436368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:46.437547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:46.438226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:46.674730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:46.685353 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b140d7d3-655d-4b0e-8163-a7421eba072d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.267015 Apr 09 21:22:46.698755 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2818/5666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:46.751370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-822145426", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "fe7136e7-da4e-4ad5-bb48-0519f1b05f75"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:46.836136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] validate_networks() for [('fe7136e7-da4e-4ad5-bb48-0519f1b05f75', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:22:47.347757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:22:47.348203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:22:47.348661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:22:47.349098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:22:47.349517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:22:47.363765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:47.364222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:47.365024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:47.369804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:47.414195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:22:47.422214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:22:47.440315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:22:47.445200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:22:47.571276 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2bf62aba-eda1-49e1-8c8f-5144834b0171 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823693 Apr 09 21:22:47.572526 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2849/5667] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:22:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:22:47.584884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-938e0dea-a4b9-44bc-8e7f-96488bfb16db tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:47.586269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-938e0dea-a4b9-44bc-8e7f-96488bfb16db tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:47.666298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-938e0dea-a4b9-44bc-8e7f-96488bfb16db tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:47.678152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-938e0dea-a4b9-44bc-8e7f-96488bfb16db tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1214 microversion: 2.1 time: 0.099527 Apr 09 21:22:47.679198 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2819/5668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:47 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:48.705956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:48.711855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:48.761518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:48.763092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:48.764499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:48.768030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:48.912268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:48.921885 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1af99dd-8c28-4ab3-ac8c-6a9bd05cb816 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1266 microversion: 2.1 time: 0.229684 Apr 09 21:22:48.939385 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2850/5669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:48 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:49.946098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:49.947426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:49.967647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:49.968533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:49.969447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:49.970010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:50.189124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:50.198282 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5291937-55e9-4aa4-ac0a-274e4ccc4564 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1272 microversion: 2.1 time: 0.256707 Apr 09 21:22:50.198899 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2820/5670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:49 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:51.216077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:51.219319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:51.231671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:51.235071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:51.236122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:51.236766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:51.488694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e2d19579-9bab-4249-a2ce-471cbd6c9bbd req-acff80ca-3a28-4546-8ab3-b8ed689e325a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f883f-7277-4842-9e82-8800660e47b8", "tag": "b5a3ac69-c84b-4760-8e9e-4dc8686b3057"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:51.501183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d19579-9bab-4249-a2ce-471cbd6c9bbd req-acff80ca-3a28-4546-8ab3-b8ed689e325a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:51.507444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2d19579-9bab-4249-a2ce-471cbd6c9bbd req-acff80ca-3a28-4546-8ab3-b8ed689e325a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:51.544167 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e2d19579-9bab-4249-a2ce-471cbd6c9bbd req-acff80ca-3a28-4546-8ab3-b8ed689e325a service nova] Creating event network-changed:b5a3ac69-c84b-4760-8e9e-4dc8686b3057 for instance 1c6f883f-7277-4842-9e82-8800660e47b8 on nch2-master-1 Apr 09 21:22:51.556240 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e2d19579-9bab-4249-a2ce-471cbd6c9bbd req-acff80ca-3a28-4546-8ab3-b8ed689e325a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070181 Apr 09 21:22:51.557506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2821/5671] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:22:51.588420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:51.605719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d83a248d-46b6-4689-8731-b04870b3757a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.393231 Apr 09 21:22:51.620406 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2851/5672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:51 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:52.628590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:52.631073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:52.655500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:52.655500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:52.656022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:52.661933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:52.898064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:52.909398 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d51c765-971a-47d5-8b36-9fa9253a96f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.285193 Apr 09 21:22:52.923305 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2822/5673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:52 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:53.930309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:53.931672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:53.941551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:53.945914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:53.948461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:53.949407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:54.204246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:54.214500 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8dd34bb0-dd4d-4df5-bd90-40f2c0dd4449 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.288506 Apr 09 21:22:54.217288 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2852/5674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:53 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:55.233279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:55.234589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:55.241748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:55.242464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:55.243428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:55.244119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:55.682813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:55.706576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0d4fd084-7b46-4ce2-a976-225457be96cb tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.468653 Apr 09 21:22:55.721494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2823/5675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:55 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:56.729513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:56.730306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:56.750950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:56.751593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:56.752664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:56.756298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:57.101009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:57.109191 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b9301b36-9084-4bbe-b53c-7ab1de1b6139 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.386482 Apr 09 21:22:57.123641 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2853/5676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:56 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:57.819436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-59ceb6eb-dfe4-44f6-8b9e-9022642ac538 req-f8b0acec-117d-4317-9fa1-5085a99459de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6f883f-7277-4842-9e82-8800660e47b8", "name": "network-vif-plugged", "status": "completed", "tag": "b5a3ac69-c84b-4760-8e9e-4dc8686b3057"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:22:57.852605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-59ceb6eb-dfe4-44f6-8b9e-9022642ac538 req-f8b0acec-117d-4317-9fa1-5085a99459de service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:57.853743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-59ceb6eb-dfe4-44f6-8b9e-9022642ac538 req-f8b0acec-117d-4317-9fa1-5085a99459de service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:57.890060 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-59ceb6eb-dfe4-44f6-8b9e-9022642ac538 req-f8b0acec-117d-4317-9fa1-5085a99459de service nova] Creating event network-vif-plugged:b5a3ac69-c84b-4760-8e9e-4dc8686b3057 for instance 1c6f883f-7277-4842-9e82-8800660e47b8 on nch2-master-1 Apr 09 21:22:57.897329 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-59ceb6eb-dfe4-44f6-8b9e-9022642ac538 req-f8b0acec-117d-4317-9fa1-5085a99459de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082311 Apr 09 21:22:57.898606 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2824/5677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:22:58.130926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:58.131548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:58.147145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:58.147887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:58.149333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:58.150796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:58.395516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:58.404793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1284fdfe-7576-40bc-a234-9bee69f37e7b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.277677 Apr 09 21:22:58.416293 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2854/5678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:58 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:59.422843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:59.424984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:59.442102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:59.443516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:59.444498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:59.445212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:59.677417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:22:59.686417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82e98137-6f63-4ace-b5bb-0cb2237bd948 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1314 microversion: 2.1 time: 0.268782 Apr 09 21:22:59.687849 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2825/5679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:22:59 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:22:59.863579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:22:59.865061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:22:59.873511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:59.877752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:59.886328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:22:59.887181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:22:59.943669 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-afa918d5-9f8d-444f-bd35-262c9e9dfedd tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.085228 Apr 09 21:22:59.944437 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2855/5680] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Apr 9 21:22:59 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48/os-server-password => generated 116 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:23:00.703923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:00.704494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:00.714880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:00.715696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:00.716700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:00.717351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:01.155812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:01.164638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4b0015f-1145-4dfe-8e57-c134c00a777e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1502 microversion: 2.1 time: 0.464958 Apr 09 21:23:01.180272 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2826/5681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:00 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:01.186908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:01.187539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:01.201859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:01.202551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:01.205054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:01.205757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:01.958803 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.network.security_group_api [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Removing security group a9df2c23-89c8-4ed9-bfa8-98ca18fb413c from port b5a3ac69-c84b-4760-8e9e-4dc8686b3057 Apr 09 21:23:02.494242 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73c9857a-062e-4d3e-a5e5-56e674bdf4a1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8/action" status: 202 len: 0 microversion: 2.1 time: 1.312115 Apr 09 21:23:02.496588 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2856/5682] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:01 2022] POST /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8/action => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:02.506668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:02.507944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:02.517302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f4383f12-f5dc-4627-a0f2-389b7976d492 req-46d7e65b-6e94-497c-80c7-1ab7c7dbcf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f883f-7277-4842-9e82-8800660e47b8", "tag": "b5a3ac69-c84b-4760-8e9e-4dc8686b3057"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:02.542600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:02.543354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:02.546112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:02.547027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:02.553623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f4383f12-f5dc-4627-a0f2-389b7976d492 req-46d7e65b-6e94-497c-80c7-1ab7c7dbcf95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:02.556187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f4383f12-f5dc-4627-a0f2-389b7976d492 req-46d7e65b-6e94-497c-80c7-1ab7c7dbcf95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:02.629560 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f4383f12-f5dc-4627-a0f2-389b7976d492 req-46d7e65b-6e94-497c-80c7-1ab7c7dbcf95 service nova] Creating event network-changed:b5a3ac69-c84b-4760-8e9e-4dc8686b3057 for instance 1c6f883f-7277-4842-9e82-8800660e47b8 on nch2-master-1 Apr 09 21:23:02.656350 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f4383f12-f5dc-4627-a0f2-389b7976d492 req-46d7e65b-6e94-497c-80c7-1ab7c7dbcf95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145629 Apr 09 21:23:02.658267 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2857/5683] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:23:02.811610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:02.835994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d062d649-f42a-4c0b-94e0-f396281537f2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1460 microversion: 2.1 time: 0.334132 Apr 09 21:23:02.837186 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2827/5684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:02 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1460 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:02.854461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:02.855758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:02.879572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:02.881000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:02.882979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:02.884448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:03.239234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:03.272276 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8153fdd6-b2c0-464b-a72c-384f29511600 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.422804 Apr 09 21:23:03.273555 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2858/5685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:02 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:03.310578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:03.311202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:03.318230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:03.318879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:03.319701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:03.320146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:03.729686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:03.739192 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12b8fa47-8071-4b8a-97e1-e46e71c3e060 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.432489 Apr 09 21:23:03.740681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2828/5686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:03 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:03.757407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:03.758710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:03.766228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:03.766976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:03.768014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:03.768625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:03.989731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:03.998275 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-19fb397c-4fa7-4538-87cf-dcb8105b2187 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.245897 Apr 09 21:23:03.999649 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2859/5687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:03 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:04.015511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:04.016138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:04.022685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:04.023360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:04.025576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:04.026176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:04.225465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:04.233660 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fef2e58d-6b37-48a4-aea2-d451fb85f248 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.222010 Apr 09 21:23:04.235302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2829/5688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:04 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:04.412588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1668859299", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "fe7136e7-da4e-4ad5-bb48-0519f1b05f75"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:04.517509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] validate_networks() for [('fe7136e7-da4e-4ad5-bb48-0519f1b05f75', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:23:05.007439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:23:05.008584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:23:05.009314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:23:05.009896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:23:05.010479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:23:05.021272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:05.022108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:05.023097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:05.023717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:05.045623 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:23:05.052400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Getting quotas for user 1d343c69635a4412bf9ffcd9dec5c13b and project 006419bf3bf84fd6807cd78e0ad59ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:23:05.068075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:23:05.070440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:23:05.140533 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b834b22c-3084-46f1-a87b-a0460c5caa7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730511 Apr 09 21:23:05.149375 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2860/5689] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:23:05.153339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-135e9446-88ee-48be-89f5-fdf655475c55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:05.154800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-135e9446-88ee-48be-89f5-fdf655475c55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:05.279896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-135e9446-88ee-48be-89f5-fdf655475c55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:05.289093 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-135e9446-88ee-48be-89f5-fdf655475c55 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1215 microversion: 2.1 time: 0.140168 Apr 09 21:23:05.291848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2830/5690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:05 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:06.311535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:06.312241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:06.324067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:06.327175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:06.328358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:06.329569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:06.493279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:06.504215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f923c99f-f4b0-46da-8659-bce249d106ff tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1267 microversion: 2.1 time: 0.199745 Apr 09 21:23:06.506023 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2861/5691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:06 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:07.524426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:07.528360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:07.550864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:07.552281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:07.553711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:07.555952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:07.964939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:07.987742 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20922d62-9868-4a03-a1ae-f1e2c45dd6fd tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.467705 Apr 09 21:23:08.001028 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2831/5692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:07 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:08.772316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1890b348-165d-4ab2-bcec-7b6ff85ee7a3 req-1c3dd7ae-22e7-4d77-bba8-3c33f158c8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658e5528-192e-4773-a79b-f67aaf20a474", "tag": "b055bd43-61af-4b78-aac5-1c110e3caee6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:08.786684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1890b348-165d-4ab2-bcec-7b6ff85ee7a3 req-1c3dd7ae-22e7-4d77-bba8-3c33f158c8ee service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:08.787137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1890b348-165d-4ab2-bcec-7b6ff85ee7a3 req-1c3dd7ae-22e7-4d77-bba8-3c33f158c8ee service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:08.809619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1890b348-165d-4ab2-bcec-7b6ff85ee7a3 req-1c3dd7ae-22e7-4d77-bba8-3c33f158c8ee service nova] Creating event network-changed:b055bd43-61af-4b78-aac5-1c110e3caee6 for instance 658e5528-192e-4773-a79b-f67aaf20a474 on nch1-master-1 Apr 09 21:23:08.815564 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1890b348-165d-4ab2-bcec-7b6ff85ee7a3 req-1c3dd7ae-22e7-4d77-bba8-3c33f158c8ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048020 Apr 09 21:23:08.816439 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2862/5693] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:23:09.007250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:09.007887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:09.023275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:09.024221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:09.025269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:09.025883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:09.290501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:09.301213 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d6720483-75cb-4d9a-a9f7-3164a5fc6e04 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.297940 Apr 09 21:23:09.310984 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2832/5694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:09 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:10.159986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:10.161361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:10.168495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:10.169220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:10.170213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:10.170653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:10.227899 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7358216-c351-4b22-9455-7ce2d8d8cbb4 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action" status: 200 len: 24570 microversion: 2.1 time: 0.289538 Apr 09 21:23:10.229074 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2863/5695] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:09 2022] POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action => generated 24570 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:23:10.318746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:10.319288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:10.333080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:10.334027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:10.334821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:10.335263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:10.580619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:10.589163 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3625bae-f5e4-493c-b6ca-920515ec18aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.274469 Apr 09 21:23:10.589933 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2833/5696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:10 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:11.607030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:11.607734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:11.616421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:11.617203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:11.618271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:11.618913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:11.808111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:11.816024 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b4eb797c-0c76-41de-81e8-66272455bab8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.213167 Apr 09 21:23:11.816541 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2864/5697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:11 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:12.833324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:12.833959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:12.841002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:12.841448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:12.842238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:12.843149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:13.028949 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:13.038328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ade12e9-16d3-47ea-8ba0-213085caad99 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.208910 Apr 09 21:23:13.039169 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2834/5698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:12 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:14.060117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:14.061413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:14.069605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:14.070092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:14.070873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:14.071329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:14.215833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:14.224486 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d00a1360-cf26-4188-8d49-49a37c7f2fa0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.168180 Apr 09 21:23:14.224993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2865/5699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:14 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:14.358407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fbcb4a34-6f3a-454a-bc05-195c82cf95da req-a32abc42-6945-4ae0-bfb0-abaed78faaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658e5528-192e-4773-a79b-f67aaf20a474", "name": "network-vif-plugged", "status": "completed", "tag": "b055bd43-61af-4b78-aac5-1c110e3caee6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:14.367789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fbcb4a34-6f3a-454a-bc05-195c82cf95da req-a32abc42-6945-4ae0-bfb0-abaed78faaea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:14.368238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fbcb4a34-6f3a-454a-bc05-195c82cf95da req-a32abc42-6945-4ae0-bfb0-abaed78faaea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:14.380533 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fbcb4a34-6f3a-454a-bc05-195c82cf95da req-a32abc42-6945-4ae0-bfb0-abaed78faaea service nova] Creating event network-vif-plugged:b055bd43-61af-4b78-aac5-1c110e3caee6 for instance 658e5528-192e-4773-a79b-f67aaf20a474 on nch1-master-1 Apr 09 21:23:14.386388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fbcb4a34-6f3a-454a-bc05-195c82cf95da req-a32abc42-6945-4ae0-bfb0-abaed78faaea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031496 Apr 09 21:23:14.387303 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2835/5700] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:23:15.241536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:15.242213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:15.249552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:15.250193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:15.251181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:15.251627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:15.383835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:15.391506 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29a4020e-e39a-423e-a766-f4d4c60cb86d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1315 microversion: 2.1 time: 0.154228 Apr 09 21:23:15.392384 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2866/5701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:15 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:16.410853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:16.411637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:16.418357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.418800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.518907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.518907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.584388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:16.592228 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-29410f53-697c-405a-a7a8-12fa7141b64a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1502 microversion: 2.1 time: 0.186570 Apr 09 21:23:16.593134 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2836/5702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:16 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:16.609457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:16.610025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:16.617056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.617528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.618371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.618807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.691301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f4a2b0e8-eb0c-4472-8a38-285e0535b49f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474/action" status: 202 len: 0 microversion: 2.1 time: 0.085094 Apr 09 21:23:16.692107 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2867/5703] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:16 2022] POST /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:16.702684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:16.703378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:16.710484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.711130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.712373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:16.712891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:16.857820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:16.867003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-44677549-1fec-411b-ba38-2fa348bb8997 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1507 microversion: 2.1 time: 0.169852 Apr 09 21:23:16.867818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2837/5704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:16 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:17.884892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:17.885621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:17.893496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:17.893952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:17.894734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:17.895174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:18.034133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:18.041812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3e66510a-c077-4f68-8966-222a8cd3b695 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1487 microversion: 2.1 time: 0.161532 Apr 09 21:23:18.042388 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2868/5705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:17 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1487 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:18.058573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:18.059181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:18.066383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:18.066840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:18.067622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:18.068056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:18.091775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lazy-loading 'flavor' on Instance uuid 658e5528-192e-4773-a79b-f67aaf20a474 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:23:18.358158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-09ac27c3-7cc0-4474-b35d-a4d514f03960 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474/action" status: 202 len: 0 microversion: 2.1 time: 0.303411 Apr 09 21:23:18.359331 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2838/5706] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:18 2022] POST /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:18.367621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:18.368330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:18.374664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:18.375114 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:18.375895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:18.376435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:18.509330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:18.516875 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-93face33-6b61-4790-97b6-9030484e8552 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1493 microversion: 2.1 time: 0.153196 Apr 09 21:23:18.517478 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2869/5707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:18 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:19.535822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:19.536526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:19.543699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:19.544155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:19.544934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:19.545411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:19.685164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:19.692756 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1fcc3fb-4f56-43e2-bb3e-5538e0788b12 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1514 microversion: 2.1 time: 0.162188 Apr 09 21:23:19.693387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2839/5708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:19 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:20.711124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:20.711801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:20.719106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:20.719564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:20.720337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:20.720790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:20.860340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:20.868715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef5ab02d-4b55-4bc0-9361-63029370f990 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.161602 Apr 09 21:23:20.869580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2870/5709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:20 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:21.890535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:21.892076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:21.900381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:21.902035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:21.904694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:21.905800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:22.059069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:22.067385 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-67df5a0e-c20b-45bd-9c28-362e111a554b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.184385 Apr 09 21:23:22.068309 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2840/5710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:21 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:22.403699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9a1aa85b-7be9-4d67-828b-e8bf10218256 req-7798bc59-74b7-44b6-bf37-858ba0505406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658e5528-192e-4773-a79b-f67aaf20a474", "name": "network-vif-plugged", "status": "completed", "tag": "b055bd43-61af-4b78-aac5-1c110e3caee6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:22.413477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9a1aa85b-7be9-4d67-828b-e8bf10218256 req-7798bc59-74b7-44b6-bf37-858ba0505406 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:22.414344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9a1aa85b-7be9-4d67-828b-e8bf10218256 req-7798bc59-74b7-44b6-bf37-858ba0505406 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:22.432238 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9a1aa85b-7be9-4d67-828b-e8bf10218256 req-7798bc59-74b7-44b6-bf37-858ba0505406 service nova] Creating event network-vif-plugged:b055bd43-61af-4b78-aac5-1c110e3caee6 for instance 658e5528-192e-4773-a79b-f67aaf20a474 on nch1-master-1 Apr 09 21:23:22.438818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9a1aa85b-7be9-4d67-828b-e8bf10218256 req-7798bc59-74b7-44b6-bf37-858ba0505406 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039770 Apr 09 21:23:22.440371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2871/5711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:23:23.085017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:23.087267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:23.099745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:23.100332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:23.101412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:23.101921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:23.291703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:23.301162 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce3efa94-7f7d-4b76-924c-2ac2dd87ff64 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.219931 Apr 09 21:23:23.302172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2841/5712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:23 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:24.321730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:24.323037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:24.329858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:24.330472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:24.331413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:24.331846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:24.474285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:24.482792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0921111f-367b-4432-87c6-4d4248a425a7 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.167050 Apr 09 21:23:24.483700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2872/5713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:24 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:25.505866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:25.507767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:25.520137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:25.521104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:25.522156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:25.523127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:25.707834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:25.718926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-936cde33-dd31-4018-9442-d2ead9383d82 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.218461 Apr 09 21:23:25.720139 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2842/5714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:25 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:26.737051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:26.737667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:26.744795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:26.745272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:26.746302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:26.746939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:26.902852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:26.911023 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03dfada8-14af-492c-99e5-1ccfc7eb650d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.177888 Apr 09 21:23:26.912811 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2873/5715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:26 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:27.932143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:27.936019 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:27.943535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:27.944255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:27.945398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:27.946420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:28.494779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:28.504535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-667abcf9-35f4-42d0-a8ea-adb2750aa92a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.577374 Apr 09 21:23:28.505459 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2843/5716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:27 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:29.525179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:29.526508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:29.533816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:29.534471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:29.535386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:29.535828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:29.716306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:29.740811 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a8006cc2-f623-4356-9f09-f2e9ec624a66 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1509 microversion: 2.1 time: 0.219574 Apr 09 21:23:29.742836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2874/5717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:29 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:30.758723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:30.759348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:30.768330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:30.768769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:30.769908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:30.770408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:30.959314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:30.966975 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2ab45e66-6c0b-4f49-870c-800dca4c9ea2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1506 microversion: 2.1 time: 0.212420 Apr 09 21:23:30.967907 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2844/5718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:30 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:31.984512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:31.985090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:31.992427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:31.992985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:31.993805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:31.994247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:32.132462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:32.140286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dae56857-7c16-4c53-a116-359ebb1f6391 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1506 microversion: 2.1 time: 0.160009 Apr 09 21:23:32.140860 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2875/5719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:31 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:33.158694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:33.159423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:33.166091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.166544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.167325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.167770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.340713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:33.349402 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28d37ba5-f8a3-4e32-9db9-9e5ba19ed6b9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 200 len: 1449 microversion: 2.1 time: 0.194830 Apr 09 21:23:33.350001 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2845/5720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:33 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 1449 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:33.366005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:33.366543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:33.374134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.374593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.375369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.375985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.514690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:33.522260 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5502af63-fa21-4f7e-8080-46585c22be95 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.160426 Apr 09 21:23:33.522868 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2876/5721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:33 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:33.541690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:33.542438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:33.549794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.550564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.551463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.552024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.698843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:33.706790 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a37019e1-2c41-4a05-9b26-fdc5433068f4 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.169323 Apr 09 21:23:33.718059 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2846/5722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:33 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:33.724233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:33.724902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:33.732701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.733197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.734081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.734519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.871280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:33.878917 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f049c530-1e81-49ee-8949-a0f817efaee3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.159545 Apr 09 21:23:33.879498 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2877/5723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:33 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:33.895500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:33.896072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:33.902820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.903285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:33.904267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:33.904722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:34.074503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:34.083451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e930d068-10f0-4406-bfb8-61654641025f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.192206 Apr 09 21:23:34.084346 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2847/5724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:33 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:34.100678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1443e2c-a71f-41e5-8f9d-264f0139d9f9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:34.108448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1443e2c-a71f-41e5-8f9d-264f0139d9f9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:34.108907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1443e2c-a71f-41e5-8f9d-264f0139d9f9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:34.137578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1443e2c-a71f-41e5-8f9d-264f0139d9f9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Going to try to stop instance {{(pid=141818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:23:34.194261 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1443e2c-a71f-41e5-8f9d-264f0139d9f9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.097384 Apr 09 21:23:34.194858 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2878/5725] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:34 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:34.203083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:34.203706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:34.211257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:34.211830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:34.212739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:34.213308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:34.364640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:34.376096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f62f223e-77e9-480b-952c-33454b2e66c5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.176736 Apr 09 21:23:34.377286 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2848/5726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:34 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:34.384265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bd30d622-ac91-48d4-8c2b-7ed47bba7fe9 req-6cfdfdab-b896-4a2f-9ac4-dfdb9da62b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658e5528-192e-4773-a79b-f67aaf20a474", "name": "network-vif-unplugged", "status": "completed", "tag": "b055bd43-61af-4b78-aac5-1c110e3caee6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:34.395528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd30d622-ac91-48d4-8c2b-7ed47bba7fe9 req-6cfdfdab-b896-4a2f-9ac4-dfdb9da62b58 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:34.396011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd30d622-ac91-48d4-8c2b-7ed47bba7fe9 req-6cfdfdab-b896-4a2f-9ac4-dfdb9da62b58 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:34.408172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.compute.server_external_events [req-bd30d622-ac91-48d4-8c2b-7ed47bba7fe9 req-6cfdfdab-b896-4a2f-9ac4-dfdb9da62b58 service nova] Unable to find a host for instance 658e5528-192e-4773-a79b-f67aaf20a474. Dropping event network-vif-unplugged {{(pid=141818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 09 21:23:34.408989 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bd30d622-ac91-48d4-8c2b-7ed47bba7fe9 req-6cfdfdab-b896-4a2f-9ac4-dfdb9da62b58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029767 Apr 09 21:23:34.409977 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2879/5727] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 21:23:35.396083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:35.396781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:35.405988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:35.406447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:35.407197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:35.407665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:35.544865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:35.552566 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aa904edc-6c1d-4a73-8538-6ec6125a90d2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.161419 Apr 09 21:23:35.553241 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2849/5728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:35 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:36.573694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:36.574437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:36.581673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:36.582141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:36.582919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:36.583362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:36.727082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:36.735806 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d3463a1f-023c-4b9d-a7df-b994716b98ab tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.168367 Apr 09 21:23:36.736399 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2880/5729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:36 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:37.757421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:37.758458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:37.770298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:37.771061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:37.772341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:37.773099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:37.908754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:37.916557 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9fc06b89-8c1d-466d-a0a3-e818239c872d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.165854 Apr 09 21:23:37.917171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2850/5730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:37 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:38.934619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:38.935254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:38.947627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:38.947627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:38.947627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:38.947627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:39.074078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:39.082145 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81d2b866-5922-4aa4-ab76-0b61170f5a0d tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.152107 Apr 09 21:23:39.082707 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2881/5731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:38 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:40.105732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:40.106746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:40.118454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:40.119275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:40.120562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:40.121344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:40.267015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:40.275030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-edfc7326-973a-4be0-b45d-7c17351b786a tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.176123 Apr 09 21:23:40.275610 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2851/5732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:40 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:41.291972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:41.292886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:41.302007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:41.302716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:41.303839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:41.304481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:41.441118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:41.449214 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-beea092c-4d35-439a-aa02-e1c589c50eae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.161285 Apr 09 21:23:41.458951 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2882/5733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:41 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:42.470587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:42.471199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:42.478597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:42.479043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:42.479810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:42.480250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:42.611358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:42.619204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f0e85a8-2beb-49bc-9410-e1dc3cc10261 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.152992 Apr 09 21:23:42.619792 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2852/5734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:42 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:43.636778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:43.637431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:43.644635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:43.645084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:43.645895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:43.646333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:43.775018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:43.783032 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d49f38ec-da7c-4150-87ff-41e121bc5365 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1679 microversion: 2.1 time: 0.150319 Apr 09 21:23:43.783592 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2883/5735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:43 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:44.800198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:44.800791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:44.808313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:44.808775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:44.809607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:44.810052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:44.944309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:44.952606 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5367c26f-3202-4d94-90f3-2d5abe3e9ad8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1656 microversion: 2.1 time: 0.156443 Apr 09 21:23:44.953419 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2853/5736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:44 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:44.969863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ff7eeae-0008-4ce4-a5ea-2b77197126bc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:44.976950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff7eeae-0008-4ce4-a5ea-2b77197126bc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:44.977450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff7eeae-0008-4ce4-a5ea-2b77197126bc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:44.999715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2ff7eeae-0008-4ce4-a5ea-2b77197126bc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Going to try to start instance {{(pid=141818) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:23:45.045589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ff7eeae-0008-4ce4-a5ea-2b77197126bc tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.080064 Apr 09 21:23:45.046397 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2884/5737] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:44 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:45.054709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:45.055428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:45.061654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:45.062214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:45.063063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:45.063610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:45.238820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:45.247187 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-06093cbe-df2a-451e-90aa-467c8b57eda1 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1665 microversion: 2.1 time: 0.196381 Apr 09 21:23:45.247878 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2854/5738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:45 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1665 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:46.266330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:46.267047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:46.273587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.274040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.274830 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.275276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.410929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:46.418852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c110454c-c1df-428c-acf7-5de3eb0ff544 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.157861 Apr 09 21:23:46.419436 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2885/5739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:46.435785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:46.436470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:46.444308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.444797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.445610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.446050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.587013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:46.596013 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39466df8-e5ed-45c4-ad6e-3dec74dad0d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.163915 Apr 09 21:23:46.596130 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2855/5740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:46.613792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:46.614414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:46.620860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.621484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.622274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.622719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.756506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:46.764142 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5df245e1-253c-42a1-8b63-526c8070b1d8 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.154883 Apr 09 21:23:46.764766 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2886/5741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:46.780322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:46.780996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:46.787177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.787623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.788388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.788821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.930835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:46.938994 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5dbbc71-6166-407e-ab3a-11fc88502236 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.162633 Apr 09 21:23:46.939873 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2856/5742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:46.955958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:46.956575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:46.962707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.963158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:46.963927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:46.964369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:47.099599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:47.107357 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-663c65e9-e070-4b99-ba30-374e6973f8e9 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.155400 Apr 09 21:23:47.108138 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2887/5743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:46 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:47.123782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:47.124347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:47.130576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:47.131060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:47.131836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:47.132279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:47.155342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lazy-loading 'flavor' on Instance uuid c80f5bf1-19c1-477a-928a-d19693346060 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:23:47.227428 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18e5a44c-ec0c-4782-b1ca-27e8b745a4a0 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.107476 Apr 09 21:23:47.228146 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2857/5744] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:47 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:47.237351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:47.237960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:47.244442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:47.244980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:47.245968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:47.246455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:47.385272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:47.393241 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ad75688-020e-4e40-b32a-1481e16bb1aa tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1677 microversion: 2.1 time: 0.160069 Apr 09 21:23:47.393799 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2888/5745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:47 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:48.417374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:48.418525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:48.429456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.430205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.431487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.432228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.572945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:48.581369 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-91a23ce7-f8f6-48ed-ac40-1da4c7c62669 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1660 microversion: 2.1 time: 0.172762 Apr 09 21:23:48.581964 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2858/5746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:48 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:48.598591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:48.599087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:48.606332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.606793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.607578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.607996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.678676 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c1adf837-8e98-4136-8ce5-269c0b7ac243 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action" status: 202 len: 0 microversion: 2.1 time: 0.083915 Apr 09 21:23:48.679231 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2889/5747] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:48 2022] POST /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:23:48.687508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:48.688216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:48.694466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.694916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.695699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.696143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.923173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:48.930892 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7408072c-9e2e-4412-8e50-7d2d67915104 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1666 microversion: 2.1 time: 0.247318 Apr 09 21:23:48.931399 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2859/5748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:48 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1666 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:48.985736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:48.987549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:48.996119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.997128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:48.997723 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:48.998269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.086325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:23:49.086843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:23:49.087391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:23:49.087869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:23:49.088497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:23:49.154595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:49.162330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.163132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.163989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.164488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.206029 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-25fde8bf-f4a3-4205-a17a-7128ba566d28 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action" status: 202 len: 1136 microversion: 2.1 time: 0.225271 Apr 09 21:23:49.215781 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2890/5749] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:23:48 2022] POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action => generated 1136 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 09 21:23:49.221703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:49.222425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:49.239313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.239722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.240638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.241025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.463089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:49.471471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-548752b0-703e-4b77-bf6f-6739c14ce129 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.254507 Apr 09 21:23:49.472050 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2860/5750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:49 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:49.948261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:49.948904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:49.956430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.956884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:49.957697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:49.958138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:50.097955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:50.105932 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-946b02ca-a010-4be6-b4b7-a907e72c7bec tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1666 microversion: 2.1 time: 0.161817 Apr 09 21:23:50.106645 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2891/5751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:49 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:50.488919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:50.489650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:50.496739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:50.497439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:50.498293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:50.498744 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:50.632542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:50.640633 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9c435a6-0798-4f1d-acd0-effba5a9e9c0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.155655 Apr 09 21:23:50.649871 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2861/5752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:50 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:51.125238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:51.125858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:51.132851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.133335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.134106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.134576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.269968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:51.277855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2ccab13-b2ae-44b3-bbc0-b970c39a606b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.158091 Apr 09 21:23:51.278430 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2892/5753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:51 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:51.294536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:51.295152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:51.301907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.302353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.303296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.303728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.455016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:51.463572 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d3954a9-98a3-4bd8-983e-441a5fc6ed86 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1669 microversion: 2.1 time: 0.172910 Apr 09 21:23:51.464218 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2862/5754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:51 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:51.481782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:51.482282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:51.488531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.488979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.489778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.490212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.514247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:23:51.520081 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.api [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Working on deleting snapshot 1ec66fa6-c4b8-4d32-ad33-7493f6f97a35 from shelved instance... Apr 09 21:23:51.657290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:51.658129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:51.665066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.665512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.666291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:51.666727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:51.807341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:51.815463 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce8c5519-38c6-4a74-a861-e242d60af71e tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.162208 Apr 09 21:23:51.816136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2863/5755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:51 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:52.112466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Doing local delete in cell fbc693f8-01e5-424c-90ab-bdc183f2f901(cell1) {{(pid=141818) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 09 21:23:52.113560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:52.114023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:52.114455 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.api [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 09 21:23:52.118303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] deallocate_for_instance() {{(pid=141818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 09 21:23:52.614282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2996f175-34c3-4f01-b12d-426a9675c347 req-31a0690b-9764-40d9-93ce-48a8eaa8f01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658e5528-192e-4773-a79b-f67aaf20a474", "name": "network-vif-deleted", "tag": "b055bd43-61af-4b78-aac5-1c110e3caee6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:52.623299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Updating instance_info_cache with network_info: [] {{(pid=141818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 09 21:23:52.625880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2996f175-34c3-4f01-b12d-426a9675c347 req-31a0690b-9764-40d9-93ce-48a8eaa8f01a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:52.626787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2996f175-34c3-4f01-b12d-426a9675c347 req-31a0690b-9764-40d9-93ce-48a8eaa8f01a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:52.658602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.server_external_events [req-2996f175-34c3-4f01-b12d-426a9675c347 req-31a0690b-9764-40d9-93ce-48a8eaa8f01a service nova] Unable to find a host for instance 658e5528-192e-4773-a79b-f67aaf20a474. Dropping event network-vif-deleted {{(pid=141819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 09 21:23:52.659570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2996f175-34c3-4f01-b12d-426a9675c347 req-31a0690b-9764-40d9-93ce-48a8eaa8f01a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.050037 Apr 09 21:23:52.660213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2864/5756] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 21:23:52.838341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:52.840721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:52.849845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:52.850296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:52.852120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:52.852810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.034252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:53.049999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b42dda8a-3280-419a-9362-77de7691d4db tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.220262 Apr 09 21:23:53.053609 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4bd0c2d7-7e94-4338-85dd-201bf3cc8c0b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 204 len: 0 microversion: 2.1 time: 1.575493 Apr 09 21:23:53.054200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2893/5757] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:23:51 2022] DELETE /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 0 bytes in 1577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:23:53.057912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2865/5758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:52 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:53.062589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:53.063282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 658e5528-192e-4773-a79b-f67aaf20a474] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:53.069674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.070123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.070906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.071340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.084931 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance 658e5528-192e-4773-a79b-f67aaf20a474 could not be found. Apr 09 21:23:53.085581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 404 to user: Instance 658e5528-192e-4773-a79b-f67aaf20a474 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:23:53.086423 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f33b9f11-59d7-4e36-9ac4-2d2fa38f19f5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474" status: 404 len: 111 microversion: 2.1 time: 0.027879 Apr 09 21:23:53.086945 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2894/5759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:53 2022] GET /compute/v2.1/servers/658e5528-192e-4773-a79b-f67aaf20a474 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:23:53.096565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:53.097214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:53.103747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.104195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.104966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.105427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.131890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:23:53.216193 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da54892b-a90c-4860-a237-7dfb0d4e3562 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 204 len: 0 microversion: 2.1 time: 0.124415 Apr 09 21:23:53.217449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2866/5760] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:23:53 2022] DELETE /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:23:53.226356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:53.227050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:53.233418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.233916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.234693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:53.235133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:53.326517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:53.334672 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60ca71a3-a028-42a7-8cd9-56dee45bb054 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1466 microversion: 2.1 time: 0.112830 Apr 09 21:23:53.335739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2895/5761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:53 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1466 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:54.069208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:54.070074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:54.077960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:54.078487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:54.079483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:54.079998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:54.226939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:54.235407 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e11d7c23-aefb-42c5-a726-d42f977d076b tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.170983 Apr 09 21:23:54.236169 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2867/5762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:54 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:54.355484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:54.356131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:54.363154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:54.363584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:54.364367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:54.364805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:54.450129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:54.460097 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc87ccf9-7d69-47df-a53f-bf1a1d3a87e2 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1466 microversion: 2.1 time: 0.108807 Apr 09 21:23:54.460729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2896/5763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:54 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1466 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:55.180451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6e09e545-9121-4f1c-a56f-5292ea3ed8a0 req-10157edd-7033-4b8c-9949-63020a46195a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6f883f-7277-4842-9e82-8800660e47b8", "name": "network-vif-deleted", "tag": "b5a3ac69-c84b-4760-8e9e-4dc8686b3057"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:55.197430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6e09e545-9121-4f1c-a56f-5292ea3ed8a0 req-10157edd-7033-4b8c-9949-63020a46195a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.198161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6e09e545-9121-4f1c-a56f-5292ea3ed8a0 req-10157edd-7033-4b8c-9949-63020a46195a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.217386 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6e09e545-9121-4f1c-a56f-5292ea3ed8a0 req-10157edd-7033-4b8c-9949-63020a46195a service nova] Creating event network-vif-deleted:b5a3ac69-c84b-4760-8e9e-4dc8686b3057 for instance 1c6f883f-7277-4842-9e82-8800660e47b8 on nch2-master-1 Apr 09 21:23:55.222272 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6e09e545-9121-4f1c-a56f-5292ea3ed8a0 req-10157edd-7033-4b8c-9949-63020a46195a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Apr 09 21:23:55.223434 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2868/5764] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:23:55.253260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:55.253899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:55.267098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.267724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.268619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.269075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.423086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:55.431446 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe9eee7f-877c-4390-8d4b-140b6a0197f0 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.182712 Apr 09 21:23:55.432025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2897/5765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:55 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:55.478522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:55.479218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:55.486402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.486850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.487625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.488061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.518888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:55.519334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:55.519777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lazy-loading 'fault' on Instance uuid 1c6f883f-7277-4842-9e82-8800660e47b8 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:23:55.562190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:55.569543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-04fe1426-67fc-4157-b5c4-a1cb7c0c9879 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 200 len: 1304 microversion: 2.1 time: 0.095386 Apr 09 21:23:55.570437 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2869/5766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:55 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:56.448732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:56.449452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:56.458651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.459101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.460048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.460489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.587822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:56.588804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 1c6f883f-7277-4842-9e82-8800660e47b8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:56.597105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.597820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.598802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.599228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.614182 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance 1c6f883f-7277-4842-9e82-8800660e47b8 could not be found. Apr 09 21:23:56.615029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 404 to user: Instance 1c6f883f-7277-4842-9e82-8800660e47b8 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:23:56.615952 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2dd6a2f5-b8ab-468c-86a2-d6dbb6b3fff5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8" status: 404 len: 111 microversion: 2.1 time: 0.032692 Apr 09 21:23:56.616584 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2870/5767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:56 2022] GET /compute/v2.1/servers/1c6f883f-7277-4842-9e82-8800660e47b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:23:56.625023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:56.625564 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:56.632030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.632471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.633329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.633769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.659577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:23:56.669066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:56.677733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-452f5c81-1657-453a-b89b-a746ddad2d27 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.233017 Apr 09 21:23:56.687896 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2898/5768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:56 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:56.747719 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-263a7b86-5a42-4c2f-ad81-215a484a3245 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 204 len: 0 microversion: 2.1 time: 0.126383 Apr 09 21:23:56.748895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2871/5769] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:23:56 2022] DELETE /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:23:56.757282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:56.757975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:56.764069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.764523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.765319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:56.765758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:56.956100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:56.963673 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b400c93c-4824-4b70-8cea-bb7bfbae597b tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1507 microversion: 2.1 time: 0.210682 Apr 09 21:23:56.964242 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2899/5770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:56 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:23:57.696126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:57.696831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:57.704514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:57.704993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:57.705814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:57.706249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:57.841391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:57.849756 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b02b786-01c6-46ff-9ccc-ebad20fb1ff9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.158494 Apr 09 21:23:57.850343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2872/5771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:57 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:57.985708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:57.986649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:57.998450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:57.999386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:58.000655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:58.001364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:58.147891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:58.159271 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a13ffe73-53c2-4594-8e38-40c012b80ac5 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 200 len: 1507 microversion: 2.1 time: 0.179980 Apr 09 21:23:58.160085 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2900/5772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:57 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:58.679091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-dd43a717-a24b-4fd3-b5c7-6ce43e279c38 req-10bbd095-b892-4feb-9989-2a9ae8e6b603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308e8aed-6ba1-430a-9dd6-df71cb7944dc", "name": "network-vif-deleted", "tag": "5d28bac7-8d0f-4df8-9193-73d2a35e3756"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:23:58.691003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dd43a717-a24b-4fd3-b5c7-6ce43e279c38 req-10bbd095-b892-4feb-9989-2a9ae8e6b603 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:58.691743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dd43a717-a24b-4fd3-b5c7-6ce43e279c38 req-10bbd095-b892-4feb-9989-2a9ae8e6b603 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:58.707088 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-dd43a717-a24b-4fd3-b5c7-6ce43e279c38 req-10bbd095-b892-4feb-9989-2a9ae8e6b603 service nova] Creating event network-vif-deleted:5d28bac7-8d0f-4df8-9193-73d2a35e3756 for instance 308e8aed-6ba1-430a-9dd6-df71cb7944dc on nch2-master-1 Apr 09 21:23:58.712584 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-dd43a717-a24b-4fd3-b5c7-6ce43e279c38 req-10bbd095-b892-4feb-9989-2a9ae8e6b603 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038573 Apr 09 21:23:58.713884 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2873/5773] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:23:58.870651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:58.871548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:58.879299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:58.879747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:58.880519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:58.880954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.018365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:59.027833 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5d433be-b606-4e37-9469-030a5f967c40 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.163398 Apr 09 21:23:59.028690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2901/5774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:58 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:23:59.188505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:59.189277 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 308e8aed-6ba1-430a-9dd6-df71cb7944dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:59.200886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.201296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.202095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.202534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.217301 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance 308e8aed-6ba1-430a-9dd6-df71cb7944dc could not be found. Apr 09 21:23:59.217937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 404 to user: Instance 308e8aed-6ba1-430a-9dd6-df71cb7944dc could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:23:59.218785 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3c883f8d-ba9f-4cc7-8a52-4f503a4b5ae3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc" status: 404 len: 111 microversion: 2.1 time: 0.040558 Apr 09 21:23:59.219647 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2874/5775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:59 2022] GET /compute/v2.1/servers/308e8aed-6ba1-430a-9dd6-df71cb7944dc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:23:59.227931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:59.228497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:59.235356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.236007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.236835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.237298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.265804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:23:59.351622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f5390493-fa52-4da6-84c2-846ae35dae53 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 204 len: 0 microversion: 2.1 time: 0.127308 Apr 09 21:23:59.352322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2902/5776] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:23:59 2022] DELETE /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:23:59.360924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:23:59.361572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:23:59.367827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.368212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.368984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:23:59.369450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:23:59.506824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:23:59.515060 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d32a608-a84f-46d1-bb16-478cb728abae tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1495 microversion: 2.1 time: 0.158162 Apr 09 21:23:59.515823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2875/5777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:23:59 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1495 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:00.051847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:00.053021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:00.064499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:00.064944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:00.065780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:00.066232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:00.204904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:00.212955 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f5d8ee6a-3a37-447d-8ca3-69db8f4a4b9d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1691 microversion: 2.1 time: 0.168487 Apr 09 21:24:00.213574 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2903/5778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:00 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:00.532613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:00.533257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:00.540548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:00.540998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:00.541804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:00.542248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:00.682633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:00.690953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c167fcf-4d90-463d-8a2a-e3eafcc6e086 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 200 len: 1495 microversion: 2.1 time: 0.162355 Apr 09 21:24:00.691668 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2876/5779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:00 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 1495 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:01.171578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1229e200-c2ab-41de-bb24-f10366e752c9 req-52767cb1-9db3-4e4c-8687-3a9c929b4eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d3d125-8793-4775-bc5a-4b81540bfadf", "name": "network-vif-deleted", "tag": "835fc95d-b81f-432d-935d-e56a67be480d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:01.180682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1229e200-c2ab-41de-bb24-f10366e752c9 req-52767cb1-9db3-4e4c-8687-3a9c929b4eaa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.181167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1229e200-c2ab-41de-bb24-f10366e752c9 req-52767cb1-9db3-4e4c-8687-3a9c929b4eaa service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.193911 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1229e200-c2ab-41de-bb24-f10366e752c9 req-52767cb1-9db3-4e4c-8687-3a9c929b4eaa service nova] Creating event network-vif-deleted:835fc95d-b81f-432d-935d-e56a67be480d for instance 17d3d125-8793-4775-bc5a-4b81540bfadf on nch1-master-1 Apr 09 21:24:01.199317 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1229e200-c2ab-41de-bb24-f10366e752c9 req-52767cb1-9db3-4e4c-8687-3a9c929b4eaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Apr 09 21:24:01.200140 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2904/5780] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:01.231045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:01.231667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:01.238228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.238673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.239450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.240052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.380830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:01.388960 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b02c5ed4-b12a-40ce-9e29-b6a43da76611 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1697 microversion: 2.1 time: 0.161970 Apr 09 21:24:01.389512 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2877/5781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:01 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:24:01.708342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:01.709079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: 17d3d125-8793-4775-bc5a-4b81540bfadf] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:01.715778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.716250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.717412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.717874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.731570 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance 17d3d125-8793-4775-bc5a-4b81540bfadf could not be found. Apr 09 21:24:01.732171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 404 to user: Instance 17d3d125-8793-4775-bc5a-4b81540bfadf could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:24:01.733106 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ac6fc415-6701-4e26-8ad2-9a21615b970f tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf" status: 404 len: 111 microversion: 2.1 time: 0.029108 Apr 09 21:24:01.733656 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2905/5782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:01 2022] GET /compute/v2.1/servers/17d3d125-8793-4775-bc5a-4b81540bfadf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:24:01.742058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:01.743057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:01.750171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.750621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.751448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.752063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.780090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:24:01.863328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40fc0ac8-59e8-4f10-a060-2fb952634e40 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 204 len: 0 microversion: 2.1 time: 0.125151 Apr 09 21:24:01.863846 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2878/5783] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:24:01 2022] DELETE /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:24:01.872109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:01.872806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:01.879215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.879686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:01.880468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:01.880910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:02.014558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:02.022691 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e4bcb73-9b1c-495d-a27d-60bff7aae739 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1675 microversion: 2.1 time: 0.154629 Apr 09 21:24:02.023269 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2906/5784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:01 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:02.411219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:02.412032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:02.419314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:02.419822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:02.420680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:02.421218 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:02.555688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:02.566365 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e09dbd48-a6ac-49e3-92eb-2beb0294c712 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1697 microversion: 2.1 time: 0.161003 Apr 09 21:24:02.566957 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2879/5785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:02 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:03.040376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:03.040938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:03.048539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:03.048975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:03.049812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:03.050313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:03.189053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:03.196740 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e93a88c-201e-4f82-a5b8-3dbab2ce092c tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1675 microversion: 2.1 time: 0.160519 Apr 09 21:24:03.197379 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2907/5786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:03 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:03.584873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:03.586607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:03.594431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:03.595206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:03.596549 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:03.597830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:03.752609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:03.762014 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82c6da8b-fb3d-4251-8296-21d52b00f07d tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1697 microversion: 2.1 time: 0.181531 Apr 09 21:24:03.763379 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2880/5787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:03 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:04.217095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:04.218545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:04.225736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:04.226481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:04.227436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:04.228277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:04.699591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:04.708541 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d289610d-422d-4255-a363-d650bb324299 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1675 microversion: 2.1 time: 0.497475 Apr 09 21:24:04.709606 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2908/5788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:04 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1675 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:04.781301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:04.782535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:04.792170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:04.792735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:04.793694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:04.794199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.058360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:05.086156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f55072f-cd49-48b1-89ab-1e85c731ddb3 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1697 microversion: 2.1 time: 0.309943 Apr 09 21:24:05.087287 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2881/5789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:04 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1697 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:05.344494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bf098413-2ec3-4e02-89e3-cde329216085 req-166e701c-bb9e-4fe3-8c95-533bac81e783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80f5bf1-19c1-477a-928a-d19693346060", "name": "network-vif-deleted", "tag": "2e3b4af2-dfb3-4068-9bd9-69c858e1156a"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:05.354938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bf098413-2ec3-4e02-89e3-cde329216085 req-166e701c-bb9e-4fe3-8c95-533bac81e783 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:05.355383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bf098413-2ec3-4e02-89e3-cde329216085 req-166e701c-bb9e-4fe3-8c95-533bac81e783 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.369162 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bf098413-2ec3-4e02-89e3-cde329216085 req-166e701c-bb9e-4fe3-8c95-533bac81e783 service nova] Creating event network-vif-deleted:2e3b4af2-dfb3-4068-9bd9-69c858e1156a for instance c80f5bf1-19c1-477a-928a-d19693346060 on nch1-master-1 Apr 09 21:24:05.374521 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bf098413-2ec3-4e02-89e3-cde329216085 req-166e701c-bb9e-4fe3-8c95-533bac81e783 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034148 Apr 09 21:24:05.375157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2909/5790] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:05.726368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:05.727421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:05.734195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:05.734790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.735664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:05.736175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.768721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:05.769209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.769675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lazy-loading 'fault' on Instance uuid c80f5bf1-19c1-477a-928a-d19693346060 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:24:05.817449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d343c69635a4412bf9ffcd9dec5c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006419bf3bf84fd6807cd78e0ad59ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:05.826444 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95287de0-2242-4c6d-80bd-830a760e3290 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 200 len: 1327 microversion: 2.1 time: 0.104213 Apr 09 21:24:05.827279 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2882/5791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:05 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:05.948190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f8172c6c-b712-4d12-81ea-31de363671c3 req-f02c0a84-2698-4d24-b7d1-0115ad913e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "name": "network-vif-plugged", "status": "completed", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:05.957079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f8172c6c-b712-4d12-81ea-31de363671c3 req-f02c0a84-2698-4d24-b7d1-0115ad913e36 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:05.957595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f8172c6c-b712-4d12-81ea-31de363671c3 req-f02c0a84-2698-4d24-b7d1-0115ad913e36 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:05.970675 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f8172c6c-b712-4d12-81ea-31de363671c3 req-f02c0a84-2698-4d24-b7d1-0115ad913e36 service nova] Creating event network-vif-plugged:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:24:05.975873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f8172c6c-b712-4d12-81ea-31de363671c3 req-f02c0a84-2698-4d24-b7d1-0115ad913e36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031957 Apr 09 21:24:05.976690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2910/5792] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:06.104953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:06.105600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:06.112895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:06.113538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:06.114510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:06.115127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:06.261783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:06.271370 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99e595c8-2e4c-475f-9b69-c949128e1074 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1682 microversion: 2.1 time: 0.170808 Apr 09 21:24:06.273912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2883/5793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:06 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:06.844777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:06.845609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] [instance: c80f5bf1-19c1-477a-928a-d19693346060] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:06.853925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:06.854455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:06.855247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:06.855918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:06.870313 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] HTTP exception thrown: Instance c80f5bf1-19c1-477a-928a-d19693346060 could not be found. Apr 09 21:24:06.870902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Returning 404 to user: Instance c80f5bf1-19c1-477a-928a-d19693346060 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:24:06.871737 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-801ecdd9-9ba8-4d64-9803-8e47ea7119b3 tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060" status: 404 len: 111 microversion: 2.1 time: 0.031719 Apr 09 21:24:06.872263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2911/5794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:06 2022] GET /compute/v2.1/servers/c80f5bf1-19c1-477a-928a-d19693346060 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:24:06.882895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a59ab95-a883-4b8c-9774-2c142f364c7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] Calling method '.version_select at 0x7fb08e2153a0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:06.904886 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a59ab95-a883-4b8c-9774-2c142f364c7e tempest-ServerActionsTestJSON-375846324 tempest-ServerActionsTestJSON-375846324-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622713950" status: 202 len: 0 microversion: 2.1 time: 0.027562 Apr 09 21:24:06.905543 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2884/5795] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Apr 9 21:24:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622713950 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:24:16.778741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1322394752", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:16.832534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] validate_networks() for [('2f52a1e4-3925-4b00-a16d-87446569ec30', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:24:17.274071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:24:17.274618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:24:17.275221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:24:17.275701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:24:17.276230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:24:17.288873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:17.289852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:17.291098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:17.291732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:17.312454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Getting quotas for project 506378df4d4d4d4b9c0ea0412d234503. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:24:17.318361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Getting quotas for user de25902bda8c4346a4bb7e70e38175fb and project 506378df4d4d4d4b9c0ea0412d234503. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:24:17.333321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:24:17.335829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:24:17.385088 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b587cbe6-c1a0-4ec1-89b9-fbb0fd00c0b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.727510 Apr 09 21:24:17.385743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2912/5796] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:24:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:24:17.396929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba8814cf-04ae-4fca-b726-b30209f3abac tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:17.398122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba8814cf-04ae-4fca-b726-b30209f3abac tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:17.470016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba8814cf-04ae-4fca-b726-b30209f3abac tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:17.477125 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba8814cf-04ae-4fca-b726-b30209f3abac tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1214 microversion: 2.1 time: 0.085099 Apr 09 21:24:17.477914 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2885/5797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:17 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:18.508806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:18.511119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:18.524994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:18.526569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:18.527987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:18.528808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:18.652909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:18.661473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31978b1b-6223-4ad8-8497-28bc3460de19 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1284 microversion: 2.1 time: 0.169872 Apr 09 21:24:18.662063 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2913/5798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:18 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:19.682510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:19.684789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:19.703609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:19.704073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:19.720991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:19.723065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:19.930515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:19.939090 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e41601f-88d1-4f6f-b7b6-fcf5d2c7fa18 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.264092 Apr 09 21:24:19.939704 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2886/5799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:19 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:20.244892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d39d3318-b1f1-4fc7-8f60-7a9bbfae3c16 req-9e457cde-6568-428e-a015-617fa37f55da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2691ac-0e55-4daf-8313-ab50b608183f", "tag": "b5a168b3-cc62-4ece-9177-61870d9ab1a5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:20.256375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d39d3318-b1f1-4fc7-8f60-7a9bbfae3c16 req-9e457cde-6568-428e-a015-617fa37f55da service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:20.256837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d39d3318-b1f1-4fc7-8f60-7a9bbfae3c16 req-9e457cde-6568-428e-a015-617fa37f55da service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:20.271091 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d39d3318-b1f1-4fc7-8f60-7a9bbfae3c16 req-9e457cde-6568-428e-a015-617fa37f55da service nova] Creating event network-changed:b5a168b3-cc62-4ece-9177-61870d9ab1a5 for instance 2a2691ac-0e55-4daf-8313-ab50b608183f on nch1-master-1 Apr 09 21:24:20.277011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d39d3318-b1f1-4fc7-8f60-7a9bbfae3c16 req-9e457cde-6568-428e-a015-617fa37f55da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035627 Apr 09 21:24:20.284322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2914/5800] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:20.956234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:20.956941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:20.965145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:20.965606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:20.966747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:20.967186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:21.151646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:21.160937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a29d717d-7506-4a2d-9dea-d2af9823494d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.208558 Apr 09 21:24:21.162406 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2887/5801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:20 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:22.179281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:22.179967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:22.187465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:22.187944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:22.188765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:22.189238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:22.320197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:22.328339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad7d5a75-563a-48b5-a81a-95e34f0fab03 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.153600 Apr 09 21:24:22.328981 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2915/5802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:22 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:23.349947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:23.350884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:23.358374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:23.358822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:23.359592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:23.360027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:23.503046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:23.514417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9d20d68-20ed-4f16-8442-89d82316195d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.171047 Apr 09 21:24:23.515140 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2888/5803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:23 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:24.534453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:24.535203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:24.543516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:24.544222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:24.545025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:24.545503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:24.676208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:24.685198 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7e1c3abb-b15f-4a31-af75-7374a584af44 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.154735 Apr 09 21:24:24.685792 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2916/5804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:24 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:24.723475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-05bd8996-25b1-4475-8123-23e70c31df7e req-bdd6bb7e-031f-4219-8cd0-cad014f1633d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2691ac-0e55-4daf-8313-ab50b608183f", "name": "network-vif-plugged", "status": "completed", "tag": "b5a168b3-cc62-4ece-9177-61870d9ab1a5"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:24.732920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-05bd8996-25b1-4475-8123-23e70c31df7e req-bdd6bb7e-031f-4219-8cd0-cad014f1633d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:24.733535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-05bd8996-25b1-4475-8123-23e70c31df7e req-bdd6bb7e-031f-4219-8cd0-cad014f1633d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:24.748618 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-05bd8996-25b1-4475-8123-23e70c31df7e req-bdd6bb7e-031f-4219-8cd0-cad014f1633d service nova] Creating event network-vif-plugged:b5a168b3-cc62-4ece-9177-61870d9ab1a5 for instance 2a2691ac-0e55-4daf-8313-ab50b608183f on nch1-master-1 Apr 09 21:24:24.753853 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-05bd8996-25b1-4475-8123-23e70c31df7e req-bdd6bb7e-031f-4219-8cd0-cad014f1633d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034104 Apr 09 21:24:24.754497 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2889/5805] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:25.702588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:25.703215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:25.710152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:25.710617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:25.711408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:25.711928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:25.860016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:25.869752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd0a9587-4061-437f-ac6d-6637958a3494 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1314 microversion: 2.1 time: 0.171038 Apr 09 21:24:25.870445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2917/5806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:25 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:26.888304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:26.888916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:26.897573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:26.898032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:26.898833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:26.899343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:27.056378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:27.068105 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f52c77d-62f9-4a2a-a928-c13959be449d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1500 microversion: 2.1 time: 0.185097 Apr 09 21:24:27.068867 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2890/5807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:26 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1500 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:27.084876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:27.086336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:27.093936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:27.094393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:27.095172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:27.095614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:27.122574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lazy-loading 'flavor' on Instance uuid 2a2691ac-0e55-4daf-8313-ab50b608183f {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:24:27.198189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff2fa9b2-e3ce-41d0-adce-ba7fa00c1d34 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "POST /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f/action" status: 200 len: 32 microversion: 2.1 time: 0.117444 Apr 09 21:24:27.203027 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2918/5808] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:24:27 2022] POST /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:24:27.208630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:27.209367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:27.216621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:27.217153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:27.217943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:27.218540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:27.443995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:27.458255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f630622-a690-4662-bcae-bf0f01589f86 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.253857 Apr 09 21:24:27.458859 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2891/5809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:27 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:28.477620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:28.478318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:28.485449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:28.485901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:28.486684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:28.487125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:28.620622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:28.628400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-309c49f7-f964-4f5a-9512-7e49d08a78c2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.156113 Apr 09 21:24:28.628989 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2919/5810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:28 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:29.645912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:29.646535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:29.654037 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:29.654500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:29.655287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:29.655739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:29.790719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:29.800310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b000be7-5931-4358-af8b-c5e48225aab5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.158391 Apr 09 21:24:29.801069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2892/5811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:29 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:30.818822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:30.819578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:30.827878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:30.828643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:30.829884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:30.830675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:30.965343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:30.973459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-251d9acc-056c-48d3-9e2a-174b301c6af6 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.159418 Apr 09 21:24:30.974071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2920/5812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:30 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:31.995131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:31.996137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:32.007623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:32.008387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:32.009789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:32.010540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:32.145905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:32.154063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fba67a5c-f829-4aa4-b80b-a7511c298b0d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.165765 Apr 09 21:24:32.154656 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2893/5813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:31 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:33.175605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:33.176611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:33.188234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:33.188984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:33.190300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:33.191024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:33.324233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:33.332154 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-530d576a-6473-46a0-9132-d90eb1bbef1b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.163182 Apr 09 21:24:33.332736 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2921/5814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:33 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:34.349920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:34.350729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:34.358015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:34.358470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:34.359378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:34.359994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:34.495050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:34.502825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b56a8a0-be73-4f5a-899f-24c605e2f434 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.156938 Apr 09 21:24:34.503410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2894/5815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:34 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:35.520042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:35.520657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:35.527794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:35.528259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:35.529063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:35.529539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:35.671450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:35.683563 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1eb27a0-8381-40d8-8582-b27263cf8552 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.167382 Apr 09 21:24:35.684289 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2922/5816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:35 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:36.700656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:36.701247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:36.709209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:36.709660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:36.710496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:36.710932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:36.845561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:36.857497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d5b0d0f-f392-4217-9d13-8c6e22565607 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.160431 Apr 09 21:24:36.858202 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2895/5817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:36 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:37.879297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:37.880325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:37.890968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:37.891432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:37.892219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:37.892666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:38.026488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:38.034733 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7f7785a-f72e-40ab-b4bd-3b97434e93d5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.162204 Apr 09 21:24:38.035320 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2923/5818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:37 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:39.054414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:39.055160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:39.062469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:39.063005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:39.064043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:39.064547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:39.203145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:39.210875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c2505fa-949e-4ac5-8c1d-bdf466b2f660 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.160893 Apr 09 21:24:39.211490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2896/5819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:39 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:40.228099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:40.228611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:40.235879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:40.236362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:40.237181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:40.237631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:40.425063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:40.432839 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3e1b802b-c2e6-4501-815f-7274e3b73c42 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.208883 Apr 09 21:24:40.433553 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2924/5820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:40 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:41.454418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:41.455041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:41.462320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:41.462774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:41.463555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:41.463999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:41.602425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:41.611571 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-566fced7-8131-4a6e-8192-6b6a2075bae4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.163793 Apr 09 21:24:41.612172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2897/5821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:41 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:42.632877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:42.633927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:42.650784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:42.650784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:42.650784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:42.650784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:42.789260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:42.797353 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd8a89fe-f2a8-4a0b-8932-e1da02f56725 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.171058 Apr 09 21:24:42.797988 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2925/5822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:42 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:43.816983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:43.817612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:43.826694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:43.827281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:43.828182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:43.828907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:43.963899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:43.972295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de554fe8-5cb0-4b81-a178-975b012e03b4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.160726 Apr 09 21:24:43.972877 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2898/5823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:43 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:44.991288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:44.992059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:45.001176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:45.001636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:45.002416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:45.002859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:45.139903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:45.149362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab48081a-f9f1-4483-b173-047ecf46d676 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.162674 Apr 09 21:24:45.150257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2926/5824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:44 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:46.176249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:46.176859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:46.186221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:46.186706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:46.187686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:46.188141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:46.335038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:46.344094 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0560c59a-9790-4dfb-b690-55c9e1ec73d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.173486 Apr 09 21:24:46.344864 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2899/5825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:46 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:47.363415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:47.363972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:47.371223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:47.371662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:47.372463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:47.372906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:47.511666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:47.521348 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6801464-745c-417b-a15f-65d9ba36b6b7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.162097 Apr 09 21:24:47.521937 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2927/5826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:47 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:48.539178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:48.539749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:48.547306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:48.547763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:48.548555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:48.548993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:48.686453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:48.695786 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dacdc2a3-54e9-4c3c-896e-e68cc6319cb4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.160642 Apr 09 21:24:48.696412 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2900/5827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:48 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:49.717909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:49.718937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:49.730695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:49.731460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:49.732770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:49.733560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:49.863967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:49.872324 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ed0f111-f470-43be-a0ed-f06ca4480def tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.161697 Apr 09 21:24:49.872913 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2928/5828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:49 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:50.889741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:50.890336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:50.897778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:50.898229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:50.898997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:50.899432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:51.029908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:51.037619 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0cb97849-3307-4c27-9cba-fe0ad22b57d3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.151920 Apr 09 21:24:51.038242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2901/5829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:50 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:52.058775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:52.059794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:52.071315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:52.072062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:52.073395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:52.074128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:52.568078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:52.576563 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5ee598d-cb9b-4bec-bb36-10872f04226c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.524469 Apr 09 21:24:52.577215 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2929/5830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:52 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:53.598530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:53.599493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:53.610694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:53.611429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:53.612238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:53.612666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:53.749178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:53.757235 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4179ec69-587f-4055-bc9a-9761646e9777 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.165638 Apr 09 21:24:53.757819 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2902/5831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:53 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:54.774311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:54.775091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:54.782247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:54.782671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:54.783477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:54.783907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:54.925888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:54.934584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2a48091-e69a-41d0-8b76-c23a60960e12 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1506 microversion: 2.1 time: 0.164234 Apr 09 21:24:54.935394 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2930/5832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:54 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:55.956169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:55.957439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:55.969313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:55.970061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:55.971136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:55.971571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:56.100055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:56.107887 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5fc1ea04-3f5a-4d09-87a4-85e142b9cc7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1486 microversion: 2.1 time: 0.158379 Apr 09 21:24:56.108473 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2903/5833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:55 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1486 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:56.216399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-608069725", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:56.268219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] validate_networks() for [('2f52a1e4-3925-4b00-a16d-87446569ec30', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:24:56.655845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:24:56.656269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:24:56.656743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:24:56.657194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:24:56.657643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:24:56.667295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:56.667748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:56.668556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:56.668991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:56.686181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Getting quotas for project 506378df4d4d4d4b9c0ea0412d234503. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:24:56.692200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Getting quotas for user de25902bda8c4346a4bb7e70e38175fb and project 506378df4d4d4d4b9c0ea0412d234503. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:24:56.705227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:24:56.707527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:24:56.753668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-21675c26-5b04-40e9-b8ad-8b4b7c1f7c7c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.542020 Apr 09 21:24:56.754316 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2931/5834] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:24:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:24:56.764559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8a41387-81fd-424f-9bb4-86a1d697adc7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:56.765295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8a41387-81fd-424f-9bb4-86a1d697adc7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:56.821520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8a41387-81fd-424f-9bb4-86a1d697adc7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:56.828426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8a41387-81fd-424f-9bb4-86a1d697adc7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1213 microversion: 2.1 time: 0.067950 Apr 09 21:24:56.829022 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2904/5835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:56 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:57.846852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:57.848219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:57.857578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:57.858037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:57.858834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:57.859276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:57.957604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:57.965310 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a9192d57-6f72-4aa0-ac79-05968e650526 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1271 microversion: 2.1 time: 0.123507 Apr 09 21:24:57.966216 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2932/5836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:57 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:24:58.983495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:24:58.984120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:24:58.992556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:58.993635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:58.994553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:58.995111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:58.998080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ad9be802-c1b3-4a0d-844f-9b4162f4a1eb req-b0959db5-6fe2-45f3-bf8e-1b2ab9560d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6771f47a-553f-460b-90ef-8d0a7d46ba1c", "tag": "290f14ae-e9a8-485b-8617-6e1c36174913"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:24:59.009395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ad9be802-c1b3-4a0d-844f-9b4162f4a1eb req-b0959db5-6fe2-45f3-bf8e-1b2ab9560d37 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:24:59.009836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ad9be802-c1b3-4a0d-844f-9b4162f4a1eb req-b0959db5-6fe2-45f3-bf8e-1b2ab9560d37 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:24:59.022211 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ad9be802-c1b3-4a0d-844f-9b4162f4a1eb req-b0959db5-6fe2-45f3-bf8e-1b2ab9560d37 service nova] Creating event network-changed:290f14ae-e9a8-485b-8617-6e1c36174913 for instance 6771f47a-553f-460b-90ef-8d0a7d46ba1c on nch2-master-1 Apr 09 21:24:59.028290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ad9be802-c1b3-4a0d-844f-9b4162f4a1eb req-b0959db5-6fe2-45f3-bf8e-1b2ab9560d37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036709 Apr 09 21:24:59.029746 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2933/5837] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:24:59.138236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:24:59.146172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f36828f8-fe23-4a40-a291-2c8ba26f0379 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.166933 Apr 09 21:24:59.152329 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2905/5838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:24:58 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:00.169720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:00.170868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:00.179733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:00.180189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:00.180971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:00.181447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:00.325112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:00.336632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7cb194de-3590-4a02-ba22-dbc7c9ad2829 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.175089 Apr 09 21:25:00.337560 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2934/5839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:00 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:01.361876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:01.362848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:01.374352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:01.375104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:01.376428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:01.377324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:01.526301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:01.534336 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbd26667-8a03-4bcf-8606-fb359d47c3d7 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.179171 Apr 09 21:25:01.535025 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2906/5840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:01 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:02.552133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:02.552694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:02.559813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:02.560268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:02.561021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:02.561520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:02.933326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:02.941257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfe5f7ea-c0d7-4ed6-9466-afb95b0306b3 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.393147 Apr 09 21:25:02.941838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2935/5841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:02 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:03.958506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:03.959184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:03.966128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:03.966617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:03.967357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:03.967804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:04.040885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-79fef846-9a7b-4802-9d0a-3b604d4b1ee4 req-6dd7efa3-4169-47cd-a2be-47dd7a1430e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6771f47a-553f-460b-90ef-8d0a7d46ba1c", "name": "network-vif-plugged", "status": "completed", "tag": "290f14ae-e9a8-485b-8617-6e1c36174913"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:04.050679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-79fef846-9a7b-4802-9d0a-3b604d4b1ee4 req-6dd7efa3-4169-47cd-a2be-47dd7a1430e2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:04.051119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-79fef846-9a7b-4802-9d0a-3b604d4b1ee4 req-6dd7efa3-4169-47cd-a2be-47dd7a1430e2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:04.062934 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-79fef846-9a7b-4802-9d0a-3b604d4b1ee4 req-6dd7efa3-4169-47cd-a2be-47dd7a1430e2 service nova] Creating event network-vif-plugged:290f14ae-e9a8-485b-8617-6e1c36174913 for instance 6771f47a-553f-460b-90ef-8d0a7d46ba1c on nch2-master-1 Apr 09 21:25:04.068389 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-79fef846-9a7b-4802-9d0a-3b604d4b1ee4 req-6dd7efa3-4169-47cd-a2be-47dd7a1430e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Apr 09 21:25:04.069297 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2936/5842] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:25:04.100303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:04.109522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3166dba-bf68-4136-a43a-7830932cf82a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.154865 Apr 09 21:25:04.110132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2907/5843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:03 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:05.128465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:05.129207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:05.136133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:05.136597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:05.137433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:05.137885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:05.278146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:05.286574 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-795c25a0-84d9-4bdd-a521-4d265fef362a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1313 microversion: 2.1 time: 0.163388 Apr 09 21:25:05.287175 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2937/5844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:05 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:06.308221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:06.309228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:06.319009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.319459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.320228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.320661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.516314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:06.523854 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-615a7454-4bcb-4a00-b97c-a4e2af4fd96c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1499 microversion: 2.1 time: 0.222426 Apr 09 21:25:06.524438 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2908/5845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:06 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1499 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:06.540610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:06.541604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:06.548487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.548943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.549741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.550184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.574401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lazy-loading 'flavor' on Instance uuid 6771f47a-553f-460b-90ef-8d0a7d46ba1c {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:25:06.653380 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12c0cdfe-d067-4b53-a986-734dd24a2961 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "POST /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c/action" status: 200 len: 32 microversion: 2.1 time: 0.116691 Apr 09 21:25:06.654169 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2938/5846] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:25:06 2022] POST /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:25:06.663317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:06.663938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:06.670062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.670541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.671289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:06.671780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:06.801148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:06.808648 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae250f9b-b57c-44e4-a2a7-18a34dc018ef tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.149381 Apr 09 21:25:06.809295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2909/5847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:06 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:07.826477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:07.827193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:07.834813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:07.835274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:07.836063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:07.836512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:07.974055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:07.981914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a9f36a6-b891-4222-a8d8-677623f9b793 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.159897 Apr 09 21:25:07.982546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2939/5848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:07 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:09.003480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:09.004534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:09.015860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:09.016608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:09.017943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:09.018659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:09.158611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:09.166279 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-318dc406-d569-4d06-aea4-8d51cc3b7be1 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.169443 Apr 09 21:25:09.166887 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2910/5849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:08 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:10.188273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:10.189291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:10.197388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:10.197842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:10.198615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:10.199048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:10.333382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:10.345009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd74c1b3-f1fa-4879-a3d2-2561e073c33e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.163069 Apr 09 21:25:10.345845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2940/5850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:10 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:11.367279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:11.368811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:11.380036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:11.380776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:11.382107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:11.382816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:11.540626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:11.548904 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-afac093f-ef87-4c81-8927-2d44c487ee02 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.188472 Apr 09 21:25:11.549533 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2911/5851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:11 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:12.576092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:12.577112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:12.588641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:12.589476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:12.591217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:12.591956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:12.735706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:12.744284 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-540a0767-2f7c-433a-b9bd-d908f6e7c11a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.174771 Apr 09 21:25:12.744876 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2941/5852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:12 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:13.766069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:13.767010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:13.775168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:13.775627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:13.776400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:13.776839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:13.914193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:13.921743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3991420b-e6db-486a-9d6e-31112631267a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.162545 Apr 09 21:25:13.922328 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2912/5853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:13 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:14.942585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:14.943518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:14.954456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:14.955161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:14.956353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:14.957060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:15.100717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:15.108396 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90c193e5-1b13-4098-9f16-4e48c89686cb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.172175 Apr 09 21:25:15.108972 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2942/5854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:14 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:16.129756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:16.130348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:16.137358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:16.137812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:16.138581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:16.139018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:16.273821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:16.281667 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75874ad6-09bc-4c2e-97c5-da295fd85808 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.158567 Apr 09 21:25:16.282253 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2913/5855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:16 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:17.303173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:17.303939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:17.312388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:17.312933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:17.313899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:17.314428 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:17.453819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:17.461568 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20e42a1e-bf9a-4378-9bbb-d1bbec722045 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.165114 Apr 09 21:25:17.462153 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2943/5856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:17 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:18.479749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:18.480378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:18.487669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:18.488111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:18.488875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:18.489353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:18.631555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:18.643415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e3b3053-1c81-48c6-b09f-68bcf42e80de tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.167336 Apr 09 21:25:18.644243 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2914/5857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:18 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:19.665690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:19.666653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:19.678222 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:19.678669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:19.679444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:19.679874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:19.816955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:19.824871 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a14c289-4bf4-4a79-9417-d87d5a0c41a8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.165906 Apr 09 21:25:19.825480 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2944/5858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:19 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:20.842642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:20.843242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:20.850651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:20.851112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:20.851926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:20.852366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:20.980162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:20.988548 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0debeefa-47c4-4d0b-97f3-cad9ccdc84bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.150269 Apr 09 21:25:20.989171 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2915/5859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:20 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:22.009546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:22.010397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:22.019758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:22.020357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:22.021515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:22.021949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:22.165782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:22.173980 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9739e63-3b8d-48ac-8e89-163215b2aa2a tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.170590 Apr 09 21:25:22.174564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2945/5860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:22 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:23.195601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:23.196135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:23.203780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:23.204261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:23.205076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:23.205598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:23.340504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:23.348177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8218c727-d4eb-48d7-86f3-c1ab3ef1ee48 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.159215 Apr 09 21:25:23.348767 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2916/5861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:23 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:24.369592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:24.370588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:24.381902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:24.382650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:24.383917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:24.384648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:24.527841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:24.536509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9eef1a3-275f-4931-8be9-e5e51c2fca93 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.173735 Apr 09 21:25:24.537116 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2946/5862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:24 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:25.554090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:25.554681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:25.561747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:25.562197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:25.562966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:25.563400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:25.694925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:25.703030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-51210168-a291-479f-8f9d-612de8afb5cf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.153052 Apr 09 21:25:25.703612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2917/5863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:25 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:26.724931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:26.726020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:26.737763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:26.738510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:26.739791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:26.740516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:26.872826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:26.885087 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88a23fbf-4455-470e-a8f3-9fc51f93014d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.167292 Apr 09 21:25:26.885681 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2947/5864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:26 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:27.905322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:27.905921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:27.916350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:27.916799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:27.917603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:27.918038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:28.063574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:28.074740 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-87e28c33-c8fe-4741-875b-72917080b046 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.175495 Apr 09 21:25:28.075532 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2918/5865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:27 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:29.097759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:29.098594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:29.106081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:29.106544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:29.107322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:29.107762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:29.244144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:29.252026 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5cb55da3-8bd3-4d17-ae59-09b7707b09e8 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.158756 Apr 09 21:25:29.252725 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2948/5866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:29 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:30.275768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:30.276407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:30.283799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:30.284248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:30.285017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:30.285478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:30.429450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:30.438289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7a906c4-493c-44d9-845e-b4a183f63436 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.169042 Apr 09 21:25:30.438876 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2919/5867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:30 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:31.455271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:31.455964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:31.462901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:31.463360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:31.464139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:31.464619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:31.600662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:31.609064 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f75f44c-8c0b-4bba-9ccd-681e584250a4 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.157976 Apr 09 21:25:31.609700 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2949/5868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:31 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:32.632030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:32.633077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:32.644194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:32.645076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:32.646590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:32.647331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:32.789887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:32.798507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0674c59e-78e0-4f66-a1e7-86abbd597faf tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.173357 Apr 09 21:25:32.799089 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2920/5869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:32 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:33.815641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:33.816919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:33.824323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:33.824779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:33.825594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:33.826024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:33.971289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:33.982377 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb11704a-298e-4759-ad98-59b642330e37 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.170407 Apr 09 21:25:33.983156 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2950/5870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:33 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:35.008988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:35.010191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:35.017426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:35.017885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:35.018672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:35.019113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:35.148468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:35.159847 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d09d1cd-8489-42eb-b4f4-da2ad7580c73 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.157296 Apr 09 21:25:35.160631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2921/5871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:35 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:36.182871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:36.183499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:36.190803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.191266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.192050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.192487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.326868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:36.334973 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e4b39d5c-8336-4f2f-83f5-9ad3420eb106 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1485 microversion: 2.1 time: 0.158406 Apr 09 21:25:36.335529 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2951/5872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:36 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1485 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:36.351721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:36.352236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:36.359288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.359734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.360498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.360930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.431805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ee2e813-80c6-468f-add2-437905f6c04c tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "POST /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c/action" status: 202 len: 0 microversion: 2.1 time: 0.083814 Apr 09 21:25:36.432561 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2922/5873] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:25:36 2022] POST /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:25:36.441314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:36.441703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:36.447994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.448456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.449320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:36.449786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:36.580595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:36.588391 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3769ad38-49c4-4036-bf5e-7e7c8a2da1eb tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1493 microversion: 2.1 time: 0.151338 Apr 09 21:25:36.589008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2952/5874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:36 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1493 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:25:37.610722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:37.611926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:37.622406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:37.622863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:37.623649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:37.624115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:37.760791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:37.771820 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cb87ef65-c655-425d-9929-01b12f167565 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1493 microversion: 2.1 time: 0.168223 Apr 09 21:25:37.772592 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2923/5875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:37 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1493 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:38.793405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:38.794078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:38.802929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:38.803394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:38.804193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:38.804656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:38.936990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:38.944718 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a046cdf-8bdf-4cb2-819e-5d1676d8a1d2 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1493 microversion: 2.1 time: 0.156998 Apr 09 21:25:38.945341 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2953/5876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:38 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1493 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:39.966035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:39.966648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:39.974612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:39.975095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:39.975910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:39.976374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:40.107801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:40.115545 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c712d48-b36a-4c9d-9c6c-3d5e1fe8c3bd tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1499 microversion: 2.1 time: 0.156068 Apr 09 21:25:40.116139 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2924/5877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:39 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:40.139138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:40.139732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:40.146925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:40.147383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:40.148162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:40.148600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:40.173523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:25:40.257008 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f72cacd4-4334-4d18-9231-dba4a7507c55 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 204 len: 0 microversion: 2.1 time: 0.121542 Apr 09 21:25:40.257531 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2954/5878] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:25:40 2022] DELETE /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:25:40.265994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:40.266580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:40.272649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:40.273124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:40.273891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:40.274327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:40.409972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:40.420439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e110744b-65ac-4bcd-b1e2-7d8309dd68ee tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.158422 Apr 09 21:25:40.421050 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2925/5879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:40 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:41.443130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:41.444322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:41.455551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:41.456343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:41.457681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:41.458406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:41.595566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:41.603598 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7a7cf10-f146-4f21-85d6-c5bf1d2170dc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.168247 Apr 09 21:25:41.604178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2955/5880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:41 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:42.620974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:42.621695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:42.630070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:42.630604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:42.631501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:42.632009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:42.774957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:42.788518 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0671df2a-467d-4328-a44f-da8cae14466e tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1505 microversion: 2.1 time: 0.171894 Apr 09 21:25:42.789215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2926/5881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:42 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:43.808066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:43.809461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:43.817511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:43.817954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:43.818959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:43.819589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:43.820856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-def4b846-6c5d-4228-9cf0-56cd38855d29 req-199576ce-43cd-4a2a-b571-cbde06cada93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6771f47a-553f-460b-90ef-8d0a7d46ba1c", "name": "network-vif-deleted", "tag": "290f14ae-e9a8-485b-8617-6e1c36174913"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:43.831781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-def4b846-6c5d-4228-9cf0-56cd38855d29 req-199576ce-43cd-4a2a-b571-cbde06cada93 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:43.832229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-def4b846-6c5d-4228-9cf0-56cd38855d29 req-199576ce-43cd-4a2a-b571-cbde06cada93 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:43.854500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-def4b846-6c5d-4228-9cf0-56cd38855d29 req-199576ce-43cd-4a2a-b571-cbde06cada93 service nova] Creating event network-vif-deleted:290f14ae-e9a8-485b-8617-6e1c36174913 for instance 6771f47a-553f-460b-90ef-8d0a7d46ba1c on nch2-master-1 Apr 09 21:25:43.859966 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-def4b846-6c5d-4228-9cf0-56cd38855d29 req-199576ce-43cd-4a2a-b571-cbde06cada93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042675 Apr 09 21:25:43.860980 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2927/5882] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:25:43.898022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:43.906411 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3562f17-24ba-4715-9146-cede402ba0cc tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 200 len: 1463 microversion: 2.1 time: 0.103531 Apr 09 21:25:43.907391 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2956/5883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:43 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 1463 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:44.929247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:44.929937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 6771f47a-553f-460b-90ef-8d0a7d46ba1c] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:44.937595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:44.938213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:44.939338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:44.940000 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:44.958468 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] HTTP exception thrown: Instance 6771f47a-553f-460b-90ef-8d0a7d46ba1c could not be found. Apr 09 21:25:44.959005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Returning 404 to user: Instance 6771f47a-553f-460b-90ef-8d0a7d46ba1c could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:25:44.959846 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-839c93a6-2def-4da4-a1da-4a46b76555f5 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c" status: 404 len: 111 microversion: 2.1 time: 0.038061 Apr 09 21:25:44.960403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2928/5884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:44 2022] GET /compute/v2.1/servers/6771f47a-553f-460b-90ef-8d0a7d46ba1c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:25:44.970286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:44.970795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:44.978684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:44.979180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:44.979964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:44.980406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:45.005526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:25:45.086381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2bd00557-de0f-4dba-bed8-a7c880ea2701 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 204 len: 0 microversion: 2.1 time: 0.119930 Apr 09 21:25:45.086991 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2957/5885] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:25:44 2022] DELETE /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:25:45.096238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:45.096866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:45.102915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:45.103368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:45.104149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:45.104584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:45.239896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:45.249414 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fdbc4e97-0953-4d87-a304-ffb575dac77d tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1492 microversion: 2.1 time: 0.157298 Apr 09 21:25:45.250015 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2929/5886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:45 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:25:46.271010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:46.271835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:46.280315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:46.280848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:46.281787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:46.282302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:46.420006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:46.428446 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7d1c93df-5ad5-4012-ab5f-171dd7a6332b tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1492 microversion: 2.1 time: 0.164186 Apr 09 21:25:46.429044 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2958/5887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:46 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1492 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:47.446140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:47.446756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:47.454148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:47.454866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:47.455658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:47.456059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:47.682096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bc2079eb-4ecb-454a-8c04-aa5743465138 req-befe542a-d5a3-4b98-b6f9-69985821f912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2691ac-0e55-4daf-8313-ab50b608183f", "name": "network-vif-deleted", "tag": "b5a168b3-cc62-4ece-9177-61870d9ab1a5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:47.687395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de25902bda8c4346a4bb7e70e38175fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506378df4d4d4d4b9c0ea0412d234503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:47.692735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bc2079eb-4ecb-454a-8c04-aa5743465138 req-befe542a-d5a3-4b98-b6f9-69985821f912 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:47.693229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bc2079eb-4ecb-454a-8c04-aa5743465138 req-befe542a-d5a3-4b98-b6f9-69985821f912 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:47.696480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e73d04b-9f5a-431e-9c3e-19e7c0bb1142 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 200 len: 1492 microversion: 2.1 time: 0.254327 Apr 09 21:25:47.697091 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2930/5888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:47 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 1492 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:25:47.713920 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bc2079eb-4ecb-454a-8c04-aa5743465138 req-befe542a-d5a3-4b98-b6f9-69985821f912 service nova] Creating event network-vif-deleted:b5a168b3-cc62-4ece-9177-61870d9ab1a5 for instance 2a2691ac-0e55-4daf-8313-ab50b608183f on nch1-master-1 Apr 09 21:25:47.719014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bc2079eb-4ecb-454a-8c04-aa5743465138 req-befe542a-d5a3-4b98-b6f9-69985821f912 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046201 Apr 09 21:25:47.719616 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2959/5889] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:25:48.717834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:48.719746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] [instance: 2a2691ac-0e55-4daf-8313-ab50b608183f] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:48.732863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:48.733322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:48.734342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:48.734770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:48.748389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] HTTP exception thrown: Instance 2a2691ac-0e55-4daf-8313-ab50b608183f could not be found. Apr 09 21:25:48.749027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] Returning 404 to user: Instance 2a2691ac-0e55-4daf-8313-ab50b608183f could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:25:48.749901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f44413f-ccee-4902-86cf-2334670842c0 tempest-ServerRescueTestJSON-2054318573 tempest-ServerRescueTestJSON-2054318573-project] 10.222.0.30 "GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f" status: 404 len: 111 microversion: 2.1 time: 0.039057 Apr 09 21:25:48.750456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2931/5890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:25:48 2022] GET /compute/v2.1/servers/2a2691ac-0e55-4daf-8313-ab50b608183f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:25:53.174294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1490067205", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": "none"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:53.237245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:25:53.237673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:25:53.238146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:25:53.238553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:25:53.238966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:25:53.248874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:53.249371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:53.250182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:53.250625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:53.267509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Getting quotas for project dbc3bda5bec94e2cba6e96394bb8d9c8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:25:53.272919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Getting quotas for user 6ab3b662559847ceb8b103944488db63 and project dbc3bda5bec94e2cba6e96394bb8d9c8. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:25:53.285751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:25:53.288113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:25:53.334828 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1e99f80-afcc-4558-9b4a-96c6ad272801 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.282313 Apr 09 21:25:53.335861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2960/5891] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Apr 9 21:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 21:25:53.346048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:53.346684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:53.403028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:53.410900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:53.412409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:53.413595 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e10130b-3f41-45fc-8d8d-a5d33ae13847 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1278 microversion: 2.57 time: 0.071505 Apr 09 21:25:53.414196 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2932/5892] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:53 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1278 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:54.433146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:54.433684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:54.441753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:54.441753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:54.442462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:54.442904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:54.509026 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:54.521205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:54.523707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:54.525604 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7a7b5f9-fd7f-49ef-9673-186a26ec2d09 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1336 microversion: 2.57 time: 0.097275 Apr 09 21:25:54.526485 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2961/5893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:54 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:55.549386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:55.549957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:55.558171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:55.558631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:55.559405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:55.559872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:55.628056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:55.636610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:55.638144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:55.639273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e9c27188-8fd9-4419-837a-a29b7ca3db97 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1336 microversion: 2.57 time: 0.095360 Apr 09 21:25:55.639845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2933/5894] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:55 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:56.658431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:56.659040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:56.666413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:56.666869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:56.667664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:56.668106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:56.738325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:56.747010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:56.748533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:56.749754 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4068a8a6-3574-4702-8afd-5169afbaf0d0 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1336 microversion: 2.57 time: 0.095441 Apr 09 21:25:56.750301 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2962/5895] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:56 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:57.771268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:57.772012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:57.781360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:57.781923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:57.782852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:57.783423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:57.849466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:57.857558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:57.859083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:57.860208 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-633fb86a-28a8-43f4-a75b-43de24e963b9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1336 microversion: 2.57 time: 0.094037 Apr 09 21:25:57.860784 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2934/5896] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:57 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:58.879036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:58.879657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:58.886948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:58.887375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:58.888175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:58.888609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:58.959270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:58.967821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:58.969496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:58.970656 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-69b1c8d4-2ee7-47e9-b571-55f010cc3d91 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1357 microversion: 2.57 time: 0.095738 Apr 09 21:25:58.971216 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2963/5897] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:58 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:25:58.988725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:25:58.990331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:58.997308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:58.997754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:58.998519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:58.998950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:59.073713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:25:59.074152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:25:59.074640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:25:59.075049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:25:59.075468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:25:59.137883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:59.143840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:59.144304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:59.145123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:59.145576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:59.178537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba2d7277-db99-4a3b-aa7b-f6553f026647 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "POST /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664/action" status: 202 len: 1138 microversion: 2.57 time: 0.193423 Apr 09 21:25:59.181076 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2935/5898] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Apr 9 21:25:58 2022] POST /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664/action => generated 1138 bytes in 196 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 09 21:25:59.197052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:25:59.197776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:25:59.204501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:59.205231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:59.206028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:25:59.206478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:25:59.279991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:59.288664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:59.290254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:25:59.291723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4397e0d0-98e3-4d16-b47f-661963f6397f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.099029 Apr 09 21:25:59.292271 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2964/5899] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:25:59 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:00.310620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:00.311357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:00.318701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:00.319234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:00.320029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:00.320471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:00.399171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:00.407765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:00.409315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:00.410546 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3548f4d9-9a69-462e-ac0a-3f5c3ff59f5b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.104174 Apr 09 21:26:00.411130 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2936/5900] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:00 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:01.433845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:01.434696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:01.446372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:01.446695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:01.448063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:01.448808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:01.521568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:01.529991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:01.531546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:01.532781 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c01aa86b-ff16-4259-bfd2-84fba6c060f4 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.105809 Apr 09 21:26:01.533396 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2965/5901] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:01 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:02.552797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:02.553530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:02.561210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:02.561715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:02.562579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:02.563069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:02.633653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:02.642397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:02.643897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:02.645176 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3853e110-f4de-4238-a28b-d9b841e3adf9 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.096796 Apr 09 21:26:02.645681 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2937/5902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:02 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:03.667835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:03.668838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:03.680450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:03.681211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:03.682512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:03.683247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:03.747677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:03.755924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:03.757451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:03.758617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d95ebcba-a9e4-4087-bf9f-dd6f239e95bb tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.097467 Apr 09 21:26:03.759285 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2966/5903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:03 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:04.778623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:04.779359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:04.786755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:04.787295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:04.788140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:04.788651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:04.853146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:04.862654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:04.864172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:04.865426 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e30430c9-fc0d-4fa6-846b-e9c6d59b5608 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.091934 Apr 09 21:26:04.866249 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2938/5904] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:04 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:05.887857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:05.888613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:05.903007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:05.903566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:05.904545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:05.905086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:05.974717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:05.986555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:05.988785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:05.990504 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-745cc620-d120-4caf-9767-ecfb76573b46 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.107427 Apr 09 21:26:05.991324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2967/5905] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:05 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:06.934660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:06.935664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:06.942957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:06.943430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:06.944226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:06.944672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:06.994469 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-991f1e5e-a8c6-4ca3-b3da-933390e604c9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action" status: 200 len: 40141 microversion: 2.1 time: 0.063659 Apr 09 21:26:06.995119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2939/5906] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:26:06 2022] POST /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298/action => generated 40141 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:26:07.012031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:07.012945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:07.021156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:07.021614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:07.022389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:07.022823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:07.088433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:07.097303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:07.098809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:07.100014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aae74a50-f0da-4dfa-a5e4-3c494853853d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.094153 Apr 09 21:26:07.100594 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2968/5907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:07 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:08.023231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:08.023838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:08.024965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-65c3a14d-643f-4f7d-ab71-5035bbc136bc req-72ec3ef1-e797-4854-8958-4ad8ebcc1378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:08.032319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.032748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.033609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.034021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.034597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-65c3a14d-643f-4f7d-ab71-5035bbc136bc req-72ec3ef1-e797-4854-8958-4ad8ebcc1378 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.035082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-65c3a14d-643f-4f7d-ab71-5035bbc136bc req-72ec3ef1-e797-4854-8958-4ad8ebcc1378 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.047266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-65c3a14d-643f-4f7d-ab71-5035bbc136bc req-72ec3ef1-e797-4854-8958-4ad8ebcc1378 service nova] Creating event network-changed:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:26:08.052518 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-65c3a14d-643f-4f7d-ab71-5035bbc136bc req-72ec3ef1-e797-4854-8958-4ad8ebcc1378 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031486 Apr 09 21:26:08.053403 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2969/5908] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:08.065495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:26:08.123260 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:08.125318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:08.132887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.133368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.135385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.135717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.152873 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0feea19c-8802-4f1f-bf49-45a3341bde5f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 204 len: 0 microversion: 2.1 time: 0.133729 Apr 09 21:26:08.157752 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2940/5909] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:26:08 2022] DELETE /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:26:08.165432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:08.166522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:08.174392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.175047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.176779 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:08.177261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:08.232925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:08.244634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:08.246526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:08.247740 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0a9ee65c-be37-469b-beda-b3bfeb817c4a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.131163 Apr 09 21:26:08.248535 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2970/5910] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:08 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:26:08.330954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:08.338690 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7dce7189-02a4-4291-a25c-570464f87e98 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1688 microversion: 2.1 time: 0.179317 Apr 09 21:26:08.339623 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2941/5911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:08 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:09.267476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:09.268018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:09.275208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:09.275668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:09.276431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:09.276876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:09.344156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:09.352558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:09.354139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:09.355363 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e890f87-1d6d-429d-9a51-f73996cc1bf6 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.092188 Apr 09 21:26:09.356087 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2971/5912] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:09 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:09.357398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:09.358025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:09.365652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:09.366101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:09.366885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:09.367324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:09.502466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:09.510318 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d4eb6f50-c2f2-495e-9284-4ffcc84818f9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1688 microversion: 2.1 time: 0.157385 Apr 09 21:26:09.510903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2942/5913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:09 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:10.260485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4e9f986c-fa68-427f-8edb-5fda5921819f req-5a32c1d0-9acb-4311-a28a-46231a3f3682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c44d14c-4ef7-4174-9b37-3b2557842298", "name": "network-vif-deleted", "tag": "4e8e15aa-2a30-4f3e-8940-762c7103b1f5"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:10.277689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4e9f986c-fa68-427f-8edb-5fda5921819f req-5a32c1d0-9acb-4311-a28a-46231a3f3682 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.278880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4e9f986c-fa68-427f-8edb-5fda5921819f req-5a32c1d0-9acb-4311-a28a-46231a3f3682 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.292809 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4e9f986c-fa68-427f-8edb-5fda5921819f req-5a32c1d0-9acb-4311-a28a-46231a3f3682 service nova] Creating event network-vif-deleted:4e8e15aa-2a30-4f3e-8940-762c7103b1f5 for instance 2c44d14c-4ef7-4174-9b37-3b2557842298 on nch2-master-1 Apr 09 21:26:10.298792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4e9f986c-fa68-427f-8edb-5fda5921819f req-5a32c1d0-9acb-4311-a28a-46231a3f3682 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042230 Apr 09 21:26:10.299410 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2972/5914] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:10.375179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:10.375809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:10.383067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.383524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.384405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.385085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.450356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:10.459366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:10.460918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:10.462175 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-adf8fc2b-d6d3-44c0-b5cb-59772097175d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.091973 Apr 09 21:26:10.462759 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2943/5915] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:10 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:10.533571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:10.534621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:10.545649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.546361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.547130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.547565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.578368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:10.578811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:10.579254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lazy-loading 'fault' on Instance uuid 2c44d14c-4ef7-4174-9b37-3b2557842298 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:26:10.624921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5534646a6384067bda99af7c864d494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbaded0b4ad4c4587cc36402e326750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:10.632702 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04284abc-4739-4156-9908-075d0446c9b9 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 200 len: 1356 microversion: 2.1 time: 0.106381 Apr 09 21:26:10.633327 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2973/5916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:10 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:11.480808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:11.481467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:11.489259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:11.489717 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:11.490504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:11.490948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:11.564086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:11.572257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:11.573932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:11.575111 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab1374f1-ea50-4bfa-82be-014e4886924b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.098483 Apr 09 21:26:11.575687 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2944/5917] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:11 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:11.655014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:11.655856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] [instance: 2c44d14c-4ef7-4174-9b37-3b2557842298] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:11.663390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:11.663865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:11.664678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:11.665177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:11.679516 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] HTTP exception thrown: Instance 2c44d14c-4ef7-4174-9b37-3b2557842298 could not be found. Apr 09 21:26:11.680133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Returning 404 to user: Instance 2c44d14c-4ef7-4174-9b37-3b2557842298 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:11.681066 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-166862d4-e1ae-4514-9cee-84ee5adda449 tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298" status: 404 len: 111 microversion: 2.1 time: 0.032832 Apr 09 21:26:11.681616 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2974/5918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:11 2022] GET /compute/v2.1/servers/2c44d14c-4ef7-4174-9b37-3b2557842298 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:26:12.594978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:12.595515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:12.603453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:12.603909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:12.604700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:12.605160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:12.708461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:12.717002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:12.718845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:12.720038 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-728f93fb-f92c-4f24-8050-0f3fd969948a tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.129430 Apr 09 21:26:12.720609 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2945/5919] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:12 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:13.738870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:13.740306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:13.747294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:13.747967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:13.748904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:13.749525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:13.823912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:13.833185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:13.834732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:13.835951 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2f61ca4-ef60-44e6-bcb8-37199188d937 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.101322 Apr 09 21:26:13.836922 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2975/5920] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:13 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:26:14.774452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-759dc547-033e-4f28-908a-f8aedda3e14f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] Calling method '.version_select at 0x7fb08efa2ee0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:14.797432 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-759dc547-033e-4f28-908a-f8aedda3e14f tempest-TestNetworkAdvancedServerOps-76454194 tempest-TestNetworkAdvancedServerOps-76454194-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1416929189" status: 202 len: 0 microversion: 2.1 time: 0.027325 Apr 09 21:26:14.798039 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2946/5921] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:26:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1416929189 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:26:14.856155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:14.857028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:14.864928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:14.865486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:14.866331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:14.866936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:14.934300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:14.942283 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:14.943817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:14.945003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3d7c6088-3790-43bf-b9ac-bc5e02f212cd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.093170 Apr 09 21:26:14.945596 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2976/5922] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:14 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:15.965710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:15.966613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:15.974164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:15.974626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:15.975444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:15.975888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:16.041865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:16.050485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:16.052002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:16.053304 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c578985-57da-4acb-b98a-4d69b54dca8b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.092053 Apr 09 21:26:16.053971 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2947/5923] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:15 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:17.071879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:17.072636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:17.079967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:17.080443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:17.081246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:17.081679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:17.149366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:17.158233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:17.159900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:17.161097 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76a008f0-82ee-452b-8393-a13223229b18 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.093317 Apr 09 21:26:17.161651 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2977/5924] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:17 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:17.765100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Action: 'create', calling method: .version_select at 0x7fb08e2aeb80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-402429487"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:17.779304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for project f835ef5aefe44c96bc20308d450b5680. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:26:17.791956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for user 0818e5f0edb74b82821c07c88df54826 and project f835ef5aefe44c96bc20308d450b5680. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:26:18.108270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for project f835ef5aefe44c96bc20308d450b5680. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:26:18.113727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for user 0818e5f0edb74b82821c07c88df54826 and project f835ef5aefe44c96bc20308d450b5680. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:26:18.128610 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b2a255c-107b-4d32-999d-46f6477217c8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.529225 Apr 09 21:26:18.129278 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2948/5925] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:26:17 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:18.179750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:18.180388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:18.187371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:18.187842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:18.188652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:18.189116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:18.252591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:18.261950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:18.263562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:18.264778 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f23e8e5-31f3-4d9e-ae01-8ef23e881606 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.089103 Apr 09 21:26:18.265429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2978/5926] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:18 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:19.284980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:19.285904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:19.292701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:19.293175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:19.293995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:19.294434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:19.362290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:19.370464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:19.371961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:19.373196 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0724cbeb-5b91-4e24-bc62-ee986b757afd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.093112 Apr 09 21:26:19.373754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2949/5927] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:19 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:20.392192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:20.392743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:20.399715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:20.400173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:20.400967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:20.401465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:20.503626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:20.512012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:20.513546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:20.514728 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-083c991c-1bd2-4446-add5-cc2348edf734 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.126898 Apr 09 21:26:20.515306 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2979/5928] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:20 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:21.533809 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:21.535202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:21.542832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:21.543600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:21.544586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:21.545276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:21.660467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:21.695921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:21.697941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:21.699366 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-76653996-9672-43fe-8361-2ee58343441e tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.169560 Apr 09 21:26:21.700086 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2950/5929] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:21 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 21:26:22.718913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:22.719472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:22.726576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:22.727027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:22.727801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:22.728236 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:22.806861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:22.815644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:22.817645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:22.818890 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d99e6227-83df-411e-a374-81f17f269bbd tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.104239 Apr 09 21:26:22.819438 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2980/5930] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:22 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:23.839063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:23.841708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:23.857726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:23.858460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:23.859981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:23.861867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:23.922367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1691406591-access_point-277421248", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "eed8a229-49ff-4110-8b62-8b54cbcf9d4e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-402429487", "security_groups": [{"name": "tempest-secgroup_access--379782238"}, {"name": "tempest-secgroup_general--883454158"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:23.957130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:23.965976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:23.967511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:23.968763 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-df7d9253-c0eb-443f-8408-ca350c67bf14 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.134866 Apr 09 21:26:23.969754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2951/5931] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:23 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:24.112902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] validate_networks() for [('eed8a229-49ff-4110-8b62-8b54cbcf9d4e', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:26:24.541187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:26:24.541618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:26:24.542094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:26:24.542500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:26:24.542909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:26:24.552149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:24.553365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:24.554396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:24.555077 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:24.575200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for project f835ef5aefe44c96bc20308d450b5680. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:26:24.580630 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for user 0818e5f0edb74b82821c07c88df54826 and project f835ef5aefe44c96bc20308d450b5680. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:26:24.594084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:26:24.596364 ncdv-master-1 devstack@n-api.service[141818]: WARNING nova.utils [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1691406591-access_point-277421248 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1691406591-ac Apr 09 21:26:24.597112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:26:24.644982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85e7696e-b16e-4549-ba67-d4809beffc84 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.726737 Apr 09 21:26:24.650759 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2981/5932] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:26:23 2022] POST /compute/v2.1/servers => generated 456 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:26:24.656153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5786d18d-1089-4f09-8b2c-4fe35d248bd8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:24.657286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5786d18d-1089-4f09-8b2c-4fe35d248bd8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:24.730215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5786d18d-1089-4f09-8b2c-4fe35d248bd8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:24.737125 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5786d18d-1089-4f09-8b2c-4fe35d248bd8 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1293 microversion: 2.1 time: 0.084993 Apr 09 21:26:24.737827 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2952/5933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:24 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:24.989902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:24.992455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:24.999504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:25.000006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:25.000979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:25.001462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:25.071512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:25.081200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:25.082697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:25.083918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d97cafa-f723-41c0-bdad-5e856166eac7 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1366 microversion: 2.57 time: 0.100602 Apr 09 21:26:25.085002 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2982/5934] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:24 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:25.755638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:25.756904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:25.768313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:25.781776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:25.782844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:25.783427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:25.858611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:25.870976 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb00a7fc-a7fe-45e6-b7c5-9ce5d4b999eb tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1345 microversion: 2.1 time: 0.119862 Apr 09 21:26:25.874118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2953/5935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:25 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:26.103639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:26.104281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:26.113577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:26.114717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:26.115705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:26.116700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:26.208261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:26.217738 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:26.219577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:26.221050 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f589780e-3532-4f0a-b601-3647d200508d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1372 microversion: 2.57 time: 0.121542 Apr 09 21:26:26.221733 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2983/5936] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:26 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:26.889288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:26.889988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:26.898387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:26.899109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:26.901714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:26.904589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:27.157960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:27.167157 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ec1b1b7-e28d-4599-a8dc-2eb9b2b73339 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.281910 Apr 09 21:26:27.167766 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2954/5937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:26 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:27.240852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:27.241815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:27.249793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:27.250347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:27.251202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:27.251821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:27.331978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:27.345833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:27.358793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:27.360296 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cda521f2-d078-4fb3-8401-50178ae42335 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1372 microversion: 2.57 time: 0.124172 Apr 09 21:26:27.361339 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2984/5938] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:27 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:27.548868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-34bde96f-a27b-4087-bd4f-6565290e3646 req-3b84da8c-c169-4275-9394-dbda11073438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb01d26-3f1e-4f5f-a85a-9cef4c817f33", "tag": "be033c1b-34cc-4943-b7a1-22bca07d3ec3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:27.558962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-34bde96f-a27b-4087-bd4f-6565290e3646 req-3b84da8c-c169-4275-9394-dbda11073438 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:27.559380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-34bde96f-a27b-4087-bd4f-6565290e3646 req-3b84da8c-c169-4275-9394-dbda11073438 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:27.587297 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-34bde96f-a27b-4087-bd4f-6565290e3646 req-3b84da8c-c169-4275-9394-dbda11073438 service nova] Creating event network-changed:be033c1b-34cc-4943-b7a1-22bca07d3ec3 for instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 on nch1-master-1 Apr 09 21:26:27.593016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-34bde96f-a27b-4087-bd4f-6565290e3646 req-3b84da8c-c169-4275-9394-dbda11073438 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048232 Apr 09 21:26:27.593987 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2955/5939] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:28.184123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:28.184667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:28.192128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:28.193094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:28.193899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:28.194517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:28.341983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:28.350678 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab64fd04-54ce-4111-bb95-b4098ba841f9 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.170549 Apr 09 21:26:28.351257 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2985/5940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:28 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:28.382013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:28.382749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:28.391682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:28.392372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:28.393604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:28.394280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:28.485700 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:28.493986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:28.495491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:28.496665 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e758d36-1075-47c3-8d74-099b740d27fe tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1372 microversion: 2.57 time: 0.120004 Apr 09 21:26:28.497294 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2956/5941] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:28 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:29.376107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:29.376747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:29.387675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:29.388243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:29.389243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:29.389859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:29.515894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:29.516593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:29.523802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:29.524289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:29.525107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:29.525557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:29.537343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:29.545687 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1398faf7-90a8-4038-8ebe-4ebf112af03d tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.176589 Apr 09 21:26:29.546328 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2986/5942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:29 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:29.591886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:29.600693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:29.602374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:29.603547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b2f013a-ab2f-4d89-8700-057830efc46b tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1372 microversion: 2.57 time: 0.091896 Apr 09 21:26:29.604649 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2957/5943] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:29 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:30.563246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:30.563896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:30.571394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:30.571883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:30.572689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:30.573164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:30.622898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:30.623489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:30.630615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:30.631066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:30.631831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:30.632270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:31.067765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.076819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.078508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.079678 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1521fb93-996f-4a90-89de-2cbba3c57633 tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1357 microversion: 2.57 time: 0.460799 Apr 09 21:26:31.080251 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2958/5944] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:30 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1357 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:31.107522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.109259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:31.109886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:31.116324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:31.116770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:31.117001 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e296766e-756c-4744-bf33-e3b413c7d8db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.557861 Apr 09 21:26:31.117608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:31.117769 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2987/5945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:30 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:31.118041 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:31.142397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:26:31.221543 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fcde9eba-b7dd-4412-966e-f44c309c80ac tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 204 len: 0 microversion: 2.57 time: 0.116631 Apr 09 21:26:31.222159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2959/5946] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Apr 9 21:26:31 2022] DELETE /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 21:26:31.231081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:31.231720 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:31.238175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:31.238628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:31.239411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:31.239846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:31.306765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.315602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.317225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:31.318463 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf110b9f-4d53-4d23-8b3a-4dec6a6b424c tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1363 microversion: 2.57 time: 0.091622 Apr 09 21:26:31.329460 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2988/5947] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:31 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:32.139606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:32.140705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:32.152257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:32.153012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:32.154425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:32.155139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:32.312343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:32.319917 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-da011e14-bb1a-49ec-88cd-803febf166b4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.187770 Apr 09 21:26:32.320507 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2960/5948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:32 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:32.337495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:32.338095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:32.345979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:32.346474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:32.347258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:32.347705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:32.410143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:32.418440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:32.419955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ab3b662559847ceb8b103944488db63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc3bda5bec94e2cba6e96394bb8d9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:32.421160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6d1b3574-aa8f-4479-8d33-9721b6e3552f tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 200 len: 1363 microversion: 2.57 time: 0.087800 Apr 09 21:26:32.421739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2989/5949] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:32 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 21:26:33.337649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:33.338217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:33.345926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:33.346382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:33.347168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:33.347611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:33.480798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d8554b72-7015-4247-911b-084e7d6dd562 req-3b42c584-7ada-44d2-9ea6-2fcf024b39ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb01d26-3f1e-4f5f-a85a-9cef4c817f33", "name": "network-vif-plugged", "status": "completed", "tag": "be033c1b-34cc-4943-b7a1-22bca07d3ec3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:33.488977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d8554b72-7015-4247-911b-084e7d6dd562 req-3b42c584-7ada-44d2-9ea6-2fcf024b39ab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:33.489453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d8554b72-7015-4247-911b-084e7d6dd562 req-3b42c584-7ada-44d2-9ea6-2fcf024b39ab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:33.497944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:33.500501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d8554b72-7015-4247-911b-084e7d6dd562 req-3b42c584-7ada-44d2-9ea6-2fcf024b39ab service nova] Creating event network-vif-plugged:be033c1b-34cc-4943-b7a1-22bca07d3ec3 for instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 on nch1-master-1 Apr 09 21:26:33.505568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cbb5458a-77c4-46ea-bddd-c3cf0e326c81 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.172047 Apr 09 21:26:33.505716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d8554b72-7015-4247-911b-084e7d6dd562 req-3b42c584-7ada-44d2-9ea6-2fcf024b39ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119377 Apr 09 21:26:33.506162 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2961/5950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:33 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:33.506291 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2990/5951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:33.511594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:33.512285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] [instance: 07027662-d41b-47d7-a7f9-83b04e5b8664] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:33.518547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:33.518997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:33.519762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:33.520248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:33.534239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] HTTP exception thrown: Instance 07027662-d41b-47d7-a7f9-83b04e5b8664 could not be found. Apr 09 21:26:33.534831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] Returning 404 to user: Instance 07027662-d41b-47d7-a7f9-83b04e5b8664 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:33.535951 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cf28802a-8b8a-4a27-aeba-cd93c683fa0d tempest-ServerShowV257Test-70081091 tempest-ServerShowV257Test-70081091-project] 10.222.0.30 "GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664" status: 404 len: 111 microversion: 2.57 time: 0.028509 Apr 09 21:26:33.536511 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2991/5952] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Apr 9 21:26:33 2022] GET /compute/v2.1/servers/07027662-d41b-47d7-a7f9-83b04e5b8664 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:26:34.522520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:34.523188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:34.530309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:34.530765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:34.531546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:34.531989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:34.680635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:34.688214 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f6a9781-ceb6-4646-b816-9a06eda5d502 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1469 microversion: 2.1 time: 0.169808 Apr 09 21:26:34.688935 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2962/5953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:34 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:35.707937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:35.708729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:35.715966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:35.716353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:35.717150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:35.717592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:35.858272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:35.866334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-493f9e71-255c-4ed4-9ea7-fb03768305b3 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1640 microversion: 2.1 time: 0.164151 Apr 09 21:26:35.866921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2992/5954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:35 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1640 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:35.883987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:35.884609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:35.891763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:35.892308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:35.893317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:35.893916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:36.038853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:36.047451 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7ae7bf0-b4f1-4b06-b2f3-a651d1af16c4 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1640 microversion: 2.1 time: 0.168336 Apr 09 21:26:36.048750 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2963/5955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:35 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1640 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:36.064570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:36.065237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:36.071648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:36.072186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:36.073102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:36.073591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:36.451793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ea99dcea-bb02-4c8a-a933-7fef4775eef2 tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1791 microversion: 2.1 time: 0.391439 Apr 09 21:26:36.453410 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2993/5956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:36 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1791 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:26:36.930370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-852542724", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "30ecadf2-222e-4a45-a8f2-a4d0fd3f2c46"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:36.983033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] validate_networks() for [('30ecadf2-222e-4a45-a8f2-a4d0fd3f2c46', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:26:37.446244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:26:37.446669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:26:37.451772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:26:37.452207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:26:37.452619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:26:37.462366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:37.462923 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:37.463964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:37.464399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:37.481753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Getting quotas for project ba99b682561b49caafd954b3a1cd65cc. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:26:37.487123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Getting quotas for user 95db37215f2444d1987829e5861c8d4b and project ba99b682561b49caafd954b3a1cd65cc. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:26:37.499687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:26:37.502071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:26:37.544957 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-27a0a680-86f4-4810-a255-ef9bcfecb7e1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734579 Apr 09 21:26:37.545833 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2964/5957] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:26:37.556934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-787082e7-66be-4e19-afc3-d3ad55e80df2 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:37.558578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-787082e7-66be-4e19-afc3-d3ad55e80df2 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:37.618347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-787082e7-66be-4e19-afc3-d3ad55e80df2 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:37.626237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-787082e7-66be-4e19-afc3-d3ad55e80df2 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1227 microversion: 2.1 time: 0.074080 Apr 09 21:26:37.627170 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2994/5958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:37 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1227 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:38.486102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c89cab62-1dd6-41e9-b4d1-6da02564e4a0 req-1155dbdb-fdeb-4cd2-9f73-a599619c69f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb01d26-3f1e-4f5f-a85a-9cef4c817f33", "tag": "be033c1b-34cc-4943-b7a1-22bca07d3ec3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:38.497418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c89cab62-1dd6-41e9-b4d1-6da02564e4a0 req-1155dbdb-fdeb-4cd2-9f73-a599619c69f4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:38.498118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c89cab62-1dd6-41e9-b4d1-6da02564e4a0 req-1155dbdb-fdeb-4cd2-9f73-a599619c69f4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:38.523938 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c89cab62-1dd6-41e9-b4d1-6da02564e4a0 req-1155dbdb-fdeb-4cd2-9f73-a599619c69f4 service nova] Creating event network-changed:be033c1b-34cc-4943-b7a1-22bca07d3ec3 for instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 on nch1-master-1 Apr 09 21:26:38.530417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c89cab62-1dd6-41e9-b4d1-6da02564e4a0 req-1155dbdb-fdeb-4cd2-9f73-a599619c69f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049977 Apr 09 21:26:38.531287 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2965/5959] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:38.643395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:38.644682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:38.662493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:38.663136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:38.664107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:38.664892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:38.798064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:38.812205 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3048a26a-92cb-451d-8d78-e98765c69c58 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1297 microversion: 2.1 time: 0.172291 Apr 09 21:26:38.813374 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2995/5960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:38 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1297 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:39.833475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:39.834376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:39.846842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:39.847326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:39.848226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:39.848691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:40.002276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:40.010681 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a94c2e2-ab7c-4d10-a870-d2ef40c4c36f tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.184790 Apr 09 21:26:40.011258 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2966/5961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:39 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:40.550652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-efe6213a-9abf-4d03-b62d-2affb5f5f84c req-6a004054-50dc-436d-8d9d-c41ebab5b413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20791c56-fc3a-4911-95ea-e2fed9828931", "tag": "329800f3-40d7-45fb-8929-5ca77a0d6267"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:40.560358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-efe6213a-9abf-4d03-b62d-2affb5f5f84c req-6a004054-50dc-436d-8d9d-c41ebab5b413 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:40.560804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-efe6213a-9abf-4d03-b62d-2affb5f5f84c req-6a004054-50dc-436d-8d9d-c41ebab5b413 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:40.573592 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-efe6213a-9abf-4d03-b62d-2affb5f5f84c req-6a004054-50dc-436d-8d9d-c41ebab5b413 service nova] Creating event network-changed:329800f3-40d7-45fb-8929-5ca77a0d6267 for instance 20791c56-fc3a-4911-95ea-e2fed9828931 on nch2-master-1 Apr 09 21:26:40.578758 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-efe6213a-9abf-4d03-b62d-2affb5f5f84c req-6a004054-50dc-436d-8d9d-c41ebab5b413 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Apr 09 21:26:40.579345 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2996/5962] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:26:41.031506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:41.032351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:41.040545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:41.041066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:41.041926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:41.042414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:41.180312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:41.188331 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e303c83-1ca4-484a-abf9-b73347fe6853 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.163625 Apr 09 21:26:41.188912 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2967/5963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:41 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:41.410648 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:26:41.410861 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:26:42.210606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:42.211838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:42.225135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:42.225934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:42.227227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:42.227968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:42.375056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:42.383092 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-005a882c-6169-4ef1-a7d5-fff6b32f54da tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.179992 Apr 09 21:26:42.383729 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2997/5964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:42 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:43.409771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:43.410748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:43.422681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:43.423439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:43.424437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:43.424877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:43.557300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:43.568112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-480bc5e6-0710-4d0a-8974-118eaa191fa1 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.165511 Apr 09 21:26:43.568719 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2968/5965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:43 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:44.585275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:44.585900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:44.593359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:44.593807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:44.594579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:44.595016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:44.735672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:44.747052 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9864be25-8182-4170-b3be-ab1458373b89 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.165770 Apr 09 21:26:44.747676 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2998/5966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:44 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:45.767963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:45.768665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:45.777089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:45.777687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:45.778969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:45.782985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:45.921819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:45.929892 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-24cefc96-f217-446e-ae21-a932baf4ef07 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.168525 Apr 09 21:26:45.930490 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2969/5967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:45 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:46.467974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0aae615c-f6f0-4d93-8469-9c2fd46124ef req-cfc16fbb-1087-4dce-ae5a-903ca8155636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20791c56-fc3a-4911-95ea-e2fed9828931", "name": "network-vif-plugged", "status": "completed", "tag": "329800f3-40d7-45fb-8929-5ca77a0d6267"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:46.478671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0aae615c-f6f0-4d93-8469-9c2fd46124ef req-cfc16fbb-1087-4dce-ae5a-903ca8155636 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:46.479101 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0aae615c-f6f0-4d93-8469-9c2fd46124ef req-cfc16fbb-1087-4dce-ae5a-903ca8155636 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:46.491182 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0aae615c-f6f0-4d93-8469-9c2fd46124ef req-cfc16fbb-1087-4dce-ae5a-903ca8155636 service nova] Creating event network-vif-plugged:329800f3-40d7-45fb-8929-5ca77a0d6267 for instance 20791c56-fc3a-4911-95ea-e2fed9828931 on nch2-master-1 Apr 09 21:26:46.495984 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0aae615c-f6f0-4d93-8469-9c2fd46124ef req-cfc16fbb-1087-4dce-ae5a-903ca8155636 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Apr 09 21:26:46.496749 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 2999/5968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:46.947372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:46.947879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:46.954871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:46.955318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:46.956091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:46.956523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:47.085726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:47.093801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e2fdaf20-97bb-45ea-b146-cf5ea2dd28ca tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1327 microversion: 2.1 time: 0.150872 Apr 09 21:26:47.094388 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2970/5969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:46 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:48.116047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.116925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.125378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.125939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.127055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.127614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.267852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:48.275834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e22e47bf-1530-4ae7-a648-e8758e7b8e29 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1526 microversion: 2.1 time: 0.167418 Apr 09 21:26:48.276410 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3000/5970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:48 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:48.292689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.293314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.300270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.300722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.301518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.301951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.438572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:48.446313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-126c03aa-addd-4f41-bf06-f18c1a046c59 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1526 microversion: 2.1 time: 0.157547 Apr 09 21:26:48.446903 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2971/5971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:48 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:48.514995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.515484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.521984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.522430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.523195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.523633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.537469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] HTTP exception thrown: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. Apr 09 21:26:48.538047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Returning 404 to user: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:48.538877 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b521ea9-d378-4d16-8a10-75d2dbd1afd8 tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] 10.222.0.30 "DELETE /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 404 len: 111 microversion: 2.1 time: 0.080565 Apr 09 21:26:48.539414 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3001/5972] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:26:48 2022] DELETE /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:26:48.548519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.549199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.555365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.555810 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.556568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.556999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.695093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:48.705770 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1ad1914-ac0e-47cc-9826-606b9860069d tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1526 microversion: 2.1 time: 0.161102 Apr 09 21:26:48.706368 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2972/5973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:48 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:48.722840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Action: 'update', calling method: >, body: {"server": {"name": "20791c56-fc3a-4911-95ea-e2fed9828931_new"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:48.724072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.732357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.732944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.733984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.734509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.749460 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] HTTP exception thrown: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. Apr 09 21:26:48.750051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] Returning 404 to user: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:48.750895 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-624efe6c-88ab-4928-9f04-8074db578b1c tempest-ServersNegativeTestMultiTenantJSON-559811070 tempest-ServersNegativeTestMultiTenantJSON-559811070-project] 10.222.0.30 "PUT /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 404 len: 111 microversion: 2.1 time: 0.032112 Apr 09 21:26:48.751488 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3002/5974] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:26:48 2022] PUT /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:26:48.760632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.761167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.767624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.768068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.768832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.769319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.794158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:26:48.872661 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc33f647-3576-4c2b-94e9-a33c1cf292cb tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 204 len: 0 microversion: 2.1 time: 0.115755 Apr 09 21:26:48.873374 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2973/5975] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:26:48 2022] DELETE /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:26:48.881971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:48.882919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:48.891073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.891511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:48.892294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:48.892766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:49.025153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:49.036131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8f7fe60c-feaa-4900-ba49-30b4d7823a03 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1532 microversion: 2.1 time: 0.158381 Apr 09 21:26:49.036692 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3003/5976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:48 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1532 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:26:50.053648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:50.054359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:50.061660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:50.062105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:50.062931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:50.063362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:50.197303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:50.204944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae3d01cd-40a6-4d70-afae-77ee12e59dde tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1532 microversion: 2.1 time: 0.155695 Apr 09 21:26:50.205562 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2974/5977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:50 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1532 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:50.878773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9ca8a3a9-ddff-4c6f-a716-88721cf75754 req-60ad1258-661b-4da6-b052-eae17bced8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20791c56-fc3a-4911-95ea-e2fed9828931", "name": "network-vif-deleted", "tag": "329800f3-40d7-45fb-8929-5ca77a0d6267"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:50.889836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9ca8a3a9-ddff-4c6f-a716-88721cf75754 req-60ad1258-661b-4da6-b052-eae17bced8fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:50.890378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9ca8a3a9-ddff-4c6f-a716-88721cf75754 req-60ad1258-661b-4da6-b052-eae17bced8fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:50.903026 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9ca8a3a9-ddff-4c6f-a716-88721cf75754 req-60ad1258-661b-4da6-b052-eae17bced8fb service nova] Creating event network-vif-deleted:329800f3-40d7-45fb-8929-5ca77a0d6267 for instance 20791c56-fc3a-4911-95ea-e2fed9828931 on nch2-master-1 Apr 09 21:26:50.908792 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9ca8a3a9-ddff-4c6f-a716-88721cf75754 req-60ad1258-661b-4da6-b052-eae17bced8fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 Apr 09 21:26:50.909433 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3004/5978] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:51.222735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:51.223957 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:51.230870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:51.231322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:51.232107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:51.232545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:51.266209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:51.266664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:51.267149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lazy-loading 'fault' on Instance uuid 20791c56-fc3a-4911-95ea-e2fed9828931 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:26:51.312813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95db37215f2444d1987829e5861c8d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba99b682561b49caafd954b3a1cd65cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:26:51.319676 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 200 len: 1317 microversion: 2.1 time: 0.100809 Apr 09 21:26:51.320261 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2975/5979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:51 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 1317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:26:52.342395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:52.343548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] [instance: 20791c56-fc3a-4911-95ea-e2fed9828931] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:26:52.355383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:52.356127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:52.357460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:26:52.358187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:26:52.374282 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] HTTP exception thrown: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. Apr 09 21:26:52.374862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Returning 404 to user: Instance 20791c56-fc3a-4911-95ea-e2fed9828931 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:52.375685 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0e3d351-14d8-4151-8407-6ee18ae6b4cf tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931" status: 404 len: 111 microversion: 2.1 time: 0.040947 Apr 09 21:26:52.376207 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3005/5980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:26:52 2022] GET /compute/v2.1/servers/20791c56-fc3a-4911-95ea-e2fed9828931 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:26:55.040607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:55.041669 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dea3163f-3ebe-4ee5-874a-dbdea712a347 tempest-ServersNegativeTestMultiTenantJSON-1351869647 tempest-ServersNegativeTestMultiTenantJSON-1351869647-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001380 Apr 09 21:26:55.042002 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2976/5981] 10.222.0.30 () {56 vars in 885 bytes} [Sat Apr 9 21:26:55 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 09 21:26:56.467337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-86d88831-f5ad-4695-958f-80330b22fb20 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Action: 'create', calling method: .version_select at 0x7fb08ee39700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-239623260", "metadata": {"Type": "work"}}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:26:56.750436 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-86d88831-f5ad-4695-958f-80330b22fb20 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.409118 Apr 09 21:26:56.751292 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3006/5982] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Apr 9 21:26:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 09 21:26:56.763104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f08e397e-d531-43f6-8d2d-8f5693ea4c77 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08ed965e0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:56.813112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f08e397e-d531-43f6-8d2d-8f5693ea4c77 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 200 len: 345 microversion: 2.1 time: 0.054140 Apr 09 21:26:56.813881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2977/5983] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:26:56 2022] GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:57.827609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cea57387-35b6-424c-9993-509aaf8149b9 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08ee39b80>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:57.875198 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cea57387-35b6-424c-9993-509aaf8149b9 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 200 len: 346 microversion: 2.1 time: 0.053154 Apr 09 21:26:57.875775 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3007/5984] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:26:57 2022] GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:57.887863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bde1370d-1acd-46c0-b37f-4c5abce1c5b5 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08df07a60>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:57.937185 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bde1370d-1acd-46c0-b37f-4c5abce1c5b5 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 200 len: 346 microversion: 2.1 time: 0.053679 Apr 09 21:26:57.938096 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2978/5985] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:26:57 2022] GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:57.950444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dacc3d05-74fe-4f25-a143-4eede20e9a55 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08efe8e50>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:58.013257 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dacc3d05-74fe-4f25-a143-4eede20e9a55 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 202 len: 0 microversion: 2.1 time: 0.066644 Apr 09 21:26:58.013838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3008/5986] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Apr 9 21:26:57 2022] DELETE /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:26:58.021999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8b1fecf4-646c-4d24-a68b-04551743f425 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08e056c10>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:58.070052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8b1fecf4-646c-4d24-a68b-04551743f425 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 200 len: 345 microversion: 2.1 time: 0.051940 Apr 09 21:26:58.070823 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2979/5987] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:26:58 2022] GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:26:59.087161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0591b3f-6bf2-476a-bd24-8c9ae299e380 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Calling method '.version_select at 0x7fb08eaa8700>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:26:59.121790 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-b0591b3f-6bf2-476a-bd24-8c9ae299e380 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] HTTP exception thrown: Volume 647db992-b381-4014-86ac-a1395b9c2d1d could not be found. Apr 09 21:26:59.122375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0591b3f-6bf2-476a-bd24-8c9ae299e380 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] Returning 404 to user: Volume 647db992-b381-4014-86ac-a1395b9c2d1d could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:26:59.123209 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0591b3f-6bf2-476a-bd24-8c9ae299e380 tempest-VolumesGetTestJSON-719299906 tempest-VolumesGetTestJSON-719299906-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d" status: 404 len: 109 microversion: 2.1 time: 0.042730 Apr 09 21:26:59.123748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3009/5988] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Apr 9 21:26:59 2022] GET /compute/v2.1/os-volumes/647db992-b381-4014-86ac-a1395b9c2d1d => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:27:03.551460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:03.552081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:03.558369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:03.558769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:03.559553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:03.559997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:03.586865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:27:03.667745 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f11c4d01-f5e5-4a11-8fb1-35eebfe76477 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "DELETE /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 204 len: 0 microversion: 2.1 time: 0.371012 Apr 09 21:27:03.668498 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2980/5989] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:27:03 2022] DELETE /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:27:03.677725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:03.678642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:03.685507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:03.685967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:03.686756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:03.687198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:03.830153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:03.838255 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce3555f1-dcc4-4028-b96d-f8530283269f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1729 microversion: 2.1 time: 0.165164 Apr 09 21:27:03.838917 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3010/5990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:03 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:04.856874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:04.857766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:04.867654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:04.868113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:04.868907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:04.869372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:05.006456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:05.014072 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-37c3f2ba-22e1-4610-b77a-9f552ed00cc3 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1729 microversion: 2.1 time: 0.161898 Apr 09 21:27:05.014671 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2981/5991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:04 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:06.031678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:06.033491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:06.041860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:06.042981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:06.044115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:06.044892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:06.186813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81497a47682c4a89ad792ee59c13fc6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605e203fc5c04ed781bf67d309905d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:06.196140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85954458-1e58-497c-8ee5-24131c8bb061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 200 len: 1662 microversion: 2.1 time: 0.168774 Apr 09 21:27:06.197151 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3011/5992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:06 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:06.620099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1210e4fa-bce2-41e8-add7-43503816d58e req-0c1aceaa-3f5b-470e-9117-71a94e48a6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ed9de-6598-458b-bdc5-118c7ca85c48", "name": "network-vif-deleted", "tag": "4c7b21e8-849b-46e4-a86f-7e4c0cea2745"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:06.628858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1210e4fa-bce2-41e8-add7-43503816d58e req-0c1aceaa-3f5b-470e-9117-71a94e48a6fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:06.629681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1210e4fa-bce2-41e8-add7-43503816d58e req-0c1aceaa-3f5b-470e-9117-71a94e48a6fb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:06.642003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1210e4fa-bce2-41e8-add7-43503816d58e req-0c1aceaa-3f5b-470e-9117-71a94e48a6fb service nova] Creating event network-vif-deleted:4c7b21e8-849b-46e4-a86f-7e4c0cea2745 for instance 584ed9de-6598-458b-bdc5-118c7ca85c48 on nch1-master-1 Apr 09 21:27:06.647380 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1210e4fa-bce2-41e8-add7-43503816d58e req-0c1aceaa-3f5b-470e-9117-71a94e48a6fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264111 Apr 09 21:27:06.648561 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2982/5993] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:07.214636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:07.215405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:07.222888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.223758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.224651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.225312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.239334 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] HTTP exception thrown: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. Apr 09 21:27:07.239964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Returning 404 to user: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:27:07.240802 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-53c56a85-998c-4eb6-aaa6-2c416236a0cf tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 404 len: 111 microversion: 2.1 time: 0.030668 Apr 09 21:27:07.246756 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3012/5994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:07 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:27:07.751737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:07.752423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:07.759011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.759465 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.760275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.760730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.773978 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] HTTP exception thrown: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. Apr 09 21:27:07.774602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Returning 404 to user: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:27:07.775423 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-315fabc9-8bfe-4c51-a135-c5f5590bf81f tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "DELETE /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 404 len: 111 microversion: 2.1 time: 0.029194 Apr 09 21:27:07.775996 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2983/5995] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:27:07 2022] DELETE /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:27:07.784254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:07.784899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] [instance: 584ed9de-6598-458b-bdc5-118c7ca85c48] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:07.791371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.791843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.792594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:07.793042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:07.807303 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] HTTP exception thrown: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. Apr 09 21:27:07.807693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Returning 404 to user: Instance 584ed9de-6598-458b-bdc5-118c7ca85c48 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:27:07.808649 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60789d35-4b72-4423-8267-a0f33b6c9775 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48" status: 404 len: 111 microversion: 2.1 time: 0.028266 Apr 09 21:27:07.809109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3013/5996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:07 2022] GET /compute/v2.1/servers/584ed9de-6598-458b-bdc5-118c7ca85c48 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:27:07.976855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac86c4dd-a7ff-4b58-9280-929914bba061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] Calling method '.version_select at 0x7fb08daa9280>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:08.019425 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac86c4dd-a7ff-4b58-9280-929914bba061 tempest-TestServerBasicOps-247092232 tempest-TestServerBasicOps-247092232-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-934123988" status: 202 len: 0 microversion: 2.1 time: 0.034489 Apr 09 21:27:08.020079 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2984/5997] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-934123988 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:27:20.090315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1277202579", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "88dcdf7c-5b2f-4b68-9daf-89dea963dd97"}], "key_name": "tempest-TestSecurityGroupsBasicOps-402429487", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5cb01d26-3f1e-4f5f-a85a-9cef4c817f33"]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:20.169581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] validate_networks() for [('88dcdf7c-5b2f-4b68-9daf-89dea963dd97', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:27:20.754205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:27:20.754854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:27:20.755214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:27:20.755950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:27:20.756031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:27:20.764971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:20.765451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:20.766253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:20.766696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:20.784286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for project f835ef5aefe44c96bc20308d450b5680. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:27:20.789748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Getting quotas for user 0818e5f0edb74b82821c07c88df54826 and project f835ef5aefe44c96bc20308d450b5680. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:27:20.803608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:27:20.806220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:27:20.857987 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc382763-247b-4b49-b5de-0db91db60c07 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.771952 Apr 09 21:27:20.861240 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3014/5998] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:27:20 2022] POST /compute/v2.1/servers => generated 361 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:27:20.871263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9060865-ab42-4e6b-b2e9-54e13022189a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:20.871897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9060865-ab42-4e6b-b2e9-54e13022189a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:20.939322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f9060865-ab42-4e6b-b2e9-54e13022189a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:20.948137 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9060865-ab42-4e6b-b2e9-54e13022189a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1241 microversion: 2.1 time: 0.081823 Apr 09 21:27:20.949220 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2985/5999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:20 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:27:21.966658 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:21.967559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:21.985704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:21.986917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:21.988760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:21.989518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:22.079807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:22.089056 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4052832d-c304-4eeb-827a-1e00ba77050a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1301 microversion: 2.1 time: 0.127342 Apr 09 21:27:22.090045 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3015/6000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:21 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:23.107736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:23.108463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:23.123046 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:23.123755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:23.124699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:23.125329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:23.226873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:23.235747 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff8fd740-73dc-4506-9eca-e8a717342f1e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.132450 Apr 09 21:27:23.238006 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2986/6001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:23 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:23.691706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6263166b-bbb0-4477-a525-13d667131c2b req-1db89e05-95d1-453b-b802-d5b85ec44ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be", "tag": "47194a7e-8340-4b25-82e7-d0bfdb84b453"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:23.703141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6263166b-bbb0-4477-a525-13d667131c2b req-1db89e05-95d1-453b-b802-d5b85ec44ae5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:23.703681 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6263166b-bbb0-4477-a525-13d667131c2b req-1db89e05-95d1-453b-b802-d5b85ec44ae5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:23.743170 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6263166b-bbb0-4477-a525-13d667131c2b req-1db89e05-95d1-453b-b802-d5b85ec44ae5 service nova] Creating event network-changed:47194a7e-8340-4b25-82e7-d0bfdb84b453 for instance b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be on nch2-master-1 Apr 09 21:27:23.752116 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6263166b-bbb0-4477-a525-13d667131c2b req-1db89e05-95d1-453b-b802-d5b85ec44ae5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065264 Apr 09 21:27:23.752741 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3016/6002] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:24.254934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:24.255778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:24.262846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:24.263308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:24.264084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:24.264545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:24.352090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:24.359680 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8c0aca5-3ad7-44af-a7c2-703208cb7372 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.109041 Apr 09 21:27:24.360366 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2987/6003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:24 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:25.377792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:25.378635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:25.385081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:25.385548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:25.386306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:25.386741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:25.475884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:25.484215 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7111592c-09b5-44b3-b929-7a6b199b6e0b tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.111763 Apr 09 21:27:25.489148 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3017/6004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:25 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:26.501742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:26.502363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:26.510897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:26.511349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:26.512144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:26.512576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:26.610345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:26.618709 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-97d343a4-6045-4849-8e45-a7d3cdcfdd41 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.121129 Apr 09 21:27:26.619954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2988/6005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:26 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:27.636247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:27.636993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:27.644181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:27.644730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:27.645809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:27.646163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:27.744598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:27.752316 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c44b48d0-f922-4fd6-8e00-c449818eb705 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.119997 Apr 09 21:27:27.752931 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3018/6006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:27 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:28.770139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:28.770753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:28.777513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:28.777975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:28.778730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:28.779158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:28.865960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:28.873693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d83160e8-e858-4535-9633-abd97c1b1ccf tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.107512 Apr 09 21:27:28.874516 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2989/6007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:28 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:29.890792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:29.891351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:29.898730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:29.899177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:29.899991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:29.900424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:29.982775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:29.990703 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f3a1b1e-e610-45c9-863f-d02a71edad66 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.104046 Apr 09 21:27:29.991390 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3019/6008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:29 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:30.612039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e5ad850f-448c-4669-a454-461bb3d6bf3d req-80cf40f7-f605-4bd8-a71e-d556a8a42e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be", "name": "network-vif-plugged", "status": "completed", "tag": "47194a7e-8340-4b25-82e7-d0bfdb84b453"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:30.621419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e5ad850f-448c-4669-a454-461bb3d6bf3d req-80cf40f7-f605-4bd8-a71e-d556a8a42e24 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:30.621959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e5ad850f-448c-4669-a454-461bb3d6bf3d req-80cf40f7-f605-4bd8-a71e-d556a8a42e24 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:30.636381 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e5ad850f-448c-4669-a454-461bb3d6bf3d req-80cf40f7-f605-4bd8-a71e-d556a8a42e24 service nova] Creating event network-vif-plugged:47194a7e-8340-4b25-82e7-d0bfdb84b453 for instance b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be on nch2-master-1 Apr 09 21:27:30.641844 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e5ad850f-448c-4669-a454-461bb3d6bf3d req-80cf40f7-f605-4bd8-a71e-d556a8a42e24 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 Apr 09 21:27:30.642553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2990/6009] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:31.007728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:31.008479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:31.015335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:31.015786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:31.016599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:31.017055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:31.100943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:31.108876 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fab928eb-5953-4edf-b038-78573f1939e7 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1299 microversion: 2.1 time: 0.105102 Apr 09 21:27:31.109493 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3020/6010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:31 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:32.136487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.138107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.144387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.144836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.145758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.146222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.234168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:32.242928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a2062e1-d209-456d-871e-cec461db46c6 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1472 microversion: 2.1 time: 0.113397 Apr 09 21:27:32.243688 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2991/6011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:32 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:32.259821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.260446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.267463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.267927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.268845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.269317 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.356086 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:32.367012 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01c4ca49-8122-4e4e-923c-edf727045aa2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1472 microversion: 2.1 time: 0.111386 Apr 09 21:27:32.367594 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3021/6012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:32 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1472 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:32.382658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.383275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.389512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.390079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.390935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.391442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.474026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dfb867c7-55ce-42e4-bbca-4c89d4e639ab tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1623 microversion: 2.1 time: 0.095243 Apr 09 21:27:32.474698 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2992/6013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:32 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:32.489879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.490512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.496456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.496908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.497717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.498167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.633739 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ba0e00a-8e96-4680-b6de-d2d68831105c tempest-TestSecurityGroupsBasicOps-1107500939 tempest-TestSecurityGroupsBasicOps-1107500939-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1909 microversion: 2.1 time: 0.147588 Apr 09 21:27:32.634322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3022/6014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:32 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1909 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:32.696816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.697349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.703611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.704089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.704853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.705325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.729457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:27:32.806442 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-560e9ca0-fd97-456c-b7be-45c093233e1a tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 204 len: 0 microversion: 2.1 time: 0.113204 Apr 09 21:27:32.807049 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2993/6015] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:27:32 2022] DELETE /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:27:32.815949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:32.816585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:32.824602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.825109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.825942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:32.826397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:32.907751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:32.915628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46791ab8-2014-4af6-85a1-d787888c5ffc tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1478 microversion: 2.1 time: 0.104008 Apr 09 21:27:32.916374 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3023/6016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:32 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1478 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:33.934538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:33.935248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:33.943258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:33.943749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:33.944536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:33.944976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:34.030185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:34.039018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e3650b52-77d2-424c-9bf0-1592bab72c0e tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1478 microversion: 2.1 time: 0.108878 Apr 09 21:27:34.039650 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2994/6017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:33 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1478 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:27:34.905005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c2ec4449-f348-4bf5-b791-fbc184dd187a req-0f477382-a4dd-4728-8ef1-4fb220c0cc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be", "name": "network-vif-deleted", "tag": "47194a7e-8340-4b25-82e7-d0bfdb84b453"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:34.917709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2ec4449-f348-4bf5-b791-fbc184dd187a req-0f477382-a4dd-4728-8ef1-4fb220c0cc0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:34.918543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c2ec4449-f348-4bf5-b791-fbc184dd187a req-0f477382-a4dd-4728-8ef1-4fb220c0cc0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:34.933254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c2ec4449-f348-4bf5-b791-fbc184dd187a req-0f477382-a4dd-4728-8ef1-4fb220c0cc0d service nova] Creating event network-vif-deleted:47194a7e-8340-4b25-82e7-d0bfdb84b453 for instance b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be on nch2-master-1 Apr 09 21:27:34.940663 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c2ec4449-f348-4bf5-b791-fbc184dd187a req-0f477382-a4dd-4728-8ef1-4fb220c0cc0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040199 Apr 09 21:27:34.941505 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3024/6018] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:35.056072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:35.056711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:35.063854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:35.064492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:35.065295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:35.065729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:35.099936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:35.100314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:35.100763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lazy-loading 'fault' on Instance uuid b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:27:35.143754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:35.151796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f15feb96-f99a-4bb4-9b32-c27639b700d2 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 200 len: 1331 microversion: 2.1 time: 0.099822 Apr 09 21:27:35.152395 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2995/6019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:35 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:36.169778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:36.170536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:36.177814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:36.178357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:36.179358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:36.179865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:36.195997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] HTTP exception thrown: Instance b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be could not be found. Apr 09 21:27:36.196686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Returning 404 to user: Instance b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:27:36.197627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb074c82-8ab0-4c62-a272-42b55cacf9b0 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be" status: 404 len: 111 microversion: 2.1 time: 0.032557 Apr 09 21:27:36.198289 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3025/6020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:36 2022] GET /compute/v2.1/servers/b3e9fc07-4fdf-491f-8a4a-e03d7b5f92be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:27:41.997984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:41.998496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:42.011545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:42.012026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:42.012863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:42.013350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:42.058339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:27:42.161193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5cab5d9a-cf21-4bc4-8667-af02c9087aa2 req-d3a57307-b856-4ed1-bff9-26990cb9456c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb01d26-3f1e-4f5f-a85a-9cef4c817f33", "tag": "be033c1b-34cc-4943-b7a1-22bca07d3ec3"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:42.167260 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3390f596-6b35-40cb-a9cb-9205b314e2db tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 204 len: 0 microversion: 2.1 time: 0.170774 Apr 09 21:27:42.168013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2996/6021] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:27:41 2022] DELETE /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:27:42.171353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5cab5d9a-cf21-4bc4-8667-af02c9087aa2 req-d3a57307-b856-4ed1-bff9-26990cb9456c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:42.171955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5cab5d9a-cf21-4bc4-8667-af02c9087aa2 req-d3a57307-b856-4ed1-bff9-26990cb9456c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:42.176759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:42.177541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:42.183568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:42.184025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:42.184804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:42.185278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:42.185557 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5cab5d9a-cf21-4bc4-8667-af02c9087aa2 req-d3a57307-b856-4ed1-bff9-26990cb9456c service nova] Creating event network-changed:be033c1b-34cc-4943-b7a1-22bca07d3ec3 for instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 on nch1-master-1 Apr 09 21:27:42.193167 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5cab5d9a-cf21-4bc4-8667-af02c9087aa2 req-d3a57307-b856-4ed1-bff9-26990cb9456c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195818 Apr 09 21:27:42.194996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3026/6022] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:42.681238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:42.689691 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0537a41e-fc6d-4dad-8825-b543436d0ef1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1764 microversion: 2.1 time: 0.517194 Apr 09 21:27:42.690295 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2997/6023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:42 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1764 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:43.708762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:43.709696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:43.717070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:43.717572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:43.718363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:43.718808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:44.210492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:44.219030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5a19189-b267-448b-a3bb-3d93b91cc784 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1764 microversion: 2.1 time: 0.515448 Apr 09 21:27:44.219619 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3027/6024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:43 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1764 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:44.887210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-87566aab-7c80-4787-b524-a356ee58f7ce req-f6b360df-9b8c-4d70-834d-6816f1bbde72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb01d26-3f1e-4f5f-a85a-9cef4c817f33", "name": "network-vif-deleted", "tag": "be033c1b-34cc-4943-b7a1-22bca07d3ec3"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:27:44.898411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-87566aab-7c80-4787-b524-a356ee58f7ce req-f6b360df-9b8c-4d70-834d-6816f1bbde72 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:44.898858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-87566aab-7c80-4787-b524-a356ee58f7ce req-f6b360df-9b8c-4d70-834d-6816f1bbde72 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:44.910693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-87566aab-7c80-4787-b524-a356ee58f7ce req-f6b360df-9b8c-4d70-834d-6816f1bbde72 service nova] Creating event network-vif-deleted:be033c1b-34cc-4943-b7a1-22bca07d3ec3 for instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 on nch1-master-1 Apr 09 21:27:44.918055 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-87566aab-7c80-4787-b524-a356ee58f7ce req-f6b360df-9b8c-4d70-834d-6816f1bbde72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Apr 09 21:27:44.918687 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2998/6025] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:27:45.236055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:45.237305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:45.244225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:45.244680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:45.245562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:45.246000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:45.287144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:45.287954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:45.288734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lazy-loading 'fault' on Instance uuid 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:27:45.361927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818e5f0edb74b82821c07c88df54826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835ef5aefe44c96bc20308d450b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:27:45.371793 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-90411f23-adc8-45d1-b579-80053fce8588 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 200 len: 1383 microversion: 2.1 time: 0.139660 Apr 09 21:27:45.372589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3028/6026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:45 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 1383 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:27:46.391091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:46.391783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] [instance: 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:27:46.398079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:46.398524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:46.399363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:27:46.399819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:27:46.413429 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] HTTP exception thrown: Instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 could not be found. Apr 09 21:27:46.414021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Returning 404 to user: Instance 5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:27:46.414849 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4fa1bd5f-ea22-4910-bd21-fe5759c439d1 tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33" status: 404 len: 111 microversion: 2.1 time: 0.029278 Apr 09 21:27:46.415391 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 2999/6027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:27:46 2022] GET /compute/v2.1/servers/5cb01d26-3f1e-4f5f-a85a-9cef4c817f33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:27:51.038071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-363ce275-9889-40a0-9ce9-ced6dc2782ce tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] Calling method '.version_select at 0x7fb08edc70d0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:27:51.076286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-363ce275-9889-40a0-9ce9-ced6dc2782ce tempest-TestSecurityGroupsBasicOps-1691406591 tempest-TestSecurityGroupsBasicOps-1691406591-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-402429487" status: 202 len: 0 microversion: 2.1 time: 0.042923 Apr 09 21:27:51.077333 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3029/6028] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-402429487 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:28:05.462032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:05.463494 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:28:05.463494 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:28:05.464733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:05.465271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:05.466187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:05.466820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:05.491303 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5c20ecb3-0135-411c-9c87-2e405b76db00 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.329048 Apr 09 21:28:05.491845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3000/6029] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Apr 9 21:28:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:28:05.595568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1271134115", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "4c1eb64b-bdbd-4129-b2ec-43b4067b6a33"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:05.662249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] validate_networks() for [('4c1eb64b-bdbd-4129-b2ec-43b4067b6a33', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:28:06.061958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:28:06.064364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:28:06.064783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:28:06.065242 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:28:06.065657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:28:06.078582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:06.079052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:06.079954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:06.080372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:06.103912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Getting quotas for project f9c697ea47df45069a2be9e2124600f9. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:28:06.109683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Getting quotas for user c90ad32122404dd59aeead26f9764953 and project f9c697ea47df45069a2be9e2124600f9. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:28:06.122211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:28:06.124760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:28:06.183277 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4545840a-802f-485a-9403-6f9e1a23e9f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593181 Apr 09 21:28:06.184849 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3030/6030] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:28:06.201341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f323e74c-6699-45e9-9d31-51cf26ec92e2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:06.202981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f323e74c-6699-45e9-9d31-51cf26ec92e2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:06.278087 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f323e74c-6699-45e9-9d31-51cf26ec92e2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1329 microversion: 2.1 time: 0.087559 Apr 09 21:28:06.294030 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3001/6031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:06 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:07.313459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:07.314793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:07.323040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:07.324092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:07.329061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:07.330506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:07.524753 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2a449cc-4baa-48fe-a922-b5dee3b4a761 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1424 microversion: 2.1 time: 0.217989 Apr 09 21:28:07.526536 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3031/6032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:07 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1424 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:08.545258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:08.546680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:08.555900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:08.556676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:08.557961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:08.558671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:08.724251 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3bbde23d-2aab-4cb9-aaa9-e566d994f9c1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.184353 Apr 09 21:28:08.734668 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3002/6033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:08 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:08.992886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c0e83c20-f97d-4606-81cf-f046de67d4e8 req-ca65ad32-0bd3-4241-9134-da8430698f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e8ea21-d185-46e5-a959-eb05f549a6dc", "tag": "9d2cb804-1803-4e27-bd87-498b577cb8e0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:09.009910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c0e83c20-f97d-4606-81cf-f046de67d4e8 req-ca65ad32-0bd3-4241-9134-da8430698f6f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:09.012563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c0e83c20-f97d-4606-81cf-f046de67d4e8 req-ca65ad32-0bd3-4241-9134-da8430698f6f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:09.035522 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c0e83c20-f97d-4606-81cf-f046de67d4e8 req-ca65ad32-0bd3-4241-9134-da8430698f6f service nova] Creating event network-changed:9d2cb804-1803-4e27-bd87-498b577cb8e0 for instance 24e8ea21-d185-46e5-a959-eb05f549a6dc on nch2-master-1 Apr 09 21:28:09.048137 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c0e83c20-f97d-4606-81cf-f046de67d4e8 req-ca65ad32-0bd3-4241-9134-da8430698f6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058889 Apr 09 21:28:09.049075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3032/6034] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:28:09.741470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:09.742129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:09.748994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:09.749491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:09.750270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:09.750764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:09.880864 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-74385afd-5859-42bc-b3eb-818c55f053f1 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.143176 Apr 09 21:28:09.881484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3003/6035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:09 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:10.898961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:10.899673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:10.906443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:10.906896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:10.907687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:10.908132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:11.143311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f380177-2b3f-4aa0-ab6b-66d435d97722 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.249293 Apr 09 21:28:11.143919 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3033/6036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:10 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:12.160510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:12.161096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:12.168087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:12.168527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:12.169559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:12.170006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:12.315893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a97167f0-1abd-47c1-be38-1977e212d32b tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.159248 Apr 09 21:28:12.316748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3004/6037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:12 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:13.332799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:13.333441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:13.340817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:13.341159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:13.341920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:13.342361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:13.472914 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fde34715-f31e-468f-b992-61a82a25c362 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.143858 Apr 09 21:28:13.473528 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3034/6038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:13 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:14.490554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:14.491146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:14.498485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:14.499142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:14.499970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:14.500393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:14.637609 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6aa0caf-4600-420e-87ad-a4a214abd7da tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.151163 Apr 09 21:28:14.638203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3005/6039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:14 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:15.656231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:15.656886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:15.664756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:15.665218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:15.666031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:15.666472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:15.889456 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-21f06e2a-8625-4bdd-888b-bea2905d464d tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.237915 Apr 09 21:28:15.890139 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3035/6040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:15 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:16.907433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:16.908658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:16.916059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:16.916516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:16.917462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:16.917912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:17.030033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-286fba45-11a8-418a-adda-357ef75dc5bc req-e9c7a877-3570-40bb-a7c3-ef1315e42b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e8ea21-d185-46e5-a959-eb05f549a6dc", "name": "network-vif-plugged", "status": "completed", "tag": "9d2cb804-1803-4e27-bd87-498b577cb8e0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:17.041543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-286fba45-11a8-418a-adda-357ef75dc5bc req-e9c7a877-3570-40bb-a7c3-ef1315e42b60 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:17.042351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-286fba45-11a8-418a-adda-357ef75dc5bc req-e9c7a877-3570-40bb-a7c3-ef1315e42b60 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:17.061601 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-891bdb5e-c6df-4413-9869-4584cafc7561 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.158155 Apr 09 21:28:17.066004 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3006/6041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:16 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:17.067492 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-286fba45-11a8-418a-adda-357ef75dc5bc req-e9c7a877-3570-40bb-a7c3-ef1315e42b60 service nova] Creating event network-vif-plugged:9d2cb804-1803-4e27-bd87-498b577cb8e0 for instance 24e8ea21-d185-46e5-a959-eb05f549a6dc on nch2-master-1 Apr 09 21:28:17.073232 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-286fba45-11a8-418a-adda-357ef75dc5bc req-e9c7a877-3570-40bb-a7c3-ef1315e42b60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047598 Apr 09 21:28:17.074459 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3036/6042] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:28:18.083021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:18.083583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:18.091206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:18.091664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:18.092601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:18.093061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:18.225277 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e8424b92-7f1b-4f68-b147-9dc468ed09ba tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1464 microversion: 2.1 time: 0.146240 Apr 09 21:28:18.225867 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3007/6043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:18 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:19.243084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:19.243796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:19.250611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.251062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.251835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.252309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.381217 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da622ab7-0936-4888-855b-798ee23dc0a9 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1649 microversion: 2.1 time: 0.143086 Apr 09 21:28:19.381811 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3037/6044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:19 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1649 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:19.397896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:19.398588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:19.406309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.406866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.407702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.408135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.550289 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81a0732b-ab61-4bb9-9eaf-4badce35c4f2 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1649 microversion: 2.1 time: 0.156277 Apr 09 21:28:19.550886 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3008/6045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:19 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:19.566139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:19.567173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:19.573462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.573897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.574678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:19.575116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:19.698980 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18c32071-e30e-438c-bc6e-b079833484aa tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1649 microversion: 2.1 time: 0.136585 Apr 09 21:28:19.699559 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3038/6046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:19 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1649 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:19.800072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1167941105", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "4c1eb64b-bdbd-4129-b2ec-43b4067b6a33"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:19.860163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] validate_networks() for [('4c1eb64b-bdbd-4129-b2ec-43b4067b6a33', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:28:20.203868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:28:20.204285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:28:20.204727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:28:20.205157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:28:20.205565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:28:20.215187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:20.215730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:20.216536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:20.216969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:20.233578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Getting quotas for project f9c697ea47df45069a2be9e2124600f9. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:28:20.238826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Getting quotas for user c90ad32122404dd59aeead26f9764953 and project f9c697ea47df45069a2be9e2124600f9. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:28:20.251365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:28:20.253707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:28:20.298894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cff41c8d-3c78-4a41-bdfc-65635ac42e7c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502718 Apr 09 21:28:20.304354 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3009/6047] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:28:20.309562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0fe6c588-c722-417f-a121-9945cb2cdc16 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:20.310178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0fe6c588-c722-417f-a121-9945cb2cdc16 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:20.393063 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0fe6c588-c722-417f-a121-9945cb2cdc16 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1329 microversion: 2.1 time: 0.087115 Apr 09 21:28:20.393867 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3039/6048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:20 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1329 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:21.410828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:21.411427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:21.419652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:21.420107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:21.420882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:21.421524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:21.508855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65283bd9-50e9-4728-a13c-8a06c5a508d0 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1422 microversion: 2.1 time: 0.102813 Apr 09 21:28:21.509494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3010/6049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:21 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:22.527071 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:22.529469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:22.537109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7836ad88-d884-4ae2-89aa-4e2ea478469e req-d2fc120c-aabd-4c0b-88a8-475cdd4be39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b33d56-3d20-476b-abf6-caa21648e913", "tag": "ecef4b84-db22-4ea7-b7b9-c9ca18be7f17"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:22.553680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7836ad88-d884-4ae2-89aa-4e2ea478469e req-d2fc120c-aabd-4c0b-88a8-475cdd4be39f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:22.554128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7836ad88-d884-4ae2-89aa-4e2ea478469e req-d2fc120c-aabd-4c0b-88a8-475cdd4be39f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:22.557864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:22.558602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:22.559608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:22.561563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:22.589026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7836ad88-d884-4ae2-89aa-4e2ea478469e req-d2fc120c-aabd-4c0b-88a8-475cdd4be39f service nova] Creating event network-changed:ecef4b84-db22-4ea7-b7b9-c9ca18be7f17 for instance 60b33d56-3d20-476b-abf6-caa21648e913 on nch1-master-1 Apr 09 21:28:22.599416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7836ad88-d884-4ae2-89aa-4e2ea478469e req-d2fc120c-aabd-4c0b-88a8-475cdd4be39f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066355 Apr 09 21:28:22.600788 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3011/6050] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:28:22.774493 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f00427e3-1a4c-47a9-8f08-212b257ca746 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.251945 Apr 09 21:28:22.777761 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3040/6051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:22 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:23.794463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:23.795089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:23.803529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:23.803983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:23.804967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:23.805601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:23.949379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b94f2b6b-a650-4976-9101-76cc6f1b4195 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.159153 Apr 09 21:28:23.949981 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3012/6052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:23 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:24.966638 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:24.967383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:24.975370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:24.975851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:24.976631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:24.977130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:25.107622 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b07500f0-dd5d-4fc3-8990-75888e7520cf tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.144714 Apr 09 21:28:25.108294 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3041/6053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:24 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:26.125608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:26.126220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:26.134052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:26.134480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:26.135294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:26.135900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:26.275524 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d867aa12-f8b2-457a-8949-d3c2f5383f83 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.154115 Apr 09 21:28:26.276493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3013/6054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:26 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:27.293005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:27.293643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:27.300627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:27.301075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:27.301864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:27.302432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:27.445874 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5585278e-79ee-4369-87a7-a678b0923712 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.156563 Apr 09 21:28:27.446543 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3042/6055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:27 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:27.912321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-77f32435-37cb-4f70-a0a8-98caec553cd0 req-ede04bf8-105b-444a-a88c-22a3a345d325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b33d56-3d20-476b-abf6-caa21648e913", "name": "network-vif-plugged", "status": "completed", "tag": "ecef4b84-db22-4ea7-b7b9-c9ca18be7f17"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:27.922854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-77f32435-37cb-4f70-a0a8-98caec553cd0 req-ede04bf8-105b-444a-a88c-22a3a345d325 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:27.923698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-77f32435-37cb-4f70-a0a8-98caec553cd0 req-ede04bf8-105b-444a-a88c-22a3a345d325 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:27.938154 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-77f32435-37cb-4f70-a0a8-98caec553cd0 req-ede04bf8-105b-444a-a88c-22a3a345d325 service nova] Creating event network-vif-plugged:ecef4b84-db22-4ea7-b7b9-c9ca18be7f17 for instance 60b33d56-3d20-476b-abf6-caa21648e913 on nch1-master-1 Apr 09 21:28:27.944566 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-77f32435-37cb-4f70-a0a8-98caec553cd0 req-ede04bf8-105b-444a-a88c-22a3a345d325 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Apr 09 21:28:27.945418 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3014/6056] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:28:28.462860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:28.463481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:28.471249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:28.471701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:28.472474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:28.472935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:28.644331 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba7e6f6e-a585-4e12-b1bd-b40fa9ad5a7f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1464 microversion: 2.1 time: 0.185747 Apr 09 21:28:28.644938 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3043/6057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:28 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:29.661938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:29.662716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:29.670246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:29.670702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:29.671485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:29.671921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:29.807315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b473b499-aaad-400e-8b12-519974d17b52 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1650 microversion: 2.1 time: 0.149478 Apr 09 21:28:29.808234 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3015/6058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:29 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:29.823949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:29.825303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:29.833315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:29.834239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:29.835238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:29.836081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.048931 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b9ab557a-148c-4a68-889d-8af7f54fa153 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1650 microversion: 2.1 time: 0.228855 Apr 09 21:28:30.049942 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3044/6059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:29 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1650 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:30.068595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:30.069480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:30.077702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.078274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.079203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.079912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.235328 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8aa5263-3c6e-49c7-aca9-cf339ad6da92 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1650 microversion: 2.1 time: 0.170759 Apr 09 21:28:30.252254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:30.252705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:30.255304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3016/6060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:30 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1650 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:30.259311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.259864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.260717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.261257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.286312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:28:30.382815 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-109b78ff-f93a-4f0a-8523-3cc32115a64c tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 204 len: 0 microversion: 2.1 time: 0.134023 Apr 09 21:28:30.383425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3045/6061] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:28:30 2022] DELETE /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:28:30.392216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:30.392959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:30.400990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.401769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.403004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:30.403554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:30.547848 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-297fff72-ca71-443f-b1ec-8029d4269043 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1656 microversion: 2.1 time: 0.158592 Apr 09 21:28:30.548386 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3017/6062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:30 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:31.566213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:31.567059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:31.576814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:31.577265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:31.578231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:31.578792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:31.831288 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-87901832-f401-4cb9-9d45-56c2045c2a4a tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 200 len: 1656 microversion: 2.1 time: 0.269450 Apr 09 21:28:31.831880 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3046/6063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:31 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 1656 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:32.205173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1a47df47-305c-46ac-9698-5569c9f0940a req-e9cf394a-444b-4cfb-b0f1-856ee52ebd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b33d56-3d20-476b-abf6-caa21648e913", "name": "network-vif-deleted", "tag": "ecef4b84-db22-4ea7-b7b9-c9ca18be7f17"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:32.221541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1a47df47-305c-46ac-9698-5569c9f0940a req-e9cf394a-444b-4cfb-b0f1-856ee52ebd32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:32.222137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1a47df47-305c-46ac-9698-5569c9f0940a req-e9cf394a-444b-4cfb-b0f1-856ee52ebd32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:32.248980 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1a47df47-305c-46ac-9698-5569c9f0940a req-e9cf394a-444b-4cfb-b0f1-856ee52ebd32 service nova] Creating event network-vif-deleted:ecef4b84-db22-4ea7-b7b9-c9ca18be7f17 for instance 60b33d56-3d20-476b-abf6-caa21648e913 on nch1-master-1 Apr 09 21:28:32.254175 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1a47df47-305c-46ac-9698-5569c9f0940a req-e9cf394a-444b-4cfb-b0f1-856ee52ebd32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052858 Apr 09 21:28:32.259013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3018/6064] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:28:32.847996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:32.848834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 60b33d56-3d20-476b-abf6-caa21648e913] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:32.856198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:32.856733 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:32.857572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:32.858005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:32.871716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] HTTP exception thrown: Instance 60b33d56-3d20-476b-abf6-caa21648e913 could not be found. Apr 09 21:28:32.872343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Returning 404 to user: Instance 60b33d56-3d20-476b-abf6-caa21648e913 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:28:32.873347 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cbd7c1d1-8b66-4696-8f91-82e98d8a6ad3 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913" status: 404 len: 111 microversion: 2.1 time: 0.029177 Apr 09 21:28:32.873889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3047/6065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:32 2022] GET /compute/v2.1/servers/60b33d56-3d20-476b-abf6-caa21648e913 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:28:32.882922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:32.883387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:32.892635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:32.893093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:32.894050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:32.894635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:32.923159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:28:33.023062 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b29dbff-e0f3-4918-89c1-256a6bfdc62f tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 204 len: 0 microversion: 2.1 time: 0.143824 Apr 09 21:28:33.024119 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3019/6066] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:28:32 2022] DELETE /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:28:33.032506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:33.033146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:33.039904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:33.040362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:33.041554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:33.042000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:33.286180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6ea3f5c1-d0ab-4cef-aa12-6ce4eb0d4e25 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1655 microversion: 2.1 time: 0.256971 Apr 09 21:28:33.287412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3048/6067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:33 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1655 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:34.303478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:34.304340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:34.312793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:34.313558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:34.314666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:34.315686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:34.462177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-77d88d93-cbb3-4911-9845-7167c68aeae6 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 200 len: 1655 microversion: 2.1 time: 0.162933 Apr 09 21:28:34.462820 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3020/6068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:34 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:28:35.002957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b044ea57-463b-4db9-84a5-a9117cc456ec req-9b24dc50-6475-4748-b38f-ed74e74a6aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e8ea21-d185-46e5-a959-eb05f549a6dc", "name": "network-vif-deleted", "tag": "9d2cb804-1803-4e27-bd87-498b577cb8e0"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:28:35.013098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b044ea57-463b-4db9-84a5-a9117cc456ec req-9b24dc50-6475-4748-b38f-ed74e74a6aa0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:35.013474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b044ea57-463b-4db9-84a5-a9117cc456ec req-9b24dc50-6475-4748-b38f-ed74e74a6aa0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:35.025706 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b044ea57-463b-4db9-84a5-a9117cc456ec req-9b24dc50-6475-4748-b38f-ed74e74a6aa0 service nova] Creating event network-vif-deleted:9d2cb804-1803-4e27-bd87-498b577cb8e0 for instance 24e8ea21-d185-46e5-a959-eb05f549a6dc on nch2-master-1 Apr 09 21:28:35.030879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b044ea57-463b-4db9-84a5-a9117cc456ec req-9b24dc50-6475-4748-b38f-ed74e74a6aa0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 Apr 09 21:28:35.031608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3049/6069] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:28:35.479965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:28:35.481318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] [instance: 24e8ea21-d185-46e5-a959-eb05f549a6dc] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:28:35.488373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:35.489180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:35.490210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:28:35.490703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:28:35.504656 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] HTTP exception thrown: Instance 24e8ea21-d185-46e5-a959-eb05f549a6dc could not be found. Apr 09 21:28:35.505592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] Returning 404 to user: Instance 24e8ea21-d185-46e5-a959-eb05f549a6dc could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:28:35.506428 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2995b08b-a328-4b6b-a30a-40167ea412f4 tempest-TestServerMultinode-345648672 tempest-TestServerMultinode-345648672-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc" status: 404 len: 111 microversion: 2.1 time: 0.030400 Apr 09 21:28:35.506987 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3021/6070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:28:35 2022] GET /compute/v2.1/servers/24e8ea21-d185-46e5-a959-eb05f549a6dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:02.772667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571810920", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:02.858827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:29:03.418350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:29:03.418591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:29:03.419068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:29:03.419467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:29:03.420243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:29:03.432402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:03.432860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:03.433703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:03.434144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:03.472168 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:29:03.485932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:29:03.502055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:29:03.504280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:29:03.595749 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d2d137c6-6525-411d-905b-70cf49382fa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828395 Apr 09 21:29:03.597086 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3050/6071] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:29:03.607109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1049d68-3f60-4c2d-939e-a4aa2c033f64 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:03.607736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1049d68-3f60-4c2d-939e-a4aa2c033f64 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:03.725134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1049d68-3f60-4c2d-939e-a4aa2c033f64 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:03.733004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1049d68-3f60-4c2d-939e-a4aa2c033f64 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1056 microversion: 2.1 time: 0.129951 Apr 09 21:29:03.734287 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3022/6072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:03 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1056 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:04.751635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:04.752282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:04.760132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:04.760797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:04.761797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:04.762248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:04.861300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:04.871536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a945bd56-df8e-4df6-8a7d-135c3bce9014 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1126 microversion: 2.1 time: 0.123957 Apr 09 21:29:04.873315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3051/6073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:04 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1126 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:05.888544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:05.889194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:05.897312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:05.898650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:05.899449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:05.899897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:06.204673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:06.212749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e035543-c444-4da5-bbe9-e69fa93c1bc7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1168 microversion: 2.1 time: 0.328194 Apr 09 21:29:06.213580 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3023/6074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:05 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1168 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:07.064272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-19e68687-60b8-426f-969f-1c665fc98988 req-20420b9e-8e7b-4e78-8c86-d7ea15a29355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da029986-1c2e-464a-bb27-be769fa60d3b", "tag": "dcacaed9-989b-49fe-a817-0cf5f6679f28"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:07.084073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-19e68687-60b8-426f-969f-1c665fc98988 req-20420b9e-8e7b-4e78-8c86-d7ea15a29355 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:07.088387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-19e68687-60b8-426f-969f-1c665fc98988 req-20420b9e-8e7b-4e78-8c86-d7ea15a29355 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:07.102173 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-19e68687-60b8-426f-969f-1c665fc98988 req-20420b9e-8e7b-4e78-8c86-d7ea15a29355 service nova] Creating event network-changed:dcacaed9-989b-49fe-a817-0cf5f6679f28 for instance da029986-1c2e-464a-bb27-be769fa60d3b on nch1-master-1 Apr 09 21:29:07.109476 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-19e68687-60b8-426f-969f-1c665fc98988 req-20420b9e-8e7b-4e78-8c86-d7ea15a29355 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055956 Apr 09 21:29:07.110724 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3052/6075] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:07.231225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:07.232072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:07.243091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:07.243551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:07.244349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:07.244788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:07.595002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:07.603079 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad8f365f-30ba-453b-b48e-fc6cd48bd8ea tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1168 microversion: 2.1 time: 0.377223 Apr 09 21:29:07.603670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3024/6076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:07 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1168 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:08.622881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:08.624219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:08.634368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:08.635030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:08.636128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:08.636808 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:09.006342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:09.017515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a26a4c34-0a26-4ee4-92ec-55125c22292d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1168 microversion: 2.1 time: 0.399804 Apr 09 21:29:09.018958 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3053/6077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:08 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1168 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:10.035065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:10.035688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:10.042243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:10.042698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:10.043466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:10.043905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:10.175448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:10.183532 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e22ba7b6-d9cc-442d-959c-302d05cfb5a8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1202 microversion: 2.1 time: 0.152273 Apr 09 21:29:10.184132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3025/6078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:10 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:11.201451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:11.202746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:11.210786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:11.211149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:11.211934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:11.212367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:11.578791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:11.587244 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8bfbdf81-37b7-4809-893f-54cac4d6dec7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1202 microversion: 2.1 time: 0.390090 Apr 09 21:29:11.587845 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3054/6079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:11 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1202 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:12.604164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:12.604712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:12.612058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:12.612998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:12.614072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:12.614729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:12.751865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:12.759601 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e15a3229-b1f6-4f24-89a5-93bb02320e35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1202 microversion: 2.1 time: 0.159638 Apr 09 21:29:12.760203 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3026/6080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:12 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:13.776003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:13.777316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:13.784332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:13.785028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:13.785882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:13.786295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:14.011177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:14.019255 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a963044a-cec2-463d-a969-abbafc51cae7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1202 microversion: 2.1 time: 0.247193 Apr 09 21:29:14.019847 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3055/6081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:13 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1202 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:29:14.270610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-55035244-9e44-48fe-9df6-26ae3ae57c6f req-4d15aa13-1c5d-4ba6-b64b-1eb73e5920c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da029986-1c2e-464a-bb27-be769fa60d3b", "name": "network-vif-plugged", "status": "completed", "tag": "dcacaed9-989b-49fe-a817-0cf5f6679f28"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:14.280612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-55035244-9e44-48fe-9df6-26ae3ae57c6f req-4d15aa13-1c5d-4ba6-b64b-1eb73e5920c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:14.281377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-55035244-9e44-48fe-9df6-26ae3ae57c6f req-4d15aa13-1c5d-4ba6-b64b-1eb73e5920c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:14.294046 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-55035244-9e44-48fe-9df6-26ae3ae57c6f req-4d15aa13-1c5d-4ba6-b64b-1eb73e5920c1 service nova] Creating event network-vif-plugged:dcacaed9-989b-49fe-a817-0cf5f6679f28 for instance da029986-1c2e-464a-bb27-be769fa60d3b on nch1-master-1 Apr 09 21:29:14.302293 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-55035244-9e44-48fe-9df6-26ae3ae57c6f req-4d15aa13-1c5d-4ba6-b64b-1eb73e5920c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035624 Apr 09 21:29:14.303140 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3027/6082] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:15.035955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:15.036564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:15.043644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:15.044164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:15.044950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:15.045414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:15.179093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:15.186852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9354e62d-6347-4c64-87d5-18cca2e6b8b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1202 microversion: 2.1 time: 0.155035 Apr 09 21:29:15.187440 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3056/6083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:15 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:16.205226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:16.206285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:16.214085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.214572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.215361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.215816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.351677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:16.361753 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64978ac6-2fd1-42a1-9ff7-f1f7bc4b05a1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1389 microversion: 2.1 time: 0.161912 Apr 09 21:29:16.362499 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3028/6084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:16 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:16.378606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:16.379571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:16.386475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.386941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.388050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.388610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.541858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:16.551376 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-45cdcf83-bee6-46ab-8ecb-f2072cb68951 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1389 microversion: 2.1 time: 0.176798 Apr 09 21:29:16.552099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3057/6085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:16 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1389 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:16.567260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:16.567871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:16.573918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.574376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.575165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.575612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.703040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:16.711124 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e20e4b2b-6c48-44a1-866c-b404482becdc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1389 microversion: 2.1 time: 0.147837 Apr 09 21:29:16.711702 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3029/6086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:16 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:16.780567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:16.781061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:16.787395 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.787861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.788620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.789141 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.813732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:29:16.896183 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-564e1291-6e27-46f0-8470-7703a92eed3a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 204 len: 0 microversion: 2.1 time: 0.119295 Apr 09 21:29:16.896593 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3058/6087] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:29:16 2022] DELETE /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:29:16.905570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:16.906428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:16.914073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.914745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:16.916680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:16.917237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:17.056423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:17.064244 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-efcc94a8-150a-42ec-bf83-9a6b2b6d7997 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1395 microversion: 2.1 time: 0.162903 Apr 09 21:29:17.064829 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3030/6088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:16 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1395 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:17.717358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1871556914", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "a6b4ace2-01e7-416c-a8a9-101f20c4f1c9"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:17.771331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] validate_networks() for [('a6b4ace2-01e7-416c-a8a9-101f20c4f1c9', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:29:18.081706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:18.082329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:18.089976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:18.090435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:18.091213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:18.091657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:18.188449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:29:18.188875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:29:18.189382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:29:18.189975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:29:18.190474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:29:18.200178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:18.200663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:18.201580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:18.202010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:18.219136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Getting quotas for project c2f4a5d8476f48828d3bf6816ac0d864. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:29:18.224587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Getting quotas for user a4bc643e662c4873a068f6a09663aef2 and project c2f4a5d8476f48828d3bf6816ac0d864. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:29:18.236772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:29:18.239543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:29:18.247296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:18.254974 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a2cdc434-7ef4-463d-8f25-3070ca5d4ea1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1395 microversion: 2.1 time: 0.177311 Apr 09 21:29:18.255603 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3031/6089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:18 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1395 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:18.292727 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c603cfe7-bcef-459c-978c-166927cd161e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701013 Apr 09 21:29:18.293411 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3059/6090] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:29:18.303808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf0655f9-c2c7-4a8b-ad50-6e8946bfa478 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:18.304429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cf0655f9-c2c7-4a8b-ad50-6e8946bfa478 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:18.358859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cf0655f9-c2c7-4a8b-ad50-6e8946bfa478 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:18.365907 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf0655f9-c2c7-4a8b-ad50-6e8946bfa478 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1214 microversion: 2.1 time: 0.066191 Apr 09 21:29:18.367100 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3032/6091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:18 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:19.007481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4ab3aa53-ed62-4205-be4e-be141ebc6798 req-ad4e0ba4-a17e-46d9-8e8f-a6c981f52e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da029986-1c2e-464a-bb27-be769fa60d3b", "name": "network-vif-deleted", "tag": "dcacaed9-989b-49fe-a817-0cf5f6679f28"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:19.017663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4ab3aa53-ed62-4205-be4e-be141ebc6798 req-ad4e0ba4-a17e-46d9-8e8f-a6c981f52e1e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.018088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4ab3aa53-ed62-4205-be4e-be141ebc6798 req-ad4e0ba4-a17e-46d9-8e8f-a6c981f52e1e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.029810 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4ab3aa53-ed62-4205-be4e-be141ebc6798 req-ad4e0ba4-a17e-46d9-8e8f-a6c981f52e1e service nova] Creating event network-vif-deleted:dcacaed9-989b-49fe-a817-0cf5f6679f28 for instance da029986-1c2e-464a-bb27-be769fa60d3b on nch1-master-1 Apr 09 21:29:19.035501 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4ab3aa53-ed62-4205-be4e-be141ebc6798 req-ad4e0ba4-a17e-46d9-8e8f-a6c981f52e1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Apr 09 21:29:19.036871 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3060/6092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:19.271898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:19.272520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:19.282953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.283409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.284287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.284713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.364530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.369698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.370405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid da029986-1c2e-464a-bb27-be769fa60d3b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:29:19.385640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:19.386534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:19.393772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.394547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.395526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:19.396151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:19.433122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:19.448172 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-abe5d267-70b2-40d2-a22c-b4026f2f385c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 200 len: 1192 microversion: 2.1 time: 0.179812 Apr 09 21:29:19.448944 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3033/6093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:19 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 1192 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:19.482405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:19.492003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4c9a5fb-e6fb-4d27-8cb3-3b75182bb6a7 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1284 microversion: 2.1 time: 0.111772 Apr 09 21:29:19.492851 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3061/6094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:19 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:20.468224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:20.468841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:20.475528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.475980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.476771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.477242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.491432 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. Apr 09 21:29:20.492039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:29:20.492881 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec7623c8-7cee-4b54-b2b4-c533496bb11a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 404 len: 111 microversion: 2.1 time: 0.030203 Apr 09 21:29:20.493492 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3034/6095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:20 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:20.508437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:20.509066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:20.517914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.517914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.517914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.517914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.523589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:20.524251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:20.530613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.531074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.531861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.532470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.547772 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. Apr 09 21:29:20.548815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:29:20.551010 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-687e9710-9b81-4e5d-9ba6-6df85cf3ba4a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 404 len: 111 microversion: 2.1 time: 0.031394 Apr 09 21:29:20.551611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3035/6096] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:29:20 2022] DELETE /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:20.560086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:20.560696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: da029986-1c2e-464a-bb27-be769fa60d3b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:20.567015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.567476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.568248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:20.568683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:20.584566 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. Apr 09 21:29:20.585188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance da029986-1c2e-464a-bb27-be769fa60d3b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:29:20.586035 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2f6f7657-d076-4b4b-b24e-77cf8d25865a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b" status: 404 len: 111 microversion: 2.1 time: 0.030063 Apr 09 21:29:20.586922 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3036/6097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:20 2022] GET /compute/v2.1/servers/da029986-1c2e-464a-bb27-be769fa60d3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:20.662146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:20.674236 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f351bf37-fa10-4087-ad9e-e862a9a073fc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.169484 Apr 09 21:29:20.675174 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3062/6098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:20 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:21.050643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7ecd679d-c8a6-409b-a75b-a67fa454249e req-19557f22-191b-4526-8a30-65b54cb0d682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a874eb-3709-4b9c-a4a9-ba3fb73d3180", "tag": "9774d97d-bbe6-48c2-b51c-47dc5cd77cba"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:21.061373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ecd679d-c8a6-409b-a75b-a67fa454249e req-19557f22-191b-4526-8a30-65b54cb0d682 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:21.062078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ecd679d-c8a6-409b-a75b-a67fa454249e req-19557f22-191b-4526-8a30-65b54cb0d682 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:21.085257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7ecd679d-c8a6-409b-a75b-a67fa454249e req-19557f22-191b-4526-8a30-65b54cb0d682 service nova] Creating event network-changed:9774d97d-bbe6-48c2-b51c-47dc5cd77cba for instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 on nch2-master-1 Apr 09 21:29:21.092256 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7ecd679d-c8a6-409b-a75b-a67fa454249e req-19557f22-191b-4526-8a30-65b54cb0d682 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045407 Apr 09 21:29:21.093459 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3037/6099] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:21.693656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:21.694298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:21.701564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:21.702019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:21.702845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:21.703278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:21.851547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:21.860073 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f7db6935-d0ec-41ea-9f1e-237a065c2dd4 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.171314 Apr 09 21:29:21.860661 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3063/6100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:21 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:22.877170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:22.877899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:22.885820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:22.886273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:22.887054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:22.887501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:23.021505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:23.029539 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8396d46a-815f-4012-aa4d-f86d4597f5cc tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.156684 Apr 09 21:29:23.030120 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3038/6101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:22 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:24.046801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:24.047423 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:24.054794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:24.055234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:24.056017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:24.056456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:24.195940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:24.203551 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-01be4147-7687-4a4b-9fc4-69be4f2d0477 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.160786 Apr 09 21:29:24.204140 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3064/6102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:24 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:25.221291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:25.221918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:25.229221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:25.229874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:25.230911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:25.231571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:25.391157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:25.399306 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e2dc49d-bdb4-4e29-b0dc-7c96db2c709e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.182062 Apr 09 21:29:25.399939 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3039/6103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:25 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:26.416154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:26.416885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:26.424058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:26.424518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:26.425345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:26.425845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:26.563998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:26.571214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1173534539", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "527175d7-c75b-4775-9719-6ac41f211e5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:26.572344 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa55a29d-23b1-43cd-a965-c2801f7d225f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.160290 Apr 09 21:29:26.572946 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3065/6104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:26 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:26.629593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:29:27.007122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:29:27.007547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:29:27.008049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:29:27.008455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:29:27.008866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:29:27.018353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:27.018797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:27.019598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:27.020043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:27.037191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:29:27.042979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:29:27.102796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:29:27.104894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='527175d7-c75b-4775-9719-6ac41f211e5f',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:29:27.204356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-50c57945-ed6d-4431-9b94-c7939e5b4e18 req-5cc669ea-e9a5-4af0-a943-6bb8b70771f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a874eb-3709-4b9c-a4a9-ba3fb73d3180", "name": "network-vif-plugged", "status": "completed", "tag": "9774d97d-bbe6-48c2-b51c-47dc5cd77cba"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:27.212836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-50c57945-ed6d-4431-9b94-c7939e5b4e18 req-5cc669ea-e9a5-4af0-a943-6bb8b70771f0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:27.213349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-50c57945-ed6d-4431-9b94-c7939e5b4e18 req-5cc669ea-e9a5-4af0-a943-6bb8b70771f0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:27.225960 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-50c57945-ed6d-4431-9b94-c7939e5b4e18 req-5cc669ea-e9a5-4af0-a943-6bb8b70771f0 service nova] Creating event network-vif-plugged:9774d97d-bbe6-48c2-b51c-47dc5cd77cba for instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 on nch2-master-1 Apr 09 21:29:27.231329 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-50c57945-ed6d-4431-9b94-c7939e5b4e18 req-5cc669ea-e9a5-4af0-a943-6bb8b70771f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Apr 09 21:29:27.232097 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3066/6105] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:29:27.239198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671898 Apr 09 21:29:27.240776 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3040/6106] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:29:27.252262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75c8bce7-af32-449b-9991-3e9f54082e77 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:27.253223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-75c8bce7-af32-449b-9991-3e9f54082e77 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:27.316273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-75c8bce7-af32-449b-9991-3e9f54082e77 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:27.323346 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75c8bce7-af32-449b-9991-3e9f54082e77 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1071 microversion: 2.1 time: 0.076833 Apr 09 21:29:27.323942 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3067/6107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:27 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1071 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:27.590021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:27.590775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:27.598686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:27.599211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:27.600085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:27.600632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:28.006100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:28.017080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a056bed-d43d-43fd-9d67-44537be92498 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1314 microversion: 2.1 time: 0.430833 Apr 09 21:29:28.017773 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3041/6108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:27 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:28.340879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:28.342383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:28.351224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:28.351682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:28.352535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:28.352998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:28.421838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:28.429517 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8dc3397d-8768-4c2e-9fff-0708ccd8c4ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1187 microversion: 2.1 time: 0.093152 Apr 09 21:29:28.430358 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3068/6109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:28 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:29.034522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:29.035991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:29.049776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:29.050232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:29.051016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:29.051659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:29.304967 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:29.314292 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9a5cf6b2-7fc9-4765-bc27-dd83a70a0129 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1497 microversion: 2.1 time: 0.283736 Apr 09 21:29:29.314864 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3042/6110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:29 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1497 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:29.456146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:29.457498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:29.466184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:29.466992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:29.468397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:29.469002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:29.714516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ba8aaff8-1147-4c81-926d-ff992fa1c397 req-c7f77823-17e2-4b3f-827d-84821612e114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3328ec9-d468-4261-9f94-4bd6831f2cf5", "tag": "a434c4f5-9523-4c23-8408-30290b0eda20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:29.729604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ba8aaff8-1147-4c81-926d-ff992fa1c397 req-c7f77823-17e2-4b3f-827d-84821612e114 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:29.730764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ba8aaff8-1147-4c81-926d-ff992fa1c397 req-c7f77823-17e2-4b3f-827d-84821612e114 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:29.735140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:29.745907 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58dd38b8-188b-4b85-96c7-2123d05e2da2 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.303359 Apr 09 21:29:29.746534 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3069/6111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:29 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:29.764509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ba8aaff8-1147-4c81-926d-ff992fa1c397 req-c7f77823-17e2-4b3f-827d-84821612e114 service nova] Creating event network-changed:a434c4f5-9523-4c23-8408-30290b0eda20 for instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 on nch1-master-1 Apr 09 21:29:29.770627 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ba8aaff8-1147-4c81-926d-ff992fa1c397 req-c7f77823-17e2-4b3f-827d-84821612e114 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063067 Apr 09 21:29:29.771620 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3043/6112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:30.763815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:30.764569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:30.771282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:30.771742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:30.772710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:30.773193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:30.978956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:30.987296 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-20e43d4c-9cd3-4c04-b890-0d3bd9b13653 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.227576 Apr 09 21:29:30.988128 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3070/6113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:30 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:31.600562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:31.601151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:31.608003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:31.608456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:31.609282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:31.609973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:31.644203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:29:31.727408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a611db1-d930-4976-8442-5939a54f259e tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 204 len: 0 microversion: 2.1 time: 0.131701 Apr 09 21:29:31.728142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3044/6114] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:29:31 2022] DELETE /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:29:31.737179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:31.738153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:31.744644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:31.745147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:31.745938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:31.746394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:31.881399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:31.889419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2cad61ed-2d43-42f9-b29d-56449252e390 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1503 microversion: 2.1 time: 0.156738 Apr 09 21:29:31.890010 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3071/6115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:31 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:32.005981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:32.006694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:32.013132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:32.013588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:32.014365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:32.014807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:32.150185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:32.157776 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73901d2b-79f4-4c64-a927-6ce0d4394b94 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.157439 Apr 09 21:29:32.158359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3045/6116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:31 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:32.907122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:32.907742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:32.915146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:32.915598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:32.916396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:32.916834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:33.057900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:33.070829 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-28d5a9c8-e237-420b-b07c-13d3d3e5ddbb tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1503 microversion: 2.1 time: 0.167498 Apr 09 21:29:33.071742 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3072/6117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:32 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:33.178220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:33.178807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:33.186887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:33.187413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:33.188317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:33.188828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:33.326124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:33.334562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5747e1cc-8149-4014-a68a-9805bf7455a3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.161751 Apr 09 21:29:33.335118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3046/6118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:33 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:33.767284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9ce778bc-1530-49ad-bbab-ad6da5aed5ba req-f0c83a7b-b4f7-4f28-8a19-60fa0596a432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a874eb-3709-4b9c-a4a9-ba3fb73d3180", "name": "network-vif-deleted", "tag": "9774d97d-bbe6-48c2-b51c-47dc5cd77cba"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:33.775876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9ce778bc-1530-49ad-bbab-ad6da5aed5ba req-f0c83a7b-b4f7-4f28-8a19-60fa0596a432 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:33.776247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9ce778bc-1530-49ad-bbab-ad6da5aed5ba req-f0c83a7b-b4f7-4f28-8a19-60fa0596a432 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:33.788478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9ce778bc-1530-49ad-bbab-ad6da5aed5ba req-f0c83a7b-b4f7-4f28-8a19-60fa0596a432 service nova] Creating event network-vif-deleted:9774d97d-bbe6-48c2-b51c-47dc5cd77cba for instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 on nch2-master-1 Apr 09 21:29:33.794887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9ce778bc-1530-49ad-bbab-ad6da5aed5ba req-f0c83a7b-b4f7-4f28-8a19-60fa0596a432 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Apr 09 21:29:33.795726 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3073/6119] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:29:34.093392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:34.093921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:34.100498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:34.100959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:34.101833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:34.102278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:34.139771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:34.140330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:34.140792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lazy-loading 'fault' on Instance uuid d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:29:34.189440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bc643e662c4873a068f6a09663aef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f4a5d8476f48828d3bf6816ac0d864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:34.198387 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12fe4e01-6078-48e8-87e4-cab76b86a83f tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 200 len: 1304 microversion: 2.1 time: 0.109161 Apr 09 21:29:34.199984 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3047/6120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:34 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:34.351990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:34.352565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:34.359798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:34.360339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:34.361136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:34.361573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:34.498025 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:34.505787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2967d7ad-d5c3-4ecd-8f27-127472ae7ddd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.158422 Apr 09 21:29:34.506447 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3074/6121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:34 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:35.219988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:35.221089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] [instance: d3a874eb-3709-4b9c-a4a9-ba3fb73d3180] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:35.229792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:35.230227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:35.231002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:35.231431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:35.244882 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] HTTP exception thrown: Instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 could not be found. Apr 09 21:29:35.245502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] Returning 404 to user: Instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:29:35.246310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7963191f-4997-41f7-b119-0a29021c29f2 tempest-VolumesActionsTest-1368969787 tempest-VolumesActionsTest-1368969787-project] 10.222.0.30 "GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180" status: 404 len: 111 microversion: 2.1 time: 0.032956 Apr 09 21:29:35.246839 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3048/6122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:35 2022] GET /compute/v2.1/servers/d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:29:35.527020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:35.527020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:35.530588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:35.531056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:35.531838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:35.532281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:35.664524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:35.673459 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51273172-5fd6-494b-9cbf-8e8a3c8834b0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.154475 Apr 09 21:29:35.674153 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3075/6123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:35 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:36.470321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-42c30aaa-6b2e-446e-bc62-01f20c46d399 req-14d6ce80-91f8-4640-914a-b89f2a01ca77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3328ec9-d468-4261-9f94-4bd6831f2cf5", "name": "network-vif-plugged", "status": "completed", "tag": "a434c4f5-9523-4c23-8408-30290b0eda20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:36.479509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-42c30aaa-6b2e-446e-bc62-01f20c46d399 req-14d6ce80-91f8-4640-914a-b89f2a01ca77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:36.479917 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-42c30aaa-6b2e-446e-bc62-01f20c46d399 req-14d6ce80-91f8-4640-914a-b89f2a01ca77 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:36.491282 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-42c30aaa-6b2e-446e-bc62-01f20c46d399 req-14d6ce80-91f8-4640-914a-b89f2a01ca77 service nova] Creating event network-vif-plugged:a434c4f5-9523-4c23-8408-30290b0eda20 for instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 on nch1-master-1 Apr 09 21:29:36.496215 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-42c30aaa-6b2e-446e-bc62-01f20c46d399 req-14d6ce80-91f8-4640-914a-b89f2a01ca77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029830 Apr 09 21:29:36.496838 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3049/6124] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:36.690669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:36.691298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:36.698262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:36.698691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:36.699477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:36.699925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:36.840805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:36.848906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f196f3e4-86cc-4edb-b017-206cb629b8f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1217 microversion: 2.1 time: 0.162420 Apr 09 21:29:36.849531 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3076/6125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:36 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:37.867270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:37.867997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:37.874383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:37.874843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:37.875642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:37.876084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:38.015263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:38.025076 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bd11418d-0378-49b0-af5a-f85f55c8e2e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1404 microversion: 2.1 time: 0.162868 Apr 09 21:29:38.025651 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3050/6126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:37 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:38.042102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:38.042643 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:38.049821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:38.050286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:38.051210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:38.051712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:38.193261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:38.201519 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a52f224e-f314-4dce-8c9a-1c30a105e9e1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1404 microversion: 2.1 time: 0.164095 Apr 09 21:29:38.202143 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3077/6127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:38 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:38.218490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1661762751"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:38.219535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:38.225777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:38.226235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:38.226996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:38.227662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:38.316577 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Attempting to quiesce instance before volume snapshot. Apr 09 21:29:38.384858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Apr 09 21:29:38.463798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Creating snapshot from volume 527175d7-c75b-4775-9719-6ac41f211e5f. {{(pid=141819) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Apr 09 21:29:39.379427 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ace0f58-4049-4701-9b8c-a41563e29c9d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5/action" status: 202 len: 0 microversion: 2.1 time: 1.164699 Apr 09 21:29:39.380057 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3051/6128] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:29:38 2022] POST /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5/action => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 21:29:39.502919 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1259725607", "imageRef": "662afc2f-fa80-4123-8c0b-23e8e5f4c88c", "flavorRef": "452", "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:39.565450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:29:39.949023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:29:39.949521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:29:39.950033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:29:39.950447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:29:39.950836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:29:39.960786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:39.961331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:39.962179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:39.962626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:39.980381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:29:39.985954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:29:39.999760 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:29:40.002321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:29:40.079673 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580688 Apr 09 21:29:40.080259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3078/6129] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:29:40.091999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-00126bc2-4beb-4e03-a60d-1f66ac367232 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:40.092735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-00126bc2-4beb-4e03-a60d-1f66ac367232 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:40.147475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-00126bc2-4beb-4e03-a60d-1f66ac367232 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:40.155059 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-00126bc2-4beb-4e03-a60d-1f66ac367232 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1230 microversion: 2.1 time: 0.068203 Apr 09 21:29:40.155668 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3052/6130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:40 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1230 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:41.172943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:41.173751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:41.181190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:41.181641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:41.182421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:41.182856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:41.247812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:41.255796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0eed2e29-8a62-4f60-9fe4-f4182861ff60 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1300 microversion: 2.1 time: 0.087644 Apr 09 21:29:41.256528 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3079/6131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:41 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:42.282248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:42.282843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:42.294593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:42.295058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:42.296186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:42.296813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:42.466424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:42.474207 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee57c5d5-bec5-4e00-a9c5-b36b459c85ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1342 microversion: 2.1 time: 0.205056 Apr 09 21:29:42.474940 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3053/6132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:42 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:42.525817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-90daec23-ad79-4265-9038-d949e2e4fc3e req-445dfaad-e48c-4edd-8c0b-7c963ea9825b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2a7d95-b507-4d61-b9f4-681bd4a6143b", "tag": "5ff0070e-2d2e-4728-a500-032397afd5cb"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:42.543104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-90daec23-ad79-4265-9038-d949e2e4fc3e req-445dfaad-e48c-4edd-8c0b-7c963ea9825b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:42.544111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-90daec23-ad79-4265-9038-d949e2e4fc3e req-445dfaad-e48c-4edd-8c0b-7c963ea9825b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:42.581660 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-90daec23-ad79-4265-9038-d949e2e4fc3e req-445dfaad-e48c-4edd-8c0b-7c963ea9825b service nova] Creating event network-changed:5ff0070e-2d2e-4728-a500-032397afd5cb for instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b on nch2-master-1 Apr 09 21:29:42.587615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-90daec23-ad79-4265-9038-d949e2e4fc3e req-445dfaad-e48c-4edd-8c0b-7c963ea9825b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066588 Apr 09 21:29:42.588356 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3080/6133] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:29:43.491040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:43.492219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:43.499668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:43.500138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:43.501151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:43.501610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:43.635747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:43.644064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7b9c9114-eab1-4348-8e0f-b8b80933a4e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1342 microversion: 2.1 time: 0.157612 Apr 09 21:29:43.644654 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3054/6134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:43 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:44.663172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:44.664551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:44.671637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:44.672096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:44.672947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:44.673411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:44.824514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:44.834166 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d1a23e4a-7715-4d15-86ac-e0765cf5d5ec tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1342 microversion: 2.1 time: 0.176405 Apr 09 21:29:44.834764 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3081/6135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:44 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:45.851347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:45.852225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:45.858998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:45.859462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:45.860256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:45.860701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:45.993871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:46.002036 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c06e8c2-a99b-4be2-a13c-ea4a027adc02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.154490 Apr 09 21:29:46.002621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3055/6136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:45 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:47.021762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:47.022590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:47.030796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:47.031294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:47.032010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:47.032442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:47.166430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:47.175028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1ef7b92f-2c0c-4a82-87c2-3c924e0ca854 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.158726 Apr 09 21:29:47.175694 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3082/6137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:47 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:48.194608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:48.195179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:48.202712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:48.203217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:48.204076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:48.204520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:48.341864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:48.349796 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c69957ed-a1ff-47b7-85b0-f77c7d8e01df tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.159759 Apr 09 21:29:48.350374 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3056/6138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:48 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:49.367329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:49.367944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:49.375156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:49.375615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:49.376393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:49.376840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:49.514891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:49.522970 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9fbec45-0da9-4849-bfb0-3b9675cbb8f0 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.159640 Apr 09 21:29:49.523546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3083/6139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:49 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:50.540234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:50.540778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:50.548669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:50.549177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:50.550189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:50.550818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:50.760595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:50.769309 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39958ded-71af-4ffc-8d77-587e35f264d6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.233105 Apr 09 21:29:50.779431 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3057/6140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:50 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:51.787576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:51.788192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:51.795352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:51.795768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:51.796564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:51.797174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:51.934020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:51.941602 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-982116c1-7dd0-4e23-aca5-cdc2a6c029bd tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.158175 Apr 09 21:29:51.945145 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3084/6141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:51 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:29:52.959298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:52.959907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:52.966780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:52.967273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:52.968045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:52.968499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:53.097968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:53.105494 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ead38c3-d70b-48e6-8609-9239ca577513 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.150431 Apr 09 21:29:53.106341 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3058/6142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:52 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:53.363116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-4ab8f845-ee2a-427c-ae15-fdf84c43452e req-dcb77b4d-67b8-4087-a22d-ba77aa252ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2a7d95-b507-4d61-b9f4-681bd4a6143b", "name": "network-vif-plugged", "status": "completed", "tag": "5ff0070e-2d2e-4728-a500-032397afd5cb"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:53.372062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4ab8f845-ee2a-427c-ae15-fdf84c43452e req-dcb77b4d-67b8-4087-a22d-ba77aa252ca9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:53.372518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-4ab8f845-ee2a-427c-ae15-fdf84c43452e req-dcb77b4d-67b8-4087-a22d-ba77aa252ca9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:53.394026 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-4ab8f845-ee2a-427c-ae15-fdf84c43452e req-dcb77b4d-67b8-4087-a22d-ba77aa252ca9 service nova] Creating event network-vif-plugged:5ff0070e-2d2e-4728-a500-032397afd5cb for instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b on nch2-master-1 Apr 09 21:29:53.400891 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-4ab8f845-ee2a-427c-ae15-fdf84c43452e req-dcb77b4d-67b8-4087-a22d-ba77aa252ca9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041497 Apr 09 21:29:53.402150 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3085/6143] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:54.127350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:54.128162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:54.139052 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:54.139508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:54.140317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:54.140763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:54.276723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:54.285314 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae9ba0d9-c4c8-481d-957d-8d463b7e9714 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1376 microversion: 2.1 time: 0.165189 Apr 09 21:29:54.285879 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3059/6144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:54 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:55.306113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:55.307099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:55.314521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.315003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.315766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.316212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.447901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:55.455851 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f03cf9f7-6ed2-4f5b-9c99-54000132720a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1562 microversion: 2.1 time: 0.156769 Apr 09 21:29:55.456467 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3086/6145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:55 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:55.472761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:55.473430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:55.480515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.480990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.481918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.482378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.617655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:55.628483 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7da61e6f-41e6-4666-b0ce-0194cfed211f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1562 microversion: 2.1 time: 0.159509 Apr 09 21:29:55.629326 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3060/6146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:55 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:55.702020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:55.703274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:55.710708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.711187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.711978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.712425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.737913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:29:55.825919 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 204 len: 0 microversion: 2.1 time: 0.129405 Apr 09 21:29:55.826763 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3087/6147] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:29:55 2022] DELETE /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:29:55.836282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:55.837122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:55.843822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.844290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.845128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:55.845667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:55.993598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:56.001562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8a1069bf-45e6-4a4c-bacb-52e04a6dc081 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1568 microversion: 2.1 time: 0.170408 Apr 09 21:29:56.002255 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3061/6148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:55 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:57.020703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:57.022054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:57.032547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:57.033353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:57.034334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:57.034925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:57.190964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:57.201499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-092bdde7-58de-4782-bd58-066eab0a9dfc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1568 microversion: 2.1 time: 0.185675 Apr 09 21:29:57.202603 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3088/6149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:57 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:57.781846 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:29:57.782589 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:29:57.914098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b543a65b-8a10-463e-87c9-6c1051cdc4b8 req-8d6cc137-ef84-430a-a9a2-71c1118048cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2a7d95-b507-4d61-b9f4-681bd4a6143b", "name": "network-vif-deleted", "tag": "5ff0070e-2d2e-4728-a500-032397afd5cb"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:29:57.924312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b543a65b-8a10-463e-87c9-6c1051cdc4b8 req-8d6cc137-ef84-430a-a9a2-71c1118048cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:57.925214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b543a65b-8a10-463e-87c9-6c1051cdc4b8 req-8d6cc137-ef84-430a-a9a2-71c1118048cd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:57.942914 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b543a65b-8a10-463e-87c9-6c1051cdc4b8 req-8d6cc137-ef84-430a-a9a2-71c1118048cd service nova] Creating event network-vif-deleted:5ff0070e-2d2e-4728-a500-032397afd5cb for instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b on nch2-master-1 Apr 09 21:29:57.951594 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b543a65b-8a10-463e-87c9-6c1051cdc4b8 req-8d6cc137-ef84-430a-a9a2-71c1118048cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040876 Apr 09 21:29:57.957934 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3062/6150] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:29:58.221459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:58.222679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:58.230415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:58.230949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:58.231702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:58.232300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:58.268913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:58.269600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:58.270178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid 5a2a7d95-b507-4d61-b9f4-681bd4a6143b {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:29:58.327913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:29:58.336865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51d3eed6-1498-4153-ac85-6f64b5b82c02 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 200 len: 1366 microversion: 2.1 time: 0.120806 Apr 09 21:29:58.347281 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3089/6151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:58 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:29:59.355170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:29:59.355890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:29:59.363521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:59.363981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:59.364780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:29:59.365267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:29:59.380767 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. Apr 09 21:29:59.381230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:29:59.382192 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b45ec438-1140-4a78-a63f-81654ad9392e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 404 len: 111 microversion: 2.1 time: 0.031458 Apr 09 21:29:59.382829 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3063/6152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:29:59 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:30.443089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:30.444186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:30.459817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:30.460268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:30.461081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:30.461548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:30.491148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:30:30.608857 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 204 len: 0 microversion: 2.1 time: 0.176696 Apr 09 21:30:30.609621 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3090/6153] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:30:30 2022] DELETE /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:30:30.619098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:30.620472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:30.628426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:30.629288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:30.630378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:30.631095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:30.909331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:30.920857 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9da31d41-e4ee-478c-a209-60990646bebc tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1410 microversion: 2.1 time: 0.305227 Apr 09 21:30:30.922069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3064/6154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:30 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1410 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:31.944328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:31.945486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:31.957186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:31.958472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:31.959491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:31.959932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:32.220382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:32.228515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab30ed8d-470e-45ee-ae2d-a0070561de2e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1410 microversion: 2.1 time: 0.291637 Apr 09 21:30:32.229123 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3091/6155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:31 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1410 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:32.654925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-09471ed2-7c4d-40cf-80c9-7d4d3527475f req-9b0fcf78-41ca-40cf-99c1-9edb789abff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3328ec9-d468-4261-9f94-4bd6831f2cf5", "name": "network-vif-deleted", "tag": "a434c4f5-9523-4c23-8408-30290b0eda20"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:32.665362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-09471ed2-7c4d-40cf-80c9-7d4d3527475f req-9b0fcf78-41ca-40cf-99c1-9edb789abff4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:32.665907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-09471ed2-7c4d-40cf-80c9-7d4d3527475f req-9b0fcf78-41ca-40cf-99c1-9edb789abff4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:32.678783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-09471ed2-7c4d-40cf-80c9-7d4d3527475f req-9b0fcf78-41ca-40cf-99c1-9edb789abff4 service nova] Creating event network-vif-deleted:a434c4f5-9523-4c23-8408-30290b0eda20 for instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 on nch1-master-1 Apr 09 21:30:32.684198 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-09471ed2-7c4d-40cf-80c9-7d4d3527475f req-9b0fcf78-41ca-40cf-99c1-9edb789abff4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033405 Apr 09 21:30:32.684782 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3065/6156] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:33.247159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:33.247768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:33.256530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:33.256996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:33.258445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:33.259062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:33.302663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:33.303374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:33.304014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid a3328ec9-d468-4261-9f94-4bd6831f2cf5 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:30:33.348078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:33.355999 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-087dfbea-ea6c-4df6-9d8f-ff3cce6f41e9 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 200 len: 1161 microversion: 2.1 time: 0.113569 Apr 09 21:30:33.356940 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3092/6157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:33 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 1161 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:34.376291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:34.377105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:34.383817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.384579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.385496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.386011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.399660 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. Apr 09 21:30:34.400409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:30:34.401473 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f0891e1-9652-4c56-a102-b3ebc5a19411 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 404 len: 111 microversion: 2.1 time: 0.030740 Apr 09 21:30:34.402269 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3066/6158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:34 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:34.434264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:34.435877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:34.443291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.443748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.444565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.445000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.459076 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. Apr 09 21:30:34.459675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:30:34.460507 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8880a74d-ec92-4281-8c9a-bbc93824dc21 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 404 len: 111 microversion: 2.1 time: 0.030477 Apr 09 21:30:34.461094 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3093/6159] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:30:34 2022] DELETE /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:34.469381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:34.470008 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 5a2a7d95-b507-4d61-b9f4-681bd4a6143b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:34.476073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.476529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.477354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.477828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.491069 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. Apr 09 21:30:34.491664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 5a2a7d95-b507-4d61-b9f4-681bd4a6143b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:30:34.492548 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3296eafc-8999-4887-81c3-82aa137f9a81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b" status: 404 len: 111 microversion: 2.1 time: 0.027064 Apr 09 21:30:34.493081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3067/6160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:34 2022] GET /compute/v2.1/servers/5a2a7d95-b507-4d61-b9f4-681bd4a6143b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:34.974405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:34.974932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:34.981512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.981964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.982735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:34.983170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:34.997098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. Apr 09 21:30:34.997614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:30:34.998434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a09e714a-e8d9-4a80-843c-26689e4f1b01 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 404 len: 111 microversion: 2.1 time: 0.027998 Apr 09 21:30:34.998953 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3094/6161] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:30:34 2022] DELETE /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:35.007525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:35.008158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: a3328ec9-d468-4261-9f94-4bd6831f2cf5] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:35.014480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:35.014950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:35.015729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:35.016181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:35.029833 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. Apr 09 21:30:35.030467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance a3328ec9-d468-4261-9f94-4bd6831f2cf5 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:30:35.031299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-595fc141-0cc6-42dd-85d0-433757237a37 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5" status: 404 len: 111 microversion: 2.1 time: 0.027954 Apr 09 21:30:35.031816 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3068/6162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:35 2022] GET /compute/v2.1/servers/a3328ec9-d468-4261-9f94-4bd6831f2cf5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:30:35.100971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: .version_select at 0x7fb08ee391f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-860748"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:35.115273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:30:35.120823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:30:35.298734 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:30:35.304264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:30:35.319131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ae5c63f-aaa8-4d1a-a16b-b16b51f0857d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.222160 Apr 09 21:30:35.319748 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3095/6163] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:30:35 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:38.947149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1565622493", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860748", "security_groups": [{"name": "tempest-secgroup-smoke-1743128156"}], "block_device_mapping_v2": [{"uuid": "ac526ef0-508b-4640-8ed5-a8a5a3135756", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:39.092817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:30:39.499592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:30:39.500141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:30:39.500738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:30:39.501304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:30:39.501835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:30:39.513838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:39.514339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:39.515408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:39.515918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:39.536683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:30:39.544499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:30:39.630259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:30:39.632282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac526ef0-508b-4640-8ed5-a8a5a3135756',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:30:39.794367 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-517d57ce-5e89-4597-b3b6-585ce31dc885 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851244 Apr 09 21:30:39.795472 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3069/6164] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:30:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:30:39.807991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc357d1b-2b1b-4f16-a9b7-3b5482bfabda tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:39.808800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc357d1b-2b1b-4f16-a9b7-3b5482bfabda tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:39.881577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc357d1b-2b1b-4f16-a9b7-3b5482bfabda tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:39.891519 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc357d1b-2b1b-4f16-a9b7-3b5482bfabda tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1091 microversion: 2.1 time: 0.089563 Apr 09 21:30:39.892353 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3096/6165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:39 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1091 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:30:40.914428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:40.915062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:40.922937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:40.923642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:40.924746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:40.925272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:41.019953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:41.030863 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6105e91c-ca53-481d-bde4-f506276ba84a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1207 microversion: 2.1 time: 0.121249 Apr 09 21:30:41.032231 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3070/6166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:40 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1207 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:42.049457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:42.050780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:42.065787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:42.066247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:42.067046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:42.067665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:42.305404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:42.317234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c84161b-8283-4c63-8445-b49c0b0d99c8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1275 microversion: 2.1 time: 0.271808 Apr 09 21:30:42.317886 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3097/6167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:42 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:30:42.607863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5a3c729a-5c32-4ebc-8118-c8c1353b4717 req-fe53c727-3611-4f9e-8ce3-3d2fd36a9c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ee4c60-a2e7-49b0-87e6-6bceb56c93e8", "tag": "18d78192-a3d6-4a59-b848-b3a97b7920bd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:42.625386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5a3c729a-5c32-4ebc-8118-c8c1353b4717 req-fe53c727-3611-4f9e-8ce3-3d2fd36a9c94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:42.626279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5a3c729a-5c32-4ebc-8118-c8c1353b4717 req-fe53c727-3611-4f9e-8ce3-3d2fd36a9c94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:42.641247 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5a3c729a-5c32-4ebc-8118-c8c1353b4717 req-fe53c727-3611-4f9e-8ce3-3d2fd36a9c94 service nova] Creating event network-changed:18d78192-a3d6-4a59-b848-b3a97b7920bd for instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 on nch2-master-1 Apr 09 21:30:42.647428 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5a3c729a-5c32-4ebc-8118-c8c1353b4717 req-fe53c727-3611-4f9e-8ce3-3d2fd36a9c94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045864 Apr 09 21:30:42.659106 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3071/6168] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:43.338764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:43.339486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:43.347065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:43.347547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:43.348408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:43.348745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:43.509265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:43.521120 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9a868d2-4cb2-42ad-887f-1889931162ad tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.186995 Apr 09 21:30:43.522886 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3098/6169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:43 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:44.541140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:44.542032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:44.549165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:44.549715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:44.550698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:44.551097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:44.741939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:44.753708 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-13de3d47-b159-4d5d-9b76-9b24f7334b9a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.217705 Apr 09 21:30:44.754744 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3072/6170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:44 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:45.771653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:45.772327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:45.780445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:45.780932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:45.781842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:45.782289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:45.939465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:45.949017 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7d50516-027e-478c-b8b7-28ed3e38a89f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.181606 Apr 09 21:30:45.950513 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3099/6171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:45 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:46.968387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:46.969021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:46.976260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:46.976814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:46.977710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:46.978166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:47.122195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:47.129953 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c341bd51-fec2-49fc-b92d-136b4299d41d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.165727 Apr 09 21:30:47.130537 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3073/6172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:46 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:48.046563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-290472083", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "4d5be3c2-663d-4396-8be5-5c8395dc4ab0"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:48.106637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] validate_networks() for [('4d5be3c2-663d-4396-8be5-5c8395dc4ab0', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:30:48.147193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:48.147829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:48.156937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:48.157430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:48.158236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:48.158689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:48.408671 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:48.416659 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a93720a-fa67-44d3-a449-ea8aa49aaa07 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.273490 Apr 09 21:30:48.417282 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3074/6173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:48 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:48.532754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:30:48.533284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:30:48.533764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:30:48.534176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:30:48.534584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:30:48.544450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:48.544901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:48.545766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:48.546210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:48.563098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Getting quotas for project 3e1e5cc7222142ab82cd6a857f7be3de. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:30:48.568512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Getting quotas for user f858bd78e1794185a908d3372a7359dd and project 3e1e5cc7222142ab82cd6a857f7be3de. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:30:48.580865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:30:48.583563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:30:48.633564 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a28acf03-7173-45e2-a976-908118c358b7 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590768 Apr 09 21:30:48.634359 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3100/6174] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:30:48.647642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a1d6193-0d99-4826-ab0c-1c6fbbc67789 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:48.648621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a1d6193-0d99-4826-ab0c-1c6fbbc67789 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:48.701667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a1d6193-0d99-4826-ab0c-1c6fbbc67789 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:48.709003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a1d6193-0d99-4826-ab0c-1c6fbbc67789 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1218 microversion: 2.1 time: 0.067859 Apr 09 21:30:48.709878 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3075/6175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:48 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:49.438396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:49.439072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:49.448237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:49.448782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:49.449849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:49.450407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:49.652307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9c1cd306-253d-4893-b6d8-1d116b758e4c req-31fd73a2-b5c6-493b-a3fd-fd00cac4ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ee4c60-a2e7-49b0-87e6-6bceb56c93e8", "name": "network-vif-plugged", "status": "completed", "tag": "18d78192-a3d6-4a59-b848-b3a97b7920bd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:49.670330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:49.673653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9c1cd306-253d-4893-b6d8-1d116b758e4c req-31fd73a2-b5c6-493b-a3fd-fd00cac4ce83 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:49.674304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9c1cd306-253d-4893-b6d8-1d116b758e4c req-31fd73a2-b5c6-493b-a3fd-fd00cac4ce83 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:49.680408 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ad1be8b-2101-4e73-8e22-1c4c0835ba85 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.248284 Apr 09 21:30:49.688008 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3101/6176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:49 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:49.693566 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9c1cd306-253d-4893-b6d8-1d116b758e4c req-31fd73a2-b5c6-493b-a3fd-fd00cac4ce83 service nova] Creating event network-vif-plugged:18d78192-a3d6-4a59-b848-b3a97b7920bd for instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 on nch2-master-1 Apr 09 21:30:49.699422 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9c1cd306-253d-4893-b6d8-1d116b758e4c req-31fd73a2-b5c6-493b-a3fd-fd00cac4ce83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051102 Apr 09 21:30:49.700901 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3076/6177] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:49.726233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:49.726863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:49.733865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:49.734551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:49.735524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:49.736135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:49.827154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:49.837609 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99d4c06e-ba63-4c08-8262-9b7cb24ff94c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1276 microversion: 2.1 time: 0.114538 Apr 09 21:30:49.838226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3102/6178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:49 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:50.699576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:50.700319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:50.708156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:50.708618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:50.709442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:50.709896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:50.855046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:50.855699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:50.862956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:50.863403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:50.864186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:50.864616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:50.921885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:50.931991 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c31524db-6320-481c-a8bc-9d28e97c4a32 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1263 microversion: 2.1 time: 0.237897 Apr 09 21:30:50.932514 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3077/6179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:50 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:51.067459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:51.076105 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b83e065-ee29-4461-82a6-5bfc71dfb02f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.225011 Apr 09 21:30:51.076704 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3103/6180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:50 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:51.113020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6cacc444-abe1-456a-bf94-76a5a68e6684 req-8137defb-e15e-463d-9030-e1acc0a64f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9564a09-2724-4004-b4e2-f93763619e14", "tag": "e824fc15-eeb4-4d4e-8c83-6c78cef294bd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:51.122292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6cacc444-abe1-456a-bf94-76a5a68e6684 req-8137defb-e15e-463d-9030-e1acc0a64f29 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:51.122904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6cacc444-abe1-456a-bf94-76a5a68e6684 req-8137defb-e15e-463d-9030-e1acc0a64f29 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:51.134549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6cacc444-abe1-456a-bf94-76a5a68e6684 req-8137defb-e15e-463d-9030-e1acc0a64f29 service nova] Creating event network-changed:e824fc15-eeb4-4d4e-8c83-6c78cef294bd for instance c9564a09-2724-4004-b4e2-f93763619e14 on nch1-master-1 Apr 09 21:30:51.146225 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6cacc444-abe1-456a-bf94-76a5a68e6684 req-8137defb-e15e-463d-9030-e1acc0a64f29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037373 Apr 09 21:30:51.147282 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3078/6181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:51.951170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:51.951783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:51.959587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:51.960050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:51.960840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:51.961326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:52.096209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:52.096885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:52.105177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:52.107524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:52.107985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:52.108981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:52.109455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:52.113150 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee5dd124-d301-4dab-b266-0db851a8576d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1449 microversion: 2.1 time: 0.167364 Apr 09 21:30:52.117181 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3104/6182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:51 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:52.128855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:52.129496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:52.135794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:52.136297 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:52.137117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:52.137563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:52.293529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:52.301592 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8417daf-92e5-4c16-92fb-38361a57e3e9 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.211238 Apr 09 21:30:52.302176 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3079/6183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:52 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:52.321538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:52.329868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0216490-235f-49df-ae0d-fce66d52caa8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1449 microversion: 2.1 time: 0.204720 Apr 09 21:30:52.330629 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3105/6184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:52 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1449 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:53.318885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:53.319502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:53.326718 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:53.327188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:53.327983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:53.328434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:53.461650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:53.469325 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-479d620d-c3c2-41ca-9896-24525bdd1e6f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.154382 Apr 09 21:30:53.469913 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3080/6185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:53 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:54.486719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:54.487963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:54.494678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:54.495128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:54.495950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:54.496382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:54.582294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-43e6368a-ee7c-4a89-88fd-b3a899a39bc9 req-92f3f9a5-9406-4016-b42f-a607d2982201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ee4c60-a2e7-49b0-87e6-6bceb56c93e8", "tag": "18d78192-a3d6-4a59-b848-b3a97b7920bd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:54.591255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-43e6368a-ee7c-4a89-88fd-b3a899a39bc9 req-92f3f9a5-9406-4016-b42f-a607d2982201 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:54.591749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-43e6368a-ee7c-4a89-88fd-b3a899a39bc9 req-92f3f9a5-9406-4016-b42f-a607d2982201 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:54.603676 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-43e6368a-ee7c-4a89-88fd-b3a899a39bc9 req-92f3f9a5-9406-4016-b42f-a607d2982201 service nova] Creating event network-changed:18d78192-a3d6-4a59-b848-b3a97b7920bd for instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 on nch2-master-1 Apr 09 21:30:54.609233 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-43e6368a-ee7c-4a89-88fd-b3a899a39bc9 req-92f3f9a5-9406-4016-b42f-a607d2982201 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030907 Apr 09 21:30:54.610680 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3081/6186] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:54.665858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:54.674077 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b050c5e6-5e71-4f71-92b7-7f34229fff83 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.191334 Apr 09 21:30:54.674659 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3106/6187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:54 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:55.692595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:55.693348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:55.700424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:55.700890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:55.701843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:55.702298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:55.842833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:55.850825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-82513f9c-ca71-49d8-bf0b-4e6df8a80eea tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.163293 Apr 09 21:30:55.851423 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3082/6188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:55 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:56.621973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0bd11084-ddc3-4b01-bdac-8fdaf31385bb req-00298ae2-5fd4-44e5-b082-795960054e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9564a09-2724-4004-b4e2-f93763619e14", "name": "network-vif-plugged", "status": "completed", "tag": "e824fc15-eeb4-4d4e-8c83-6c78cef294bd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:56.631706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0bd11084-ddc3-4b01-bdac-8fdaf31385bb req-00298ae2-5fd4-44e5-b082-795960054e3e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:56.632249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0bd11084-ddc3-4b01-bdac-8fdaf31385bb req-00298ae2-5fd4-44e5-b082-795960054e3e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:56.645161 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0bd11084-ddc3-4b01-bdac-8fdaf31385bb req-00298ae2-5fd4-44e5-b082-795960054e3e service nova] Creating event network-vif-plugged:e824fc15-eeb4-4d4e-8c83-6c78cef294bd for instance c9564a09-2724-4004-b4e2-f93763619e14 on nch1-master-1 Apr 09 21:30:56.650525 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0bd11084-ddc3-4b01-bdac-8fdaf31385bb req-00298ae2-5fd4-44e5-b082-795960054e3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Apr 09 21:30:56.651452 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3107/6189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:30:56.868225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:56.868850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:56.876145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:56.876604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:56.877424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:56.877870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:57.012460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:57.020702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2c29ace0-5fea-4302-ad1d-69f9b4ebe297 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1318 microversion: 2.1 time: 0.156594 Apr 09 21:30:57.021270 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3083/6190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:56 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:58.038483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:30:58.039230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:58.046791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:58.047240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:58.048014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:58.048453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:58.180793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:30:58.188655 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-edf2af38-28b4-4da9-b523-7fed061f32a3 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1507 microversion: 2.1 time: 0.154480 Apr 09 21:30:58.189282 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3108/6191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:30:58 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:30:59.677183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "390d885e-abbc-40c6-a67c-adccc1e809d8", "device": "/dev/sdb"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:30:59.678794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:30:59.685796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:59.686261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:59.687073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:30:59.687531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:30:59.942539 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "POST /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269207 Apr 09 21:30:59.943189 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3084/6192] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:30:59 2022] POST /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:32:39.987587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:39.988144 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:39.994301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:39.994751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:39.995521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:39.995963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:40.080661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lazy-loading 'services' on Instance uuid c9564a09-2724-4004-b4e2-f93763619e14 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:32:40.154022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14/os-volume_attachments/390d885e-abbc-40c6-a67c-adccc1e809d8" status: 202 len: 0 microversion: 2.1 time: 0.171472 Apr 09 21:32:40.154645 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3109/6193] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:32:39 2022] DELETE /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14/os-volume_attachments/390d885e-abbc-40c6-a67c-adccc1e809d8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:32:41.274857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:41.275497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:41.284183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:41.284736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:41.285997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:41.286602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:41.315314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:32:41.396471 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48cb7c07-5516-4425-8246-b8b1dd14b8cc tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 204 len: 0 microversion: 2.1 time: 0.130023 Apr 09 21:32:41.397215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3085/6194] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:32:41 2022] DELETE /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:32:41.407687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:41.408421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:41.415002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:41.415459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:41.416774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:41.416774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:41.572044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:41.583559 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a6bffadd-40f9-407f-8e78-9e56c92a4b0b tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1513 microversion: 2.1 time: 0.181368 Apr 09 21:32:41.584329 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3110/6195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:41 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:42.605721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:42.606440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:42.614135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:42.614600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:42.615387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:42.615835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:42.749736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:42.757834 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8eee54d1-f7c2-41be-96f3-42f8120ac6b2 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1513 microversion: 2.1 time: 0.156568 Apr 09 21:32:42.758408 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3086/6196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:42 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:43.444701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e2906499-2d18-4cdf-b586-6507dfe2b19e req-c4078cee-430b-476e-b731-f58d50999e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9564a09-2724-4004-b4e2-f93763619e14", "name": "network-vif-deleted", "tag": "e824fc15-eeb4-4d4e-8c83-6c78cef294bd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:32:43.453545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e2906499-2d18-4cdf-b586-6507dfe2b19e req-c4078cee-430b-476e-b731-f58d50999e4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:43.454377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e2906499-2d18-4cdf-b586-6507dfe2b19e req-c4078cee-430b-476e-b731-f58d50999e4a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:43.467425 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e2906499-2d18-4cdf-b586-6507dfe2b19e req-c4078cee-430b-476e-b731-f58d50999e4a service nova] Creating event network-vif-deleted:e824fc15-eeb4-4d4e-8c83-6c78cef294bd for instance c9564a09-2724-4004-b4e2-f93763619e14 on nch1-master-1 Apr 09 21:32:43.474509 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e2906499-2d18-4cdf-b586-6507dfe2b19e req-c4078cee-430b-476e-b731-f58d50999e4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105931 Apr 09 21:32:43.475108 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3111/6197] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:32:43.776240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:43.776850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:43.784309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:43.784771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:43.785612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:43.786058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:43.817509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:43.817971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:43.818438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lazy-loading 'fault' on Instance uuid c9564a09-2724-4004-b4e2-f93763619e14 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:32:43.861835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:43.868718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8318143-6bd2-4a00-9eba-f9c4856564b0 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 200 len: 1308 microversion: 2.1 time: 0.097069 Apr 09 21:32:43.869335 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3087/6198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:43 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:44.890186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:44.890957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: c9564a09-2724-4004-b4e2-f93763619e14] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:44.899197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:44.899706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:44.900557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:44.901069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:44.916305 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] HTTP exception thrown: Instance c9564a09-2724-4004-b4e2-f93763619e14 could not be found. Apr 09 21:32:44.917203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Returning 404 to user: Instance c9564a09-2724-4004-b4e2-f93763619e14 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:32:44.918156 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f9ce5331-2355-4c73-9d07-4c11c9c5ae33 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14" status: 404 len: 111 microversion: 2.1 time: 0.034559 Apr 09 21:32:44.918797 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3112/6199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:44 2022] GET /compute/v2.1/servers/c9564a09-2724-4004-b4e2-f93763619e14 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:32:48.618903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1923772629", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "4d5be3c2-663d-4396-8be5-5c8395dc4ab0"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:32:48.677572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] validate_networks() for [('4d5be3c2-663d-4396-8be5-5c8395dc4ab0', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:32:49.105910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:32:49.106341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:32:49.106883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:32:49.107303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:32:49.107730 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:32:49.118171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:49.118592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:49.119588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:49.120030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:49.138697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Getting quotas for project 3e1e5cc7222142ab82cd6a857f7be3de. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:32:49.144988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Getting quotas for user f858bd78e1794185a908d3372a7359dd and project 3e1e5cc7222142ab82cd6a857f7be3de. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:32:49.159883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:32:49.162844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:32:49.210175 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-273d9973-35c6-424f-8fcf-105201cf5d88 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595942 Apr 09 21:32:49.211053 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3088/6200] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:32:49.222296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5330a5dc-0b8d-49db-91ff-d14e3909913f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:49.223032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5330a5dc-0b8d-49db-91ff-d14e3909913f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:49.290602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5330a5dc-0b8d-49db-91ff-d14e3909913f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:49.300251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5330a5dc-0b8d-49db-91ff-d14e3909913f tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1219 microversion: 2.1 time: 0.082650 Apr 09 21:32:49.305833 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3113/6201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:49 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:50.319596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:50.320339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:50.327570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:50.328040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:50.329371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:50.330012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:50.400202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:50.407702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0fac734-c7f1-4c59-bb13-dc273a6da015 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1289 microversion: 2.1 time: 0.093870 Apr 09 21:32:50.408535 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3089/6202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:50 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:51.425798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:51.426559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:51.434045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:51.434547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:51.435282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:51.435750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:51.640829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:51.648747 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ad326838-a16f-4cf1-8b81-4248b0f2808e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.227305 Apr 09 21:32:51.649380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3114/6203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:51 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:51.761763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-349f4a2b-9830-4ad0-b8a6-24bc87991794 req-e3479eb5-1ecc-46f0-b750-578621f7d0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7271036-4159-4cba-a4cb-20f4c26667b2", "tag": "d79a689e-45b3-4974-a773-81359e2329c9"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:32:51.771171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-349f4a2b-9830-4ad0-b8a6-24bc87991794 req-e3479eb5-1ecc-46f0-b750-578621f7d0fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:51.771663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-349f4a2b-9830-4ad0-b8a6-24bc87991794 req-e3479eb5-1ecc-46f0-b750-578621f7d0fd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:51.798464 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-349f4a2b-9830-4ad0-b8a6-24bc87991794 req-e3479eb5-1ecc-46f0-b750-578621f7d0fd service nova] Creating event network-changed:d79a689e-45b3-4974-a773-81359e2329c9 for instance a7271036-4159-4cba-a4cb-20f4c26667b2 on nch1-master-1 Apr 09 21:32:51.803578 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-349f4a2b-9830-4ad0-b8a6-24bc87991794 req-e3479eb5-1ecc-46f0-b750-578621f7d0fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046079 Apr 09 21:32:51.804142 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3090/6204] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:32:52.668648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:52.669417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:52.677790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:52.678634 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:52.679788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:52.680327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:52.818085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:52.829341 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a514e3f2-ddbf-48a8-a058-8a96e269f2b5 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.165866 Apr 09 21:32:52.830067 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3115/6205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:52 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:53.849424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:53.850206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:53.856702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:53.857203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:53.857991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:53.858446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:53.990004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:54.001379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2dd9ad22-1c85-4726-902f-dbb1b128ce47 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.156895 Apr 09 21:32:54.002107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3091/6206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:53 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:55.018934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:55.019559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:55.026524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:55.026982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:55.027756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:55.028186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:55.162296 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:55.169938 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-729df1ae-8b19-440e-aeec-b6f5a7bc9c43 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.154984 Apr 09 21:32:55.170784 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3116/6207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:55 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:56.191381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:56.192304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:56.200338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:56.200799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:56.201617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:56.202057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:56.340453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:56.348281 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3776de75-7676-4523-bb57-c0cea7b1145e tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.163729 Apr 09 21:32:56.349018 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3092/6208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:56 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:57.165394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-63efad7e-bff2-4587-8230-80f99da26686 req-06ce61af-5434-4a53-b940-480ea87a6cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7271036-4159-4cba-a4cb-20f4c26667b2", "name": "network-vif-plugged", "status": "completed", "tag": "d79a689e-45b3-4974-a773-81359e2329c9"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:32:57.175983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-63efad7e-bff2-4587-8230-80f99da26686 req-06ce61af-5434-4a53-b940-480ea87a6cc1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:57.176554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-63efad7e-bff2-4587-8230-80f99da26686 req-06ce61af-5434-4a53-b940-480ea87a6cc1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:57.192666 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-63efad7e-bff2-4587-8230-80f99da26686 req-06ce61af-5434-4a53-b940-480ea87a6cc1 service nova] Creating event network-vif-plugged:d79a689e-45b3-4974-a773-81359e2329c9 for instance a7271036-4159-4cba-a4cb-20f4c26667b2 on nch1-master-1 Apr 09 21:32:57.198221 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-63efad7e-bff2-4587-8230-80f99da26686 req-06ce61af-5434-4a53-b940-480ea87a6cc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115546 Apr 09 21:32:57.198814 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3117/6209] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:32:57.365799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:57.366577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:57.375139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:57.375595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:57.376364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:57.376799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:57.510788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:57.519170 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdbf6aa7-3e00-4e0d-ae0e-455bfef88fba tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1319 microversion: 2.1 time: 0.157377 Apr 09 21:32:57.519824 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3093/6210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:57 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:58.537540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:32:58.538359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:58.545000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:58.545483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:58.546271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:58.546701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:58.676702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:32:58.684339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9202d354-3357-4ef4-a320-c5c6c4b165d1 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1507 microversion: 2.1 time: 0.152025 Apr 09 21:32:58.684921 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3118/6211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:32:58 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:32:58.700804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b", "device": "/dev/sdb"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:32:58.702417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:32:58.710125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:58.710601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:58.711378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:32:58.711821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:32:58.962964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-abe34623-a965-4a71-9173-57d20dd8b694 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "POST /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265820 Apr 09 21:32:58.963820 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3094/6212] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:32:58 2022] POST /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:33:00.696147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:00.697183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:00.708819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:00.709626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:00.710897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:00.711624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:00.736773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:33:00.822231 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 204 len: 0 microversion: 2.1 time: 0.132512 Apr 09 21:33:00.823018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3119/6213] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:33:00 2022] DELETE /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:33:00.833453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:00.834174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:00.840599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:00.841098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:00.841889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:00.842363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:00.989721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:00.999531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-84a85a92-5fa4-4246-8fde-8f46eac30376 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1574 microversion: 2.1 time: 0.171792 Apr 09 21:33:01.000118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3095/6214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:00 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:33:02.018163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:02.019036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:02.026777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:02.027398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:02.028224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:02.028785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:02.168572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:02.176391 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4784ae9d-4950-4ea8-826b-2e9537febf24 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1574 microversion: 2.1 time: 0.163077 Apr 09 21:33:02.177059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3120/6215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:02 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:03.193931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:03.195371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:03.202815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:03.203615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:03.204423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:03.204905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:03.357569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:03.366662 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fe004a32-1443-49a4-b4ea-9ff710cae275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1574 microversion: 2.1 time: 0.176950 Apr 09 21:33:03.374891 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3096/6216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:03 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:03.947647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-00db8965-d1a8-46c7-b468-90a6bfc11590 req-32608d0d-6e71-490b-ad15-3d8812aa3659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ee4c60-a2e7-49b0-87e6-6bceb56c93e8", "name": "network-vif-deleted", "tag": "18d78192-a3d6-4a59-b848-b3a97b7920bd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:33:03.961694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-00db8965-d1a8-46c7-b468-90a6bfc11590 req-32608d0d-6e71-490b-ad15-3d8812aa3659 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:03.962029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-00db8965-d1a8-46c7-b468-90a6bfc11590 req-32608d0d-6e71-490b-ad15-3d8812aa3659 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:03.983540 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-00db8965-d1a8-46c7-b468-90a6bfc11590 req-32608d0d-6e71-490b-ad15-3d8812aa3659 service nova] Creating event network-vif-deleted:18d78192-a3d6-4a59-b848-b3a97b7920bd for instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 on nch2-master-1 Apr 09 21:33:03.990933 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-00db8965-d1a8-46c7-b468-90a6bfc11590 req-32608d0d-6e71-490b-ad15-3d8812aa3659 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122141 Apr 09 21:33:03.996067 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3121/6217] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:33:04.384057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:04.385093 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:04.392742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:04.393340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:04.394148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:04.394628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:04.425451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:04.425916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:04.426387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:33:04.472047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:04.480045 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc5925da-eff6-486b-883d-11f2bdb114ce tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 200 len: 1181 microversion: 2.1 time: 0.100024 Apr 09 21:33:04.481227 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3097/6218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:04 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 1181 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:05.498985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:05.499693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:05.507454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:05.507911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:05.508732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:05.509212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:05.524332 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. Apr 09 21:33:05.524965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:33:05.525841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d87b9a14-0ee4-41b0-859b-4c615cd3ca7e tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 404 len: 111 microversion: 2.1 time: 0.031312 Apr 09 21:33:05.526489 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3122/6219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:05 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:33:05.576181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-157509480", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860748", "security_groups": [{"name": "tempest-secgroup-smoke-1743128156"}], "block_device_mapping_v2": [{"uuid": "ac526ef0-508b-4640-8ed5-a8a5a3135756", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:33:05.692166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:33:06.058596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:33:06.059027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:33:06.059515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:33:06.059933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:33:06.060350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:33:06.069878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:06.070348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:06.071161 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:06.071603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:06.088537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:33:06.094152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:33:06.153741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:33:06.155882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac526ef0-508b-4640-8ed5-a8a5a3135756',volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:33:06.295505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-289f84f4-1f5a-462d-9607-50f7bb52edb7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723358 Apr 09 21:33:06.296128 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3098/6220] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:33:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:33:06.306517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3009a4d3-97f5-4a12-83b9-ae25876a8942 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:06.307160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3009a4d3-97f5-4a12-83b9-ae25876a8942 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:06.361819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3009a4d3-97f5-4a12-83b9-ae25876a8942 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:06.368715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3009a4d3-97f5-4a12-83b9-ae25876a8942 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1090 microversion: 2.1 time: 0.066263 Apr 09 21:33:06.369321 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3123/6221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:06 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1090 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:07.386880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:07.387512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:07.393985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:07.394476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:07.395252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:07.395890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:07.466918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:07.475206 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-514ee34a-7b0f-41db-a2f3-787561bcf07d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1206 microversion: 2.1 time: 0.093103 Apr 09 21:33:07.480082 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3099/6222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:07 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1206 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:08.494354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:08.495868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:08.505859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:08.506388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:08.507306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:08.507814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:08.644118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fb27873b-4b34-4d7c-a5b3-39f019d31ce8 req-3e3d36ef-0e48-486c-8b61-757c697ffaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de5a516-0ec3-4ff2-8957-5defe102de22", "tag": "0a7a5701-b0a1-4a59-9337-ee33fe404576"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:33:08.672404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fb27873b-4b34-4d7c-a5b3-39f019d31ce8 req-3e3d36ef-0e48-486c-8b61-757c697ffaa4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:08.672853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fb27873b-4b34-4d7c-a5b3-39f019d31ce8 req-3e3d36ef-0e48-486c-8b61-757c697ffaa4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:08.697211 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fb27873b-4b34-4d7c-a5b3-39f019d31ce8 req-3e3d36ef-0e48-486c-8b61-757c697ffaa4 service nova] Creating event network-changed:0a7a5701-b0a1-4a59-9337-ee33fe404576 for instance 9de5a516-0ec3-4ff2-8957-5defe102de22 on nch2-master-1 Apr 09 21:33:08.703862 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fb27873b-4b34-4d7c-a5b3-39f019d31ce8 req-3e3d36ef-0e48-486c-8b61-757c697ffaa4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081118 Apr 09 21:33:08.705552 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3100/6223] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:33:08.730663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:08.744815 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-29fb1a3b-eb49-4f95-af12-a5473c027b30 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.256401 Apr 09 21:33:08.745461 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3124/6224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:08 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:09.767177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:09.768346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:09.778935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:09.779448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:09.780241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:09.780690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:09.913144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:09.921231 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dea68a53-5bfb-45d7-9e3b-4d6569d36867 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.161178 Apr 09 21:33:09.921819 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3101/6225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:09 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:10.942596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:10.943692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:10.952639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:10.953475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:10.954248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:10.954685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:11.092300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:11.103724 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5faa1077-615d-4849-8d81-7ddfccf3a1f6 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.167754 Apr 09 21:33:11.104386 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3125/6226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:10 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:12.125193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:12.126110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:12.137372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:12.137829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:12.138621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:12.139090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:12.279791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:12.289100 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-803cd69d-e140-44ee-8f27-d3e5cad7db04 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.170177 Apr 09 21:33:12.289934 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3102/6227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:12 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:13.310156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:13.311107 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:13.318217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:13.318670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:13.319465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:13.319899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:13.465848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:13.473706 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8ec6889c-4b06-403a-9333-715d822ae6e8 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.168586 Apr 09 21:33:13.474288 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3126/6228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:13 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:14.498410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:14.499067 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:14.505375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:14.505833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:14.506615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:14.507057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:14.914254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:14.921968 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4573b6e1-8406-47fd-adec-88030b7742e5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.434703 Apr 09 21:33:14.922683 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3103/6229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:14 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:15.945708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:15.946655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:15.956332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:15.956776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:15.957602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:15.958038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:16.089430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:16.097435 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f1c5f002-7d78-4a62-9c3b-53e24c4c588d tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.160063 Apr 09 21:33:16.098047 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3127/6230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:15 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:16.415098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e82a8487-3954-46d6-9fac-a647b7109114 req-0a22dc81-a58c-4373-9b4b-174bad1f926a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de5a516-0ec3-4ff2-8957-5defe102de22", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a5701-b0a1-4a59-9337-ee33fe404576"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:33:16.424485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e82a8487-3954-46d6-9fac-a647b7109114 req-0a22dc81-a58c-4373-9b4b-174bad1f926a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:16.424987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e82a8487-3954-46d6-9fac-a647b7109114 req-0a22dc81-a58c-4373-9b4b-174bad1f926a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:16.437547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e82a8487-3954-46d6-9fac-a647b7109114 req-0a22dc81-a58c-4373-9b4b-174bad1f926a service nova] Creating event network-vif-plugged:0a7a5701-b0a1-4a59-9337-ee33fe404576 for instance 9de5a516-0ec3-4ff2-8957-5defe102de22 on nch2-master-1 Apr 09 21:33:16.442685 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e82a8487-3954-46d6-9fac-a647b7109114 req-0a22dc81-a58c-4373-9b4b-174bad1f926a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Apr 09 21:33:16.443306 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3104/6231] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:33:17.118017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:17.119032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:17.128290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:17.128758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:17.129586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:17.130032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:17.268009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:17.275779 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f753cb2-bd97-43a0-bece-fc68da41e9c5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1262 microversion: 2.1 time: 0.164525 Apr 09 21:33:17.276382 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3128/6232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:17 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:17.791449 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:33:17.792070 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:33:18.297696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:18.298622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:18.307615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:18.308191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:18.309212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:18.309774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:18.443735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:18.451367 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f322ea38-d5df-42e9-86c7-db54ebc707ca tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1448 microversion: 2.1 time: 0.160405 Apr 09 21:33:18.451955 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3105/6233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:18 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:18.469886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:33:18.470506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:33:18.477578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:18.478024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:18.478798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:18.479237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:18.619096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:33:18.627127 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-25fdab73-92ed-49af-b41e-f970c8c61257 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1448 microversion: 2.1 time: 0.162868 Apr 09 21:33:18.627687 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3129/6234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:33:18 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:33:20.465057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-68e8493c-d4c8-447f-8735-78f3ab87ada3 req-92b24ca5-f2ec-4aab-9c7b-5979581e29ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de5a516-0ec3-4ff2-8957-5defe102de22", "tag": "0a7a5701-b0a1-4a59-9337-ee33fe404576"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:33:20.474708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-68e8493c-d4c8-447f-8735-78f3ab87ada3 req-92b24ca5-f2ec-4aab-9c7b-5979581e29ca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:33:20.475438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-68e8493c-d4c8-447f-8735-78f3ab87ada3 req-92b24ca5-f2ec-4aab-9c7b-5979581e29ca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:33:20.486398 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-68e8493c-d4c8-447f-8735-78f3ab87ada3 req-92b24ca5-f2ec-4aab-9c7b-5979581e29ca service nova] Creating event network-changed:0a7a5701-b0a1-4a59-9337-ee33fe404576 for instance 9de5a516-0ec3-4ff2-8957-5defe102de22 on nch2-master-1 Apr 09 21:33:20.491357 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-68e8493c-d4c8-447f-8735-78f3ab87ada3 req-92b24ca5-f2ec-4aab-9c7b-5979581e29ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030312 Apr 09 21:33:20.492414 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3106/6235] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:33:21.035460 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:33:21.036077 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:33:21.423368 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:33:21.423580 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:34:36.529477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:36.530163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:36.539047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:36.539864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:36.540951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:36.541764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:36.629366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lazy-loading 'services' on Instance uuid a7271036-4159-4cba-a4cb-20f4c26667b2 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:34:36.709414 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2/os-volume_attachments/fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b" status: 202 len: 0 microversion: 2.1 time: 0.185038 Apr 09 21:34:36.710405 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3130/6236] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:34:36 2022] DELETE /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2/os-volume_attachments/fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:34:37.839709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:37.840288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:37.846909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:37.847376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:37.848160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:37.848610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:37.872487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:34:37.960655 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8908f24c-5e6a-4a6f-99a5-93ec368331fe tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 204 len: 0 microversion: 2.1 time: 0.125888 Apr 09 21:34:37.961712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3107/6237] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:34:37 2022] DELETE /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:34:37.970421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:37.971156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:37.978556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:37.979006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:37.979776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:37.980208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:38.112349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:34:38.120041 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0e9f3619-502c-48e7-aa05-03639e2bec66 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1513 microversion: 2.1 time: 0.153915 Apr 09 21:34:38.120621 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3131/6238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:34:37 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:34:39.138150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:39.138802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:39.146207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:39.146662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:39.147437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:39.147882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:39.283167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:34:39.291587 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5afbba2-b52a-48eb-acf3-02dbee79196c tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1513 microversion: 2.1 time: 0.157791 Apr 09 21:34:39.292182 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3108/6239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:34:39 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:34:39.901967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-169d0b06-13d3-4501-93b7-f2a90878f006 req-15d2164b-9300-4b06-a471-bca810007972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7271036-4159-4cba-a4cb-20f4c26667b2", "name": "network-vif-deleted", "tag": "d79a689e-45b3-4974-a773-81359e2329c9"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:34:39.911217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-169d0b06-13d3-4501-93b7-f2a90878f006 req-15d2164b-9300-4b06-a471-bca810007972 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:39.911649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-169d0b06-13d3-4501-93b7-f2a90878f006 req-15d2164b-9300-4b06-a471-bca810007972 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:39.923037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-169d0b06-13d3-4501-93b7-f2a90878f006 req-15d2164b-9300-4b06-a471-bca810007972 service nova] Creating event network-vif-deleted:d79a689e-45b3-4974-a773-81359e2329c9 for instance a7271036-4159-4cba-a4cb-20f4c26667b2 on nch1-master-1 Apr 09 21:34:39.927952 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-169d0b06-13d3-4501-93b7-f2a90878f006 req-15d2164b-9300-4b06-a471-bca810007972 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Apr 09 21:34:39.928604 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3132/6240] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:34:40.310244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:40.310870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:40.317833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:40.318295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:40.319108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:40.319554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:40.354307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:40.354873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:40.355402 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lazy-loading 'fault' on Instance uuid a7271036-4159-4cba-a4cb-20f4c26667b2 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:34:40.403229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f858bd78e1794185a908d3372a7359dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1e5cc7222142ab82cd6a857f7be3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:34:40.410486 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2acee6c8-7a68-4386-bed5-5f2bc21d63cf tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 200 len: 1309 microversion: 2.1 time: 0.105133 Apr 09 21:34:40.411066 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3109/6241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:34:40 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:34:41.439258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:34:41.440389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] [instance: a7271036-4159-4cba-a4cb-20f4c26667b2] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:34:41.451695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:41.452443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:41.453801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:34:41.454530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:34:41.469723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] HTTP exception thrown: Instance a7271036-4159-4cba-a4cb-20f4c26667b2 could not be found. Apr 09 21:34:41.470319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] Returning 404 to user: Instance a7271036-4159-4cba-a4cb-20f4c26667b2 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:34:41.471157 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f04bfb76-5078-4caf-81df-e1dde2c1c3a4 tempest-VolumesSnapshotTestJSON-286608301 tempest-VolumesSnapshotTestJSON-286608301-project] 10.222.0.30 "GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2" status: 404 len: 111 microversion: 2.1 time: 0.040570 Apr 09 21:34:41.471701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3133/6242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:34:41 2022] GET /compute/v2.1/servers/a7271036-4159-4cba-a4cb-20f4c26667b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:35:10.711028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: .version_select at 0x7fb08c1d3af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-132241706"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:10.731443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:35:10.738570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:35:10.864110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:35:10.870438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:35:10.895731 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5203d469-ea23-447f-8235-ef7d2b7713dc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.191303 Apr 09 21:35:10.902621 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3110/6243] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:35:10 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:12.132523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-787860265", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "e19588c9-72b7-4d6c-866b-e793cc5d4659"}], "key_name": "tempest-TestNetworkBasicOps-132241706", "security_groups": [{"name": "tempest-secgroup-smoke-660411142"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:12.264565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] validate_networks() for [('e19588c9-72b7-4d6c-866b-e793cc5d4659', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:35:12.708771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:35:12.709319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:35:12.709891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:35:12.710364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:35:12.710842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:35:12.720433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:12.720991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:12.721968 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:12.722470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:12.739766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:35:12.745161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:35:12.758411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:35:12.760732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:35:12.809186 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b3e807f-a019-4843-9579-3a1cbbd995db tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.680402 Apr 09 21:35:12.810185 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3134/6244] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:35:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:35:12.821176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ca63f25-6a9c-420e-b8e4-5153bc2c522e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:12.821904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ca63f25-6a9c-420e-b8e4-5153bc2c522e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:12.883165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ca63f25-6a9c-420e-b8e4-5153bc2c522e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:12.890506 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ca63f25-6a9c-420e-b8e4-5153bc2c522e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1247 microversion: 2.1 time: 0.074191 Apr 09 21:35:12.891080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3111/6245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:12 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:35:13.910095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:13.910712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:13.923165 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:13.924052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:13.925173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:13.925781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:14.005516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:14.015838 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-101371f7-44ca-469a-a19c-627292c183c8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1305 microversion: 2.1 time: 0.110978 Apr 09 21:35:14.016448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3135/6246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:13 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:15.035596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:15.036378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:15.047944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:15.048417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:15.049268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:15.049726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:15.246342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:15.253929 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f10d5a21-7069-4094-9b9b-372909c78bd4 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.223145 Apr 09 21:35:15.254550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3112/6247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:15 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:15.360642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5f87230e-0268-4e5a-b0c7-39e97bdb1dad req-d8422d7b-9722-49e2-91ff-054953957d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8bba5ac-8bba-4e5e-8949-c7bc620a8c22", "tag": "dbaa066f-e4cf-4268-b5bb-9b496001e2b8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:15.370471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5f87230e-0268-4e5a-b0c7-39e97bdb1dad req-d8422d7b-9722-49e2-91ff-054953957d15 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:15.371170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5f87230e-0268-4e5a-b0c7-39e97bdb1dad req-d8422d7b-9722-49e2-91ff-054953957d15 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:15.383536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5f87230e-0268-4e5a-b0c7-39e97bdb1dad req-d8422d7b-9722-49e2-91ff-054953957d15 service nova] Creating event network-changed:dbaa066f-e4cf-4268-b5bb-9b496001e2b8 for instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 on nch1-master-1 Apr 09 21:35:15.388849 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5f87230e-0268-4e5a-b0c7-39e97bdb1dad req-d8422d7b-9722-49e2-91ff-054953957d15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Apr 09 21:35:15.390070 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3136/6248] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:16.271960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:16.272580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:16.279534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:16.280141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:16.280896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:16.281406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:16.420167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:16.431199 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48c9362c-5969-4f46-a946-81eb9cc83ec0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.163710 Apr 09 21:35:16.432003 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3113/6249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:16 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:16.990948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491989457", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860748", "security_groups": [{"name": "tempest-secgroup-smoke-1743128156"}], "block_device_mapping_v2": [{"uuid": "c19b2253-ae96-41f0-89c0-10ccf95949e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66be874b-41eb-401e-a35f-6e34d5263533"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:17.139525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] validate_networks() for [('66be874b-41eb-401e-a35f-6e34d5263533', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:35:17.450595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:17.451977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:17.459288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:17.459832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:17.460708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:17.461363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:17.541589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:35:17.542019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:35:17.542492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:35:17.542901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:35:17.543310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:35:17.552847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:17.553359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:17.554166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:17.554579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:17.572585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:35:17.578329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Getting quotas for user 2e9bbd737ff54225a549f072976ef296 and project 5e1063334e4a426eb70eec5ed1578744. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:35:17.604322 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:17.612257 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-caafea52-8c38-4262-8ec9-a2cf60dae44d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.165957 Apr 09 21:35:17.612840 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3114/6250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:17 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:17.638939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:35:17.641171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c19b2253-ae96-41f0-89c0-10ccf95949e0',volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:35:17.774042 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a538172-0a58-49b1-a002-1eeb5b863e72 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788698 Apr 09 21:35:17.774621 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3137/6251] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:35:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:35:17.784707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bab74ff0-70e3-40c7-bf56-129225161d35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:17.785565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bab74ff0-70e3-40c7-bf56-129225161d35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:17.839315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bab74ff0-70e3-40c7-bf56-129225161d35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:17.846034 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bab74ff0-70e3-40c7-bf56-129225161d35 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1091 microversion: 2.1 time: 0.065225 Apr 09 21:35:17.846945 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3115/6252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:17 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1091 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:35:18.630745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:18.631338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:18.638382 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:18.638863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:18.639631 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:18.640041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:18.786506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:18.795184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dde3da7e-5a96-4ffc-ad03-eb33327a6d08 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.169403 Apr 09 21:35:18.795761 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3138/6253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:18 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:18.863290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:18.863913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:18.871296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:18.871757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:18.872552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:18.872991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:18.935997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:18.943865 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56361b15-acc9-4728-8476-880e0e283e49 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1207 microversion: 2.1 time: 0.084621 Apr 09 21:35:18.944440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3116/6254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:18 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:19.812405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:19.813375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:19.821689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:19.822134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:19.823123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:19.823717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:19.961844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:19.962080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:19.962600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:19.969720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:19.970441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:19.970647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-82b2baea-2c60-4021-a01f-b7a42c39cf78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.162728 Apr 09 21:35:19.971244 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3139/6255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:19 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:19.980863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:19.981459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:20.147976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:20.157213 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-09fe1572-5828-466e-98ec-6315ea9ee740 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.198812 Apr 09 21:35:20.158004 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3117/6256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:19 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:35:20.212177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f4db41fd-e4e9-43b5-89a4-1670850ad982 req-35a9cbea-7001-4b00-9fea-ccbee6837361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865dc81b-5656-46ef-b403-170b3f5adb70", "tag": "e734433e-37c2-48eb-a6f3-b8bd12274b0d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:20.244854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f4db41fd-e4e9-43b5-89a4-1670850ad982 req-35a9cbea-7001-4b00-9fea-ccbee6837361 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:20.245806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f4db41fd-e4e9-43b5-89a4-1670850ad982 req-35a9cbea-7001-4b00-9fea-ccbee6837361 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:20.258043 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f4db41fd-e4e9-43b5-89a4-1670850ad982 req-35a9cbea-7001-4b00-9fea-ccbee6837361 service nova] Creating event network-changed:e734433e-37c2-48eb-a6f3-b8bd12274b0d for instance 865dc81b-5656-46ef-b403-170b3f5adb70 on nch2-master-1 Apr 09 21:35:20.266156 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f4db41fd-e4e9-43b5-89a4-1670850ad982 req-35a9cbea-7001-4b00-9fea-ccbee6837361 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060412 Apr 09 21:35:20.268308 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3140/6257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:20.991823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:20.992788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:21.000448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:21.000965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:21.001785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:21.002231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:21.141289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:21.149311 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69e78fc3-a7dd-42c7-b600-c409382cc6f3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.164222 Apr 09 21:35:21.149909 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3118/6258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:20 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:21.175739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:21.176439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:21.183244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:21.183698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:21.184477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:21.184915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:21.324876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:21.333443 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd5682c5-b14f-41fc-9e98-39dfc871751c tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.162696 Apr 09 21:35:21.334016 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3141/6259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:21 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:21.605710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e2c44adf-fc85-44a4-8db1-350a03876312 req-447b1b2f-4203-463d-a298-903cd0943488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bba5ac-8bba-4e5e-8949-c7bc620a8c22", "name": "network-vif-plugged", "status": "completed", "tag": "dbaa066f-e4cf-4268-b5bb-9b496001e2b8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:21.615440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2c44adf-fc85-44a4-8db1-350a03876312 req-447b1b2f-4203-463d-a298-903cd0943488 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:21.616689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e2c44adf-fc85-44a4-8db1-350a03876312 req-447b1b2f-4203-463d-a298-903cd0943488 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:21.633512 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e2c44adf-fc85-44a4-8db1-350a03876312 req-447b1b2f-4203-463d-a298-903cd0943488 service nova] Creating event network-vif-plugged:dbaa066f-e4cf-4268-b5bb-9b496001e2b8 for instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 on nch1-master-1 Apr 09 21:35:21.639576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e2c44adf-fc85-44a4-8db1-350a03876312 req-447b1b2f-4203-463d-a298-903cd0943488 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Apr 09 21:35:21.640754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3119/6260] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:22.166507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:22.167123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:22.174332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:22.174780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:22.175551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:22.175984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:22.310561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:22.318311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-14b42354-5bdc-41c4-b87a-0fe4d0ebe453 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1372 microversion: 2.1 time: 0.155893 Apr 09 21:35:22.318895 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3142/6261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:22 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:22.350375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:22.351083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:22.358578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:22.359039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:22.359817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:22.360256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:22.493540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:22.501224 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-382242d7-b2f5-4e52-8990-85e12277d3f5 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.155049 Apr 09 21:35:22.501796 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3120/6262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:22 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:23.338946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:23.339545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:23.346701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.347153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.347929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.348363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.482129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:23.490248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2360a58-2860-48dc-bc09-b487db25d6a6 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1543 microversion: 2.1 time: 0.157502 Apr 09 21:35:23.490879 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3143/6263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:23 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1543 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:23.506566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:23.507190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:23.515421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.516115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.517143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.517652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.517764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:23.518349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:23.525588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.526083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.526878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:23.527323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:23.710822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:23.715487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:23.721926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6cb69ae-4d1d-406f-96a2-089480f60510 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1543 microversion: 2.1 time: 0.219047 Apr 09 21:35:23.723067 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3121/6264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:23 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1543 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:35:23.725321 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9212e83c-fe58-4bc8-b99b-6a06e75232c1 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.211416 Apr 09 21:35:23.725901 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3144/6265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:23 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:24.741803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:24.742527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:24.750129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:24.750592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:24.751382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:24.751835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:24.987486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:24.995148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-230f89e9-228f-4d11-8699-0f1e9b311b99 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.257094 Apr 09 21:35:24.995863 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3122/6266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:24 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:25.787885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-aca1f284-5f46-47ae-b7a9-2351ea5762f9 req-c1c7c373-28ee-4e9d-b49e-914a6941e6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8bba5ac-8bba-4e5e-8949-c7bc620a8c22", "tag": "dbaa066f-e4cf-4268-b5bb-9b496001e2b8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:25.797504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-aca1f284-5f46-47ae-b7a9-2351ea5762f9 req-c1c7c373-28ee-4e9d-b49e-914a6941e6d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:25.798038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-aca1f284-5f46-47ae-b7a9-2351ea5762f9 req-c1c7c373-28ee-4e9d-b49e-914a6941e6d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:25.809997 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-aca1f284-5f46-47ae-b7a9-2351ea5762f9 req-c1c7c373-28ee-4e9d-b49e-914a6941e6d3 service nova] Creating event network-changed:dbaa066f-e4cf-4268-b5bb-9b496001e2b8 for instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 on nch1-master-1 Apr 09 21:35:25.815107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-aca1f284-5f46-47ae-b7a9-2351ea5762f9 req-c1c7c373-28ee-4e9d-b49e-914a6941e6d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Apr 09 21:35:25.815695 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3145/6267] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:26.013793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:26.014513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:26.022134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:26.022602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:26.023415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:26.024235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:26.235646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:26.244373 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6963ae80-db4e-4555-806c-bbf9c3520d90 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.235070 Apr 09 21:35:26.245166 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3123/6268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:26 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:27.056178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-8f884909-c2cb-4a9a-8186-47a9d51d4295 req-3d2fb1a4-ca0d-45a3-be37-958c4355a770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865dc81b-5656-46ef-b403-170b3f5adb70", "name": "network-vif-plugged", "status": "completed", "tag": "e734433e-37c2-48eb-a6f3-b8bd12274b0d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:27.066359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8f884909-c2cb-4a9a-8186-47a9d51d4295 req-3d2fb1a4-ca0d-45a3-be37-958c4355a770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:27.066848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8f884909-c2cb-4a9a-8186-47a9d51d4295 req-3d2fb1a4-ca0d-45a3-be37-958c4355a770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:27.079148 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-8f884909-c2cb-4a9a-8186-47a9d51d4295 req-3d2fb1a4-ca0d-45a3-be37-958c4355a770 service nova] Creating event network-vif-plugged:e734433e-37c2-48eb-a6f3-b8bd12274b0d for instance 865dc81b-5656-46ef-b403-170b3f5adb70 on nch2-master-1 Apr 09 21:35:27.084031 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-8f884909-c2cb-4a9a-8186-47a9d51d4295 req-3d2fb1a4-ca0d-45a3-be37-958c4355a770 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034800 Apr 09 21:35:27.084849 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3146/6269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:27.263483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:27.264250 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:27.274323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:27.274885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:27.275887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:27.276373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:27.418940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:27.427003 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-80970ab6-215c-445d-8eec-4d501111d138 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.167972 Apr 09 21:35:27.427598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3124/6270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:27 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:28.450021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:28.451197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:28.463181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:28.464374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:28.465229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:28.465671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:28.606648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:28.614254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-26f98e90-7433-4c90-910f-13564df3e700 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1263 microversion: 2.1 time: 0.173035 Apr 09 21:35:28.614834 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3147/6271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:28 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:29.634728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:29.635435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:29.642645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:29.643103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:29.643918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:29.644360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:29.928002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:29.936267 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b6cd01e-bc36-4cc2-befe-c1945f612275 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1450 microversion: 2.1 time: 0.307850 Apr 09 21:35:29.936818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3125/6272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:29 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1450 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:35:29.958070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:35:29.958597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:29.965800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:29.966255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:29.967032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:29.967468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:30.106579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:35:30.114635 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6eb9d8e9-26c2-48cd-abab-0e716f6e0155 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1450 microversion: 2.1 time: 0.160578 Apr 09 21:35:30.115258 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3148/6273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:35:29 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:35:32.113128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e7c47229-749d-4fdd-8388-a7de0cdeab3f req-50902506-f7dd-4a78-b5bd-b9ddb71e1244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865dc81b-5656-46ef-b403-170b3f5adb70", "tag": "e734433e-37c2-48eb-a6f3-b8bd12274b0d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:32.122248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7c47229-749d-4fdd-8388-a7de0cdeab3f req-50902506-f7dd-4a78-b5bd-b9ddb71e1244 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:32.122704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e7c47229-749d-4fdd-8388-a7de0cdeab3f req-50902506-f7dd-4a78-b5bd-b9ddb71e1244 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:32.134538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e7c47229-749d-4fdd-8388-a7de0cdeab3f req-50902506-f7dd-4a78-b5bd-b9ddb71e1244 service nova] Creating event network-changed:e734433e-37c2-48eb-a6f3-b8bd12274b0d for instance 865dc81b-5656-46ef-b403-170b3f5adb70 on nch2-master-1 Apr 09 21:35:32.140120 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e7c47229-749d-4fdd-8388-a7de0cdeab3f req-50902506-f7dd-4a78-b5bd-b9ddb71e1244 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Apr 09 21:35:32.141296 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3126/6274] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:35:48.174764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:35:48.176597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:35:48.184030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:48.184488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:48.185351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:35:48.185786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:35:48.239993 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b2ad7ed7-e4c3-40fe-bfb9-003aaf8d9c11 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22/action" status: 200 len: 24574 microversion: 2.1 time: 0.069200 Apr 09 21:35:48.240708 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3149/6275] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:35:48 2022] POST /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:36:01.082727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: .version_select at 0x7fb08db57d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-89971181"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:01.097285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:36:01.102594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:36:01.215294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:36:01.220256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:36:01.234285 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f8368d44-b063-4c37-81e6-7cca4db0a634 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.157479 Apr 09 21:36:01.234897 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3127/6276] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:36:01 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:02.248116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-587182214", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "cbc9ae09-e279-4755-9a62-9396d42f0602"}], "key_name": "tempest-TestNetworkBasicOps-89971181", "security_groups": [{"name": "tempest-secgroup-smoke-669462241"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:02.479846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] validate_networks() for [('cbc9ae09-e279-4755-9a62-9396d42f0602', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:36:02.872176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:36:02.872598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:36:02.873073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:36:02.873500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:36:02.874103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:36:02.886034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:02.886483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:02.887282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:02.887714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:02.904606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:36:02.910180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:36:02.922843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:36:02.925281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:36:02.977112 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba2e4f66-9c17-46be-93c7-73dcc42eca7f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733400 Apr 09 21:36:02.982894 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3150/6277] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:36:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:36:02.990017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb192f4f-ca79-48a5-8e90-bc7a4123deda tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:02.991172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb192f4f-ca79-48a5-8e90-bc7a4123deda tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:03.110978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb192f4f-ca79-48a5-8e90-bc7a4123deda tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:03.118928 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb192f4f-ca79-48a5-8e90-bc7a4123deda tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1246 microversion: 2.1 time: 0.134806 Apr 09 21:36:03.119528 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3128/6278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:02 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1246 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:04.140379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:04.141088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:04.148459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:04.149007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:04.149872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:04.150483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:04.212180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:04.219621 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f367815-59a7-4b2b-978b-6eda11ef1ab3 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1304 microversion: 2.1 time: 0.084878 Apr 09 21:36:04.220425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3151/6279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:04 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:05.236365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:05.237295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:05.244929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:05.245697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:05.246689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:05.247177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:05.343958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d52770cf-064f-4b5f-aeb6-d7d7751dc4e8 req-cdc8eaac-a3f5-49f3-b603-6cffa376d7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a209929c-9159-4d88-8795-4f78a8a3c52b", "tag": "3acc31a5-a307-41b6-8106-1fec4fe6e5fd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:05.363627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d52770cf-064f-4b5f-aeb6-d7d7751dc4e8 req-cdc8eaac-a3f5-49f3-b603-6cffa376d7d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:05.364096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d52770cf-064f-4b5f-aeb6-d7d7751dc4e8 req-cdc8eaac-a3f5-49f3-b603-6cffa376d7d3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:05.385280 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d52770cf-064f-4b5f-aeb6-d7d7751dc4e8 req-cdc8eaac-a3f5-49f3-b603-6cffa376d7d3 service nova] Creating event network-changed:3acc31a5-a307-41b6-8106-1fec4fe6e5fd for instance a209929c-9159-4d88-8795-4f78a8a3c52b on nch2-master-1 Apr 09 21:36:05.394681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d52770cf-064f-4b5f-aeb6-d7d7751dc4e8 req-cdc8eaac-a3f5-49f3-b603-6cffa376d7d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062872 Apr 09 21:36:05.395979 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3152/6280] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:36:05.424480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:05.432283 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d1dd291-d6ed-49da-9d88-9f321305b84c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.200054 Apr 09 21:36:05.432881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3129/6281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:05 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:06.454334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:06.455275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:06.463289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:06.463744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:06.464531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:06.464974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:06.601403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:06.609452 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bce10950-fef9-4c3c-8b9d-6482322d95be tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.162599 Apr 09 21:36:06.610055 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3153/6282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:06 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:07.626654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:07.627312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:07.634692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:07.635150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:07.635930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:07.636381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:07.776188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:07.783995 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-86a60891-317f-4607-b47a-6f9e6f4d5173 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.161273 Apr 09 21:36:07.784568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3130/6283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:07 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:08.805355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:08.806344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:08.817984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:08.818748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:08.819945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:08.820386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:08.953780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:08.961387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d522861-0093-450e-9037-2fb5947a0f9e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.162684 Apr 09 21:36:08.962007 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3154/6284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:08 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:09.982654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:09.983672 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:09.993956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:09.994424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:09.995221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:09.995705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:10.133002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:10.143936 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-80eb1033-e55e-4ac6-9131-b4ecb062b9f0 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.167530 Apr 09 21:36:10.144707 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3131/6285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:09 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:11.162499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:11.163192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:11.170674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:11.171128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:11.171900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:11.172333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:11.298223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-00c3c928-ff22-483b-ba4c-645e7b71f8b2 req-2b8028ab-aac2-4e1b-ba26-8894a21c8e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a209929c-9159-4d88-8795-4f78a8a3c52b", "name": "network-vif-plugged", "status": "completed", "tag": "3acc31a5-a307-41b6-8106-1fec4fe6e5fd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:11.309075 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-00c3c928-ff22-483b-ba4c-645e7b71f8b2 req-2b8028ab-aac2-4e1b-ba26-8894a21c8e97 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:11.309677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-00c3c928-ff22-483b-ba4c-645e7b71f8b2 req-2b8028ab-aac2-4e1b-ba26-8894a21c8e97 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:11.315578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:11.323979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6781d693-79a2-4076-a898-a80d610986ff tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.165464 Apr 09 21:36:11.324910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3155/6286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:11 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:11.328340 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-00c3c928-ff22-483b-ba4c-645e7b71f8b2 req-2b8028ab-aac2-4e1b-ba26-8894a21c8e97 service nova] Creating event network-vif-plugged:3acc31a5-a307-41b6-8106-1fec4fe6e5fd for instance a209929c-9159-4d88-8795-4f78a8a3c52b on nch2-master-1 Apr 09 21:36:11.335492 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-00c3c928-ff22-483b-ba4c-645e7b71f8b2 req-2b8028ab-aac2-4e1b-ba26-8894a21c8e97 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041514 Apr 09 21:36:11.336242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3132/6287] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:36:12.342499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:12.343138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:12.351032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:12.351528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:12.352377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:12.352854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:12.500918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:12.508929 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-809eec44-6de7-4fe6-85e3-c1a51836491c tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1371 microversion: 2.1 time: 0.171005 Apr 09 21:36:12.509594 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3156/6288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:12 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:13.530027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:13.530876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:13.539550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:13.540209 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:13.541450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:13.541997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:13.743229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:13.751410 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c3616f72-5b93-4104-9a8d-fe51920408ea tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1544 microversion: 2.1 time: 0.228930 Apr 09 21:36:13.752021 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3133/6289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:13 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1544 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:13.767971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:13.768690 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:13.775900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:13.776431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:13.777246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:13.777694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:13.979570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:13.987618 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb6f1c23-7088-4408-b956-47d508d2bac1 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1544 microversion: 2.1 time: 0.223769 Apr 09 21:36:13.988211 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3157/6290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:13 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:41.433634 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:36:41.435072 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:36:50.675687 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:50.676239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:50.682722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:50.683854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:50.684678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:50.685162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:50.712265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:36:50.805996 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-468159fa-69d9-4b04-a053-051ba2c57fc7 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 204 len: 0 microversion: 2.1 time: 0.133575 Apr 09 21:36:50.806598 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3134/6291] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:36:50 2022] DELETE /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:36:50.815148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:50.815840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:50.824093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:50.825229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:50.826028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:50.826528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:50.962667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:50.970736 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4272eaf9-656d-4ba4-9421-ca2df7875d8a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1550 microversion: 2.1 time: 0.159884 Apr 09 21:36:50.971319 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3158/6292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:50 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:51.988538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:51.989307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:51.997061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:51.997518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:51.998341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:51.999079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:52.138910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:52.146592 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0b240a92-b633-4132-8db6-729cb910d618 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1550 microversion: 2.1 time: 0.162353 Apr 09 21:36:52.147306 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3135/6293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:51 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:52.929376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dcd7b65b-2235-4fcc-9d25-5a31cc4b8679 req-9a587f84-e92e-4314-b1f8-abde01d0e47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a209929c-9159-4d88-8795-4f78a8a3c52b", "name": "network-vif-deleted", "tag": "3acc31a5-a307-41b6-8106-1fec4fe6e5fd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:52.938573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dcd7b65b-2235-4fcc-9d25-5a31cc4b8679 req-9a587f84-e92e-4314-b1f8-abde01d0e47b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:52.939016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dcd7b65b-2235-4fcc-9d25-5a31cc4b8679 req-9a587f84-e92e-4314-b1f8-abde01d0e47b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:52.951258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dcd7b65b-2235-4fcc-9d25-5a31cc4b8679 req-9a587f84-e92e-4314-b1f8-abde01d0e47b service nova] Creating event network-vif-deleted:3acc31a5-a307-41b6-8106-1fec4fe6e5fd for instance a209929c-9159-4d88-8795-4f78a8a3c52b on nch2-master-1 Apr 09 21:36:52.956708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dcd7b65b-2235-4fcc-9d25-5a31cc4b8679 req-9a587f84-e92e-4314-b1f8-abde01d0e47b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031266 Apr 09 21:36:52.957362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3159/6294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:36:53.166729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:53.167529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:53.177552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:53.178219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:53.179341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:53.179981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:53.213900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:53.214327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:53.214823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lazy-loading 'fault' on Instance uuid a209929c-9159-4d88-8795-4f78a8a3c52b {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:36:53.257937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:53.267259 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5cbb6c23-9b9b-4863-a373-dcd1bfed2b18 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 200 len: 1336 microversion: 2.1 time: 0.106197 Apr 09 21:36:53.268406 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3136/6295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:53 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:54.286511 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:54.287210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: a209929c-9159-4d88-8795-4f78a8a3c52b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:54.293973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:54.294426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:54.295205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:54.295649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:54.309550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] HTTP exception thrown: Instance a209929c-9159-4d88-8795-4f78a8a3c52b could not be found. Apr 09 21:36:54.310142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Returning 404 to user: Instance a209929c-9159-4d88-8795-4f78a8a3c52b could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:36:54.310974 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-06898d9b-7845-4599-9a0c-cde2093ceb04 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b" status: 404 len: 111 microversion: 2.1 time: 0.029770 Apr 09 21:36:54.311506 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3160/6296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:54 2022] GET /compute/v2.1/servers/a209929c-9159-4d88-8795-4f78a8a3c52b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:36:54.476032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6bafd6f5-0cec-4c0c-ba1e-4ef42b26dbc8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '.version_select at 0x7fb08c1f09d0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:54.497680 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6bafd6f5-0cec-4c0c-ba1e-4ef42b26dbc8 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-89971181" status: 202 len: 0 microversion: 2.1 time: 0.025408 Apr 09 21:36:54.498204 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3137/6297] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:36:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-89971181 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:36:56.270773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:56.271324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:56.277196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-91924b44-e65e-47e4-a735-29d6555ee966 req-7da08b02-d8dc-472c-94f0-981bfdb5c49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8bba5ac-8bba-4e5e-8949-c7bc620a8c22", "tag": "dbaa066f-e4cf-4268-b5bb-9b496001e2b8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:56.285158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:56.285648 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:56.286143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-91924b44-e65e-47e4-a735-29d6555ee966 req-7da08b02-d8dc-472c-94f0-981bfdb5c49e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:56.286676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-91924b44-e65e-47e4-a735-29d6555ee966 req-7da08b02-d8dc-472c-94f0-981bfdb5c49e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:56.286827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:56.287603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:56.297897 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-91924b44-e65e-47e4-a735-29d6555ee966 req-7da08b02-d8dc-472c-94f0-981bfdb5c49e service nova] Creating event network-changed:dbaa066f-e4cf-4268-b5bb-9b496001e2b8 for instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 on nch1-master-1 Apr 09 21:36:56.306947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-91924b44-e65e-47e4-a735-29d6555ee966 req-7da08b02-d8dc-472c-94f0-981bfdb5c49e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034045 Apr 09 21:36:56.307932 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3138/6298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:36:56.323876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:36:56.411092 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6f3d724-8514-4c69-bc84-a746dabe21fb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 204 len: 0 microversion: 2.1 time: 0.143916 Apr 09 21:36:56.412109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3161/6299] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:36:56 2022] DELETE /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:36:56.421259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:56.422302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:56.428798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:56.429485 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:56.430444 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:56.431053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:56.579362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:56.586894 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7661f8ad-c363-47de-b82b-b2dbc86c8ced tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1667 microversion: 2.1 time: 0.170055 Apr 09 21:36:56.587477 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3139/6300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:56 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:36:57.607038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:57.607772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:57.615855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:57.616342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:57.617227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:57.617665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:58.096904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:36:58.104836 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e289c2d6-ad2b-4483-bc7d-fa3d82eee257 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 200 len: 1667 microversion: 2.1 time: 0.502674 Apr 09 21:36:58.105680 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3162/6301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:57 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 1667 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:36:58.520866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cb2dd50d-f260-4e72-b406-b6825c67bdca req-9ebdb04a-74c4-45c5-a4cb-ca3bb135503e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bba5ac-8bba-4e5e-8949-c7bc620a8c22", "name": "network-vif-deleted", "tag": "dbaa066f-e4cf-4268-b5bb-9b496001e2b8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:36:58.531477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cb2dd50d-f260-4e72-b406-b6825c67bdca req-9ebdb04a-74c4-45c5-a4cb-ca3bb135503e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:58.531966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cb2dd50d-f260-4e72-b406-b6825c67bdca req-9ebdb04a-74c4-45c5-a4cb-ca3bb135503e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:58.543895 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cb2dd50d-f260-4e72-b406-b6825c67bdca req-9ebdb04a-74c4-45c5-a4cb-ca3bb135503e service nova] Creating event network-vif-deleted:dbaa066f-e4cf-4268-b5bb-9b496001e2b8 for instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 on nch1-master-1 Apr 09 21:36:58.549313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cb2dd50d-f260-4e72-b406-b6825c67bdca req-9ebdb04a-74c4-45c5-a4cb-ca3bb135503e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Apr 09 21:36:58.549924 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3140/6302] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:36:59.125550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:59.126278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: c8bba5ac-8bba-4e5e-8949-c7bc620a8c22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:36:59.134997 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:59.135570 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:59.136519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:36:59.137091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:36:59.156625 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] HTTP exception thrown: Instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 could not be found. Apr 09 21:36:59.157253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Returning 404 to user: Instance c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:36:59.158083 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11f2fed2-b29d-4a49-9efd-01355fb5f804 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22" status: 404 len: 111 microversion: 2.1 time: 0.038414 Apr 09 21:36:59.158614 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3163/6303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:36:59 2022] GET /compute/v2.1/servers/c8bba5ac-8bba-4e5e-8949-c7bc620a8c22 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:36:59.325015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ff9c436f-456d-43e8-a512-dac3ef76936f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '.version_select at 0x7fb08c1ee820>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:36:59.344420 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ff9c436f-456d-43e8-a512-dac3ef76936f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-132241706" status: 202 len: 0 microversion: 2.1 time: 0.024137 Apr 09 21:36:59.345025 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3141/6304] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 21:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-132241706 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:37:07.693264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: .version_select at 0x7fb08e1e61f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1564016521"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:07.708777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:37:07.714902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:37:07.964157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:37:07.969284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:37:07.983515 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cbc09d04-c72d-440d-85cf-ed73f74636c9 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.294613 Apr 09 21:37:07.988953 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3164/6305] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:37:07 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:08.951952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1440487667", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "acba3ce0-36af-42b3-a264-578599fc9a5f"}], "key_name": "tempest-TestNetworkBasicOps-1564016521", "security_groups": [{"name": "tempest-secgroup-smoke-95006098"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:09.076156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] validate_networks() for [('acba3ce0-36af-42b3-a264-578599fc9a5f', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:37:09.502112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:37:09.502569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:37:09.503062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:37:09.503484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:37:09.503903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:37:09.514133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:09.514698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:09.515517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:09.515973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:09.534142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:37:09.540617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Getting quotas for user f0203027cfe84e548c0b541f545585a1 and project 2307958edd534abb847445b0e1dd954d. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:37:09.553217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:37:09.555767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:37:09.607274 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-badcaecb-122f-4c89-9c67-1bd3a82caa68 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.660849 Apr 09 21:37:09.608031 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3142/6306] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:37:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:37:09.620850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ffcff713-b993-48b4-8f33-5f4df7ca5ff2 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:09.622193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ffcff713-b993-48b4-8f33-5f4df7ca5ff2 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:09.684596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ffcff713-b993-48b4-8f33-5f4df7ca5ff2 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:09.692534 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ffcff713-b993-48b4-8f33-5f4df7ca5ff2 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1249 microversion: 2.1 time: 0.077279 Apr 09 21:37:09.694072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3165/6307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:09 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:10.710960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:10.711598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:10.719968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:10.720683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:10.721716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:10.722348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:10.798882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:10.806852 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b66750d4-e686-4b3c-ae48-a14c1fff0706 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1319 microversion: 2.1 time: 0.100066 Apr 09 21:37:10.807448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3143/6308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:10 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:11.824194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:11.824967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:11.833108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:11.833704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:11.834756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:11.835293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:12.063890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:12.072098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e74c6193-50a1-4281-a3e5-0a6b8dc73f5b tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.252175 Apr 09 21:37:12.072690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3166/6309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:11 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:12.431050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-68d218fe-a9f1-4c24-9b31-50a01d7bf818 req-b6bb1b87-7c5a-40cb-9dec-347931c1914d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e5ba44-4ad9-4b72-8bc6-badf6de74e61", "tag": "4b0aa577-f25c-4659-b116-5cf77d5cff67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:12.447419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-68d218fe-a9f1-4c24-9b31-50a01d7bf818 req-b6bb1b87-7c5a-40cb-9dec-347931c1914d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:12.448237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-68d218fe-a9f1-4c24-9b31-50a01d7bf818 req-b6bb1b87-7c5a-40cb-9dec-347931c1914d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:12.466859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-68d218fe-a9f1-4c24-9b31-50a01d7bf818 req-b6bb1b87-7c5a-40cb-9dec-347931c1914d service nova] Creating event network-changed:4b0aa577-f25c-4659-b116-5cf77d5cff67 for instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 on nch1-master-1 Apr 09 21:37:12.472943 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-68d218fe-a9f1-4c24-9b31-50a01d7bf818 req-b6bb1b87-7c5a-40cb-9dec-347931c1914d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046225 Apr 09 21:37:12.473594 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3144/6310] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:13.093125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:13.094158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:13.105079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:13.105793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:13.106988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:13.107678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:13.252329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:13.260487 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81c4832e-4aa5-4ab1-947a-1ab91af79378 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.173516 Apr 09 21:37:13.261069 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3167/6311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:13 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:14.280231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:14.280943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:14.288356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:14.288816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:14.289613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:14.290502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:14.433887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:14.441903 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-177afc6e-8fd7-4ae7-9239-644ed66ab5bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.167827 Apr 09 21:37:14.442504 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3145/6312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:14 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:15.461390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:15.462011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:15.472369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:15.472952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:15.474149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:15.474743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:15.618085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:15.626811 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b35439d-e7fc-49f9-ab8c-2edc22f5a921 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.171564 Apr 09 21:37:15.627670 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3168/6313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:15 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:16.645287 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:16.645890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:16.652673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:16.653163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:16.653936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:16.654382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:16.802726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:16.814004 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd9ab89c-a1c8-4ba2-8e94-b2be8528993e tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.172643 Apr 09 21:37:16.814881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3146/6314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:16 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:17.840001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:17.840985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:17.852767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:17.853587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:17.854857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:17.855578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:17.996431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:18.004050 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa0c1691-48db-46b8-b6f6-2d88b45c1dec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.170731 Apr 09 21:37:18.004643 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3169/6315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:17 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:18.044963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ddb48ae3-d878-4ef6-a8f9-35812573b8fe req-bf5ff6e2-0845-4075-89b1-8698a84647ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e5ba44-4ad9-4b72-8bc6-badf6de74e61", "name": "network-vif-plugged", "status": "completed", "tag": "4b0aa577-f25c-4659-b116-5cf77d5cff67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:18.053952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ddb48ae3-d878-4ef6-a8f9-35812573b8fe req-bf5ff6e2-0845-4075-89b1-8698a84647ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:18.054385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ddb48ae3-d878-4ef6-a8f9-35812573b8fe req-bf5ff6e2-0845-4075-89b1-8698a84647ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:18.065809 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ddb48ae3-d878-4ef6-a8f9-35812573b8fe req-bf5ff6e2-0845-4075-89b1-8698a84647ac service nova] Creating event network-vif-plugged:4b0aa577-f25c-4659-b116-5cf77d5cff67 for instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 on nch1-master-1 Apr 09 21:37:18.071151 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ddb48ae3-d878-4ef6-a8f9-35812573b8fe req-bf5ff6e2-0845-4075-89b1-8698a84647ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029664 Apr 09 21:37:18.071810 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3147/6316] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:19.020745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:19.021374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:19.028682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:19.029166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:19.029937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:19.030371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:19.164291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:19.171926 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f63c7d29-2997-4e57-96e8-e6fb2dd89a5f tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1373 microversion: 2.1 time: 0.155284 Apr 09 21:37:19.172507 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3170/6317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:19 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:20.192488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:20.193215 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:20.200517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:20.201014 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:20.201825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:20.202274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:20.344238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:20.352570 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bec22d43-89f9-40b5-b45c-c48bcf1b8007 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1545 microversion: 2.1 time: 0.165703 Apr 09 21:37:20.353181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3148/6318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:20 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:20.368837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:20.369482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:20.376632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:20.377083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:20.377881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:20.378323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:20.514615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:20.522712 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e22b3822-344f-4035-93a4-0f5a76a3c7bb tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1545 microversion: 2.1 time: 0.157750 Apr 09 21:37:20.523331 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3171/6319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:20 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:21.569063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:21.569629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:21.573022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d2a50b87-a1c6-46ff-9390-e3ab5cfb813f req-12d67dad-cbcb-474a-8a27-428d7502b2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865dc81b-5656-46ef-b403-170b3f5adb70", "tag": "e734433e-37c2-48eb-a6f3-b8bd12274b0d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:21.591918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:21.592968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:21.594257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:21.594639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d2a50b87-a1c6-46ff-9390-e3ab5cfb813f req-12d67dad-cbcb-474a-8a27-428d7502b2ec service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:21.595262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:21.595979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d2a50b87-a1c6-46ff-9390-e3ab5cfb813f req-12d67dad-cbcb-474a-8a27-428d7502b2ec service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:21.613676 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d2a50b87-a1c6-46ff-9390-e3ab5cfb813f req-12d67dad-cbcb-474a-8a27-428d7502b2ec service nova] Creating event network-changed:e734433e-37c2-48eb-a6f3-b8bd12274b0d for instance 865dc81b-5656-46ef-b403-170b3f5adb70 on nch2-master-1 Apr 09 21:37:21.619903 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d2a50b87-a1c6-46ff-9390-e3ab5cfb813f req-12d67dad-cbcb-474a-8a27-428d7502b2ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055279 Apr 09 21:37:21.620456 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3172/6320] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:21.628782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:37:21.742132 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 204 len: 0 microversion: 2.1 time: 0.180037 Apr 09 21:37:21.743312 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3149/6321] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:37:21 2022] DELETE /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:37:21.752773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:21.753501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:21.760917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:21.761619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:21.763534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:21.764143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:22.023312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:22.031668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34cfdc23-81f3-4ebc-9ca6-7ac9d51eeca4 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1574 microversion: 2.1 time: 0.283744 Apr 09 21:37:22.032876 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3173/6322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:21 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1574 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:22.334276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-ed440149-bcda-41d0-9979-eb3723c89e58 req-75e86e00-2a89-47ee-97b8-3c8fd2f3f986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e5ba44-4ad9-4b72-8bc6-badf6de74e61", "tag": "4b0aa577-f25c-4659-b116-5cf77d5cff67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:22.342625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ed440149-bcda-41d0-9979-eb3723c89e58 req-75e86e00-2a89-47ee-97b8-3c8fd2f3f986 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:22.343585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-ed440149-bcda-41d0-9979-eb3723c89e58 req-75e86e00-2a89-47ee-97b8-3c8fd2f3f986 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:22.357945 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-ed440149-bcda-41d0-9979-eb3723c89e58 req-75e86e00-2a89-47ee-97b8-3c8fd2f3f986 service nova] Creating event network-changed:4b0aa577-f25c-4659-b116-5cf77d5cff67 for instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 on nch1-master-1 Apr 09 21:37:22.364405 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-ed440149-bcda-41d0-9979-eb3723c89e58 req-75e86e00-2a89-47ee-97b8-3c8fd2f3f986 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Apr 09 21:37:22.366626 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3150/6323] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:23.050530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:23.051842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:23.058892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:23.059977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:23.060967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:23.061655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:23.201614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:23.209405 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3eeb95d6-fc66-4953-ba06-8c9ab916ea5f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1574 microversion: 2.1 time: 0.163481 Apr 09 21:37:23.209975 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3174/6324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:23 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:23.808887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1dd93a28-21c6-497d-a916-2e355673cdfd req-ad972bc7-6a65-4da7-81f7-b88fe0105f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865dc81b-5656-46ef-b403-170b3f5adb70", "name": "network-vif-deleted", "tag": "e734433e-37c2-48eb-a6f3-b8bd12274b0d"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:23.819571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1dd93a28-21c6-497d-a916-2e355673cdfd req-ad972bc7-6a65-4da7-81f7-b88fe0105f96 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:23.821065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1dd93a28-21c6-497d-a916-2e355673cdfd req-ad972bc7-6a65-4da7-81f7-b88fe0105f96 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:23.832650 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1dd93a28-21c6-497d-a916-2e355673cdfd req-ad972bc7-6a65-4da7-81f7-b88fe0105f96 service nova] Creating event network-vif-deleted:e734433e-37c2-48eb-a6f3-b8bd12274b0d for instance 865dc81b-5656-46ef-b403-170b3f5adb70 on nch2-master-1 Apr 09 21:37:23.837447 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1dd93a28-21c6-497d-a916-2e355673cdfd req-ad972bc7-6a65-4da7-81f7-b88fe0105f96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Apr 09 21:37:23.838068 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3151/6325] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:24.227252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:24.228105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:24.235950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:24.236406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:24.237227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:24.237698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:24.268475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:24.268962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:24.269454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid 865dc81b-5656-46ef-b403-170b3f5adb70 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:37:24.313239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:24.321478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a01d6242-552c-4589-bb61-ffc67357ca8a tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 200 len: 1227 microversion: 2.1 time: 0.097926 Apr 09 21:37:24.322703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3175/6326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:24 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 1227 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:25.340391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:25.341150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 865dc81b-5656-46ef-b403-170b3f5adb70] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:25.347994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:25.348453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:25.349274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:25.349721 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:25.363923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 865dc81b-5656-46ef-b403-170b3f5adb70 could not be found. Apr 09 21:37:25.364664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 865dc81b-5656-46ef-b403-170b3f5adb70 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:37:25.365629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c9d5564f-b2da-4775-bd1a-1165380b8b57 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70" status: 404 len: 111 microversion: 2.1 time: 0.030513 Apr 09 21:37:25.366170 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3152/6327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:25 2022] GET /compute/v2.1/servers/865dc81b-5656-46ef-b403-170b3f5adb70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:37:44.708822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:44.709802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:44.717948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:44.718444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:44.719238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:44.719669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:44.773427 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e63aa078-6629-433f-9a77-723216c2220d tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61/action" status: 200 len: 24561 microversion: 2.1 time: 0.070213 Apr 09 21:37:44.774375 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3176/6328] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:37:44 2022] POST /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61/action => generated 24561 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:37:51.175657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:51.176678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:51.183566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:51.184054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:51.184837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:51.185312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:51.234703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95f2d3aa-ee5c-48a1-8983-e947f7512054 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "POST /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61/action" status: 200 len: 32621 microversion: 2.1 time: 0.063052 Apr 09 21:37:51.235352 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3153/6329] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:37:51 2022] POST /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61/action => generated 32621 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:37:52.686105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:52.688056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:52.696633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:52.697134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:52.697988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:52.698544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:52.727095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:37:52.772298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f7e961a0-46be-4cd9-9ed8-fb59b60d5677 req-86e0fdde-a297-4134-9ae0-014545c5a2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e5ba44-4ad9-4b72-8bc6-badf6de74e61", "tag": "4b0aa577-f25c-4659-b116-5cf77d5cff67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:52.782629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f7e961a0-46be-4cd9-9ed8-fb59b60d5677 req-86e0fdde-a297-4134-9ae0-014545c5a2df service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:52.783376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f7e961a0-46be-4cd9-9ed8-fb59b60d5677 req-86e0fdde-a297-4134-9ae0-014545c5a2df service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:52.795816 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f7e961a0-46be-4cd9-9ed8-fb59b60d5677 req-86e0fdde-a297-4134-9ae0-014545c5a2df service nova] Creating event network-changed:4b0aa577-f25c-4659-b116-5cf77d5cff67 for instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 on nch1-master-1 Apr 09 21:37:52.802040 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f7e961a0-46be-4cd9-9ed8-fb59b60d5677 req-86e0fdde-a297-4134-9ae0-014545c5a2df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124347 Apr 09 21:37:52.803193 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3154/6330] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:52.816937 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6e975144-cbaf-414a-b9ec-a7772b548a6a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 204 len: 0 microversion: 2.1 time: 0.141238 Apr 09 21:37:52.818570 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3177/6331] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:37:52 2022] DELETE /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:37:52.827790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:52.828499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:52.835363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:52.835821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:52.836600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:52.837068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:52.984207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:52.992264 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f2369a5-aa3d-4a34-add1-95d8b434508a tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1670 microversion: 2.1 time: 0.168789 Apr 09 21:37:52.993052 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3155/6332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:52 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:37:54.014561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:54.014561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:54.021393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:54.022175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:54.022945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:54.023391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:54.226564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:54.234855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83e2c99f-27a4-477d-be04-4e1a582bd490 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1670 microversion: 2.1 time: 0.225967 Apr 09 21:37:54.235460 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3178/6333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:54 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:37:54.861047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-265472d8-9b8f-4bd1-9567-9fb0c116cdf3 req-c0d4534e-50ee-4498-8e3a-6196ee2ab4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e5ba44-4ad9-4b72-8bc6-badf6de74e61", "name": "network-vif-deleted", "tag": "4b0aa577-f25c-4659-b116-5cf77d5cff67"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:54.872720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-265472d8-9b8f-4bd1-9567-9fb0c116cdf3 req-c0d4534e-50ee-4498-8e3a-6196ee2ab4c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:54.873235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-265472d8-9b8f-4bd1-9567-9fb0c116cdf3 req-c0d4534e-50ee-4498-8e3a-6196ee2ab4c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:54.885531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-265472d8-9b8f-4bd1-9567-9fb0c116cdf3 req-c0d4534e-50ee-4498-8e3a-6196ee2ab4c4 service nova] Creating event network-vif-deleted:4b0aa577-f25c-4659-b116-5cf77d5cff67 for instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 on nch1-master-1 Apr 09 21:37:54.891406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-265472d8-9b8f-4bd1-9567-9fb0c116cdf3 req-c0d4534e-50ee-4498-8e3a-6196ee2ab4c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 Apr 09 21:37:54.892185 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3156/6334] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:37:55.252096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:55.254552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:55.261813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:55.262261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:55.263097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:55.263531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:55.308833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:55.309391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:55.309901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lazy-loading 'fault' on Instance uuid 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:37:55.352333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0203027cfe84e548c0b541f545585a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307958edd534abb847445b0e1dd954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:55.359389 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d7ceb46-c75f-4238-a7ab-1756a8e3ec78 tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 200 len: 1339 microversion: 2.1 time: 0.111427 Apr 09 21:37:55.359980 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3179/6335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:55 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:37:56.381256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:56.381966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] [instance: 05e5ba44-4ad9-4b72-8bc6-badf6de74e61] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:56.390457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:56.390952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:56.391825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:56.392320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:56.406030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] HTTP exception thrown: Instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 could not be found. Apr 09 21:37:56.406624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Returning 404 to user: Instance 05e5ba44-4ad9-4b72-8bc6-badf6de74e61 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:37:56.407454 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89ac91eb-fa0f-4894-b8e6-ecd7c73b5ddc tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61" status: 404 len: 111 microversion: 2.1 time: 0.032764 Apr 09 21:37:56.407958 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3157/6336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:56 2022] GET /compute/v2.1/servers/05e5ba44-4ad9-4b72-8bc6-badf6de74e61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:37:56.575762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b58f64e9-5c30-4007-9c45-a39205acbcec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] Calling method '.version_select at 0x7fb08e1f4c10>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:56.598061 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b58f64e9-5c30-4007-9c45-a39205acbcec tempest-TestNetworkBasicOps-121607112 tempest-TestNetworkBasicOps-121607112-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1564016521" status: 202 len: 0 microversion: 2.1 time: 0.025924 Apr 09 21:37:56.599061 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3180/6337] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 21:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1564016521 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:37:58.891178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:58.892493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:58.899684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:58.900320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:58.901599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:58.902340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:58.906893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2c1dcae4-0db0-4a64-90a9-f71ec724bae8 req-c2af3e19-1c99-4dd3-b387-b2a9ac7e05b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de5a516-0ec3-4ff2-8957-5defe102de22", "tag": "0a7a5701-b0a1-4a59-9337-ee33fe404576"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:37:58.918342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2c1dcae4-0db0-4a64-90a9-f71ec724bae8 req-c2af3e19-1c99-4dd3-b387-b2a9ac7e05b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:58.918791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2c1dcae4-0db0-4a64-90a9-f71ec724bae8 req-c2af3e19-1c99-4dd3-b387-b2a9ac7e05b9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:58.930406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:37:58.934535 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2c1dcae4-0db0-4a64-90a9-f71ec724bae8 req-c2af3e19-1c99-4dd3-b387-b2a9ac7e05b9 service nova] Creating event network-changed:0a7a5701-b0a1-4a59-9337-ee33fe404576 for instance 9de5a516-0ec3-4ff2-8957-5defe102de22 on nch2-master-1 Apr 09 21:37:58.944129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2c1dcae4-0db0-4a64-90a9-f71ec724bae8 req-c2af3e19-1c99-4dd3-b387-b2a9ac7e05b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040050 Apr 09 21:37:58.945128 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3181/6338] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:37:59.040358 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 204 len: 0 microversion: 2.1 time: 0.152661 Apr 09 21:37:59.043669 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3158/6339] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:37:58 2022] DELETE /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:37:59.056667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:37:59.057772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:37:59.065454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:59.066099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:59.066886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:37:59.067378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:37:59.349913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:37:59.358113 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9b4eb125-463b-4a53-a583-f6127134cd76 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1573 microversion: 2.1 time: 0.308749 Apr 09 21:37:59.358728 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3182/6340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:37:59 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1573 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:00.376637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:00.377963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:00.385269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:00.386081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:00.387116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:00.387642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:00.553412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:00.560999 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2eaf7dea-7539-4bd2-98ac-b439649e2233 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1573 microversion: 2.1 time: 0.188759 Apr 09 21:38:00.561958 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3159/6341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:00 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:01.123028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-008a3cd2-7fc7-42a6-a173-2cc060ad4aaf req-9d31d39d-b5f6-491d-98f0-122a4483b093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de5a516-0ec3-4ff2-8957-5defe102de22", "name": "network-vif-deleted", "tag": "0a7a5701-b0a1-4a59-9337-ee33fe404576"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:01.134272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-008a3cd2-7fc7-42a6-a173-2cc060ad4aaf req-9d31d39d-b5f6-491d-98f0-122a4483b093 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:01.134710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-008a3cd2-7fc7-42a6-a173-2cc060ad4aaf req-9d31d39d-b5f6-491d-98f0-122a4483b093 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:01.148160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-008a3cd2-7fc7-42a6-a173-2cc060ad4aaf req-9d31d39d-b5f6-491d-98f0-122a4483b093 service nova] Creating event network-vif-deleted:0a7a5701-b0a1-4a59-9337-ee33fe404576 for instance 9de5a516-0ec3-4ff2-8957-5defe102de22 on nch2-master-1 Apr 09 21:38:01.153285 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-008a3cd2-7fc7-42a6-a173-2cc060ad4aaf req-9d31d39d-b5f6-491d-98f0-122a4483b093 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034025 Apr 09 21:38:01.153929 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3183/6342] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:01.578511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:01.579442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:01.587258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:01.587781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:01.588689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:01.589331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:01.625141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:01.625838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:01.626253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lazy-loading 'fault' on Instance uuid 9de5a516-0ec3-4ff2-8957-5defe102de22 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:38:01.672590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9bbd737ff54225a549f072976ef296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1063334e4a426eb70eec5ed1578744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:01.682055 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0df617f5-482d-49bf-a5f2-72acdf77de88 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 200 len: 1226 microversion: 2.1 time: 0.107583 Apr 09 21:38:01.682783 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3160/6343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:01 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:02.707163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:02.708123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 9de5a516-0ec3-4ff2-8957-5defe102de22] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:02.714773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:02.715232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:02.716039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:02.716477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:02.729752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 9de5a516-0ec3-4ff2-8957-5defe102de22 could not be found. Apr 09 21:38:02.730337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 9de5a516-0ec3-4ff2-8957-5defe102de22 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:02.731161 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4ca09542-33b6-48eb-a4dd-ab58020fe379 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22" status: 404 len: 111 microversion: 2.1 time: 0.032661 Apr 09 21:38:02.731702 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3184/6344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:02 2022] GET /compute/v2.1/servers/9de5a516-0ec3-4ff2-8957-5defe102de22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:38:03.198533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:03.199054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:03.208533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:03.208992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:03.209798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:03.210244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:03.223388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. Apr 09 21:38:03.223981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:03.224836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c67e63b5-aba5-4b5f-af06-4a29b9efcd1f tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 404 len: 111 microversion: 2.1 time: 0.033069 Apr 09 21:38:03.225428 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3161/6345] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:38:03 2022] DELETE /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:38:03.233846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:03.234500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] [instance: 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:03.240976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:03.241474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:03.242245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:03.242682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:03.255931 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] HTTP exception thrown: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. Apr 09 21:38:03.256542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Returning 404 to user: Instance 91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:03.257434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bd714f9f-f8a6-415c-b4c4-a25d37c97396 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8" status: 404 len: 111 microversion: 2.1 time: 0.027610 Apr 09 21:38:03.257951 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3185/6346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:03 2022] GET /compute/v2.1/servers/91ee4c60-a2e7-49b0-87e6-6bceb56c93e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:38:05.626124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-198c2b88-3c90-45de-838a-3baf6a5ce349 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] Calling method '.version_select at 0x7fb08c1deaf0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:05.651693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-198c2b88-3c90-45de-838a-3baf6a5ce349 tempest-TestVolumeBootPattern-212634100 tempest-TestVolumeBootPattern-212634100-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-860748" status: 202 len: 0 microversion: 2.1 time: 0.029296 Apr 09 21:38:05.652494 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3162/6347] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Apr 9 21:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-860748 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:38:21.047152 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:38:21.047776 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:38:24.979430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1556234465", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:25.031040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] validate_networks() for None {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:38:25.669156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:38:25.669587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:38:25.670065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:38:25.670477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:38:25.670895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:38:25.680309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:25.680771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:25.681632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:25.682076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:25.699820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Getting quotas for project c029d816337b4a5d97fa5fc881203e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:38:25.705683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Getting quotas for user bcd63823db1446db8425ef68cc834956 and project c029d816337b4a5d97fa5fc881203e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:38:25.721656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:38:25.723951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:38:25.769295 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e4302e8-f8c5-4ea5-9446-be0b33ed764c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911741 Apr 09 21:38:25.769944 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3186/6348] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:38:25.782647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c027b55f-39d1-47b6-98bb-d27985bc15db tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:25.783400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c027b55f-39d1-47b6-98bb-d27985bc15db tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:25.838596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c027b55f-39d1-47b6-98bb-d27985bc15db tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:25.845817 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c027b55f-39d1-47b6-98bb-d27985bc15db tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1222 microversion: 2.1 time: 0.069309 Apr 09 21:38:25.846421 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3163/6349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:25 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:26.863408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04da8416-dcad-44a2-b90b-04f69015094d tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:26.864054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-04da8416-dcad-44a2-b90b-04f69015094d tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:26.917138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04da8416-dcad-44a2-b90b-04f69015094d tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:26.924210 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04da8416-dcad-44a2-b90b-04f69015094d tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1222 microversion: 2.1 time: 0.065768 Apr 09 21:38:26.924776 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3187/6350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:26 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:27.940759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d8cac9cf-ac5b-4203-896e-f828fc56eebe tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:27.941426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d8cac9cf-ac5b-4203-896e-f828fc56eebe tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:27.994774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d8cac9cf-ac5b-4203-896e-f828fc56eebe tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:28.002333 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d8cac9cf-ac5b-4203-896e-f828fc56eebe tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1222 microversion: 2.1 time: 0.065636 Apr 09 21:38:28.002916 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3164/6351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:27 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:29.023588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:29.024589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:29.033600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:29.034053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:29.034831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:29.035270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:29.098261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:29.106160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fe1f06eb-17fb-46c7-a2a6-bf5f6cbb67df tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1226 microversion: 2.1 time: 0.089230 Apr 09 21:38:29.106782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3188/6352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:29 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:30.122661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:30.123422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:30.131240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:30.131706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:30.132501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:30.132960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:30.219997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:30.228064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e915b015-ee3c-445e-8a80-6c3ebc0d40ac tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1280 microversion: 2.1 time: 0.109395 Apr 09 21:38:30.228648 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3165/6353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:30 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:31.246125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:31.247301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:31.254826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:31.255284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:31.256076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:31.256515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:31.444903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:31.452893 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0d3f5d29-f303-45ac-867b-431b9194b829 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.210734 Apr 09 21:38:31.453633 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3189/6354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:31 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:31.552817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-dbcc85ba-eac5-4a7a-ae5e-94d82ea7b0e2 req-f193d6e1-c067-4de1-8763-e75552cfa186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b", "tag": "810346fc-5efd-46ec-ba9c-2a319bf44dcc"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:31.561583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dbcc85ba-eac5-4a7a-ae5e-94d82ea7b0e2 req-f193d6e1-c067-4de1-8763-e75552cfa186 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:31.562316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-dbcc85ba-eac5-4a7a-ae5e-94d82ea7b0e2 req-f193d6e1-c067-4de1-8763-e75552cfa186 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:31.585190 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-dbcc85ba-eac5-4a7a-ae5e-94d82ea7b0e2 req-f193d6e1-c067-4de1-8763-e75552cfa186 service nova] Creating event network-changed:810346fc-5efd-46ec-ba9c-2a319bf44dcc for instance 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b on nch1-master-1 Apr 09 21:38:31.590502 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-dbcc85ba-eac5-4a7a-ae5e-94d82ea7b0e2 req-f193d6e1-c067-4de1-8763-e75552cfa186 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041393 Apr 09 21:38:31.591152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3166/6355] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:32.470187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:32.470804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:32.478092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:32.478545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:32.479325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:32.479762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:32.630606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:32.638323 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd65a4e7-4023-43d9-b635-3536ea1dd01c tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.172159 Apr 09 21:38:32.638907 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3190/6356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:32 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:33.656686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:33.657438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:33.664233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:33.664699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:33.665524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:33.665970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:33.794729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:33.802392 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e57ef476-2960-42fb-b819-7693071d9826 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.151359 Apr 09 21:38:33.802971 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3167/6357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:33 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:34.822675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:34.823593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:34.834272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:34.834965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:34.836159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:34.836730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:34.972980 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:34.980491 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5d20b901-c670-473c-9556-c74507faf985 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.164703 Apr 09 21:38:34.981077 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3191/6358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:34 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:36.000479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:36.001536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:36.013023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:36.013554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:36.014347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:36.014790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:36.154567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:36.162503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8c50da3f-205e-4225-91a0-985079681dde tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.168567 Apr 09 21:38:36.163096 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3168/6359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:35 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:36.611637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-88fb5ba0-c6fa-4750-9a7c-e484fa5a61c7 req-eae753a3-41cf-454c-b259-be7c6b98921d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b", "name": "network-vif-plugged", "status": "completed", "tag": "810346fc-5efd-46ec-ba9c-2a319bf44dcc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:36.619837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-88fb5ba0-c6fa-4750-9a7c-e484fa5a61c7 req-eae753a3-41cf-454c-b259-be7c6b98921d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:36.620284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-88fb5ba0-c6fa-4750-9a7c-e484fa5a61c7 req-eae753a3-41cf-454c-b259-be7c6b98921d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:36.631545 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-88fb5ba0-c6fa-4750-9a7c-e484fa5a61c7 req-eae753a3-41cf-454c-b259-be7c6b98921d service nova] Creating event network-vif-plugged:810346fc-5efd-46ec-ba9c-2a319bf44dcc for instance 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b on nch1-master-1 Apr 09 21:38:36.638569 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-88fb5ba0-c6fa-4750-9a7c-e484fa5a61c7 req-eae753a3-41cf-454c-b259-be7c6b98921d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094326 Apr 09 21:38:36.639315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3192/6360] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:37.184025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:37.184985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:37.192264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:37.192767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:37.193904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:37.194359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:37.329155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:37.337011 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f36fb33c-440b-452d-a0b2-a9a7ed459881 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1322 microversion: 2.1 time: 0.160314 Apr 09 21:38:37.337646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3169/6361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:37 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:38.362451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:38.363387 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:38.372186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.372777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.373899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.374482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.515673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:38.524016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76d5486f-87d5-4383-bf84-4826f2b741dc tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1472 microversion: 2.1 time: 0.172244 Apr 09 21:38:38.524595 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3193/6362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:38 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:38.605244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d787f89-ca63-4964-8769-f8d72f7d861f tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '.version_select at 0x7fb08da4b1f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:38.672640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d787f89-ca63-4964-8769-f8d72f7d861f tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/3ddc9f4e4ff74c56b88bd20d4e303bf6" status: 200 len: 371 microversion: 2.1 time: 0.133687 Apr 09 21:38:38.673279 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3170/6363] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:38:38 2022] GET /compute/v2.1/os-quota-sets/3ddc9f4e4ff74c56b88bd20d4e303bf6 => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:38.683934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a099955a-4b5c-4c61-add3-639f9dfb66e4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-551774843", "id": 1006533629, "os-flavor-access:is_public": "True"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:38.685688 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:38:38.685688 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:38:38.704094 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a099955a-4b5c-4c61-add3-639f9dfb66e4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023910 Apr 09 21:38:38.704682 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3194/6364] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:38:38 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:38.715399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1006533629"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:38.716706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:38.722835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.723300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.724083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.724536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.917233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd4335119f9aa45cbae9193e2df99a25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:38.923974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-551774843 {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:38:38.930499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.930955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.931758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:38.932199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:38.952034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Getting quotas for project c029d816337b4a5d97fa5fc881203e5f. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:38:38.956914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Getting quotas for user bcd63823db1446db8425ef68cc834956 and project c029d816337b4a5d97fa5fc881203e5f. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:38:38.969581 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] ram quota exceeded for 3ddc9f4e4ff74c56b88bd20d4e303bf6, tried to resize instance. Apr 09 21:38:38.970147 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Apr 09 21:38:38.970777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:38.971628 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ebd52ce1-b63a-4ec8-9493-5f9196d00234 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b/action" status: 403 len: 118 microversion: 2.1 time: 0.260257 Apr 09 21:38:38.972222 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3171/6365] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:38:38 2022] POST /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b/action => generated 118 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:38:38.980897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-581014f6-d042-4652-9439-f5998c432a13 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:38.981730 ncdv-master-1 devstack@n-api.service[141818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:38:38.981730 ncdv-master-1 devstack@n-api.service[141818]: warnings.warn(msg) Apr 09 21:38:39.001258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-581014f6-d042-4652-9439-f5998c432a13 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1006533629" status: 202 len: 0 microversion: 2.1 time: 0.024133 Apr 09 21:38:39.001796 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3195/6366] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 21:38:38 2022] DELETE /compute/v2.1/flavors/1006533629 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:38:39.009518 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42e2f546-d291-46d2-a565-bf34ce445587 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.028180 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42e2f546-d291-46d2-a565-bf34ce445587 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022334 Apr 09 21:38:39.028728 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3172/6367] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:38:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:38:39.044981 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cfa1f9cd-5238-40ce-a961-70274062d136 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '.version_select at 0x7fb08e47d160>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.116572 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cfa1f9cd-5238-40ce-a961-70274062d136 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/3ddc9f4e4ff74c56b88bd20d4e303bf6" status: 200 len: 371 microversion: 2.1 time: 0.075266 Apr 09 21:38:39.117185 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3196/6368] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Apr 9 21:38:39 2022] GET /compute/v2.1/os-quota-sets/3ddc9f4e4ff74c56b88bd20d4e303bf6 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:39.127459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c6445ea3-f4a9-4d80-90b4-d6a9929905ac tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-777194130", "id": 1773210859, "os-flavor-access:is_public": "True"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:39.128980 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:38:39.128980 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:38:39.146379 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c6445ea3-f4a9-4d80-90b4-d6a9929905ac tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022779 Apr 09 21:38:39.146973 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3173/6369] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:38:39 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:39.157583 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1773210859"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:39.158612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:39.164629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.165088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.165858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.166299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.259166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd4335119f9aa45cbae9193e2df99a25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddc9f4e4ff74c56b88bd20d4e303bf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:39.267396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-777194130 {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:38:39.274399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.274852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.275667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.276104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.298181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Getting quotas for project c029d816337b4a5d97fa5fc881203e5f. Resources: {'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:38:39.303739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Getting quotas for user bcd63823db1446db8425ef68cc834956 and project c029d816337b4a5d97fa5fc881203e5f. Resources: {'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:38:39.319282 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.api [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] cores quota exceeded for 3ddc9f4e4ff74c56b88bd20d4e303bf6, tried to resize instance. Apr 09 21:38:39.319821 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Apr 09 21:38:39.320420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:39.321315 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e9a41cae-1b12-4b81-97e0-8ba5dcb582a4 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b/action" status: 403 len: 113 microversion: 2.1 time: 0.167729 Apr 09 21:38:39.321902 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3197/6370] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:38:39 2022] POST /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:38:39.330361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17180be1-c47b-4d96-907e-fe4096fdca2f tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.331168 ncdv-master-1 devstack@n-api.service[141819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 21:38:39.331168 ncdv-master-1 devstack@n-api.service[141819]: warnings.warn(msg) Apr 09 21:38:39.350644 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17180be1-c47b-4d96-907e-fe4096fdca2f tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1773210859" status: 202 len: 0 microversion: 2.1 time: 0.024077 Apr 09 21:38:39.351244 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3174/6371] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Apr 9 21:38:39 2022] DELETE /compute/v2.1/flavors/1773210859 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:38:39.359280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c0008deb-be5b-44a8-a956-027f22d84766 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.379060 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c0008deb-be5b-44a8-a956-027f22d84766 tempest-ServersAdminNegativeTestJSON-931439021 tempest-ServersAdminNegativeTestJSON-931439021-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023401 Apr 09 21:38:39.379739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3198/6372] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Apr 9 21:38:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:39.403029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.403639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:39.410081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.410540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.411313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.411755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.435740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:38:39.517867 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ac4389e-2e11-4b2c-a27c-d6ff6f94fab2 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 204 len: 0 microversion: 2.1 time: 0.120654 Apr 09 21:38:39.518633 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3175/6373] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:38:39 2022] DELETE /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:38:39.526786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:39.527406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:39.533725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.534184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.534964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:39.535407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:39.677142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:39.688951 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-343deec4-87b2-4b65-aa1d-738cddf05782 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1478 microversion: 2.1 time: 0.165838 Apr 09 21:38:39.689749 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3199/6374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:39 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:40.712192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:40.713410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:40.725400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:40.726192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:40.727472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:40.728223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:40.939176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd63823db1446db8425ef68cc834956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c029d816337b4a5d97fa5fc881203e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:40.947604 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90c6a8f6-b9cb-40f3-9990-67fda4a57ea0 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 200 len: 1478 microversion: 2.1 time: 0.242808 Apr 09 21:38:40.948186 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3176/6375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:40 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 1478 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:41.319476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-58650f54-33dc-4629-9461-70e0c055941d req-9ad58250-3e4f-4bfc-a714-d692743e9766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b", "name": "network-vif-deleted", "tag": "810346fc-5efd-46ec-ba9c-2a319bf44dcc"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:41.329411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-58650f54-33dc-4629-9461-70e0c055941d req-9ad58250-3e4f-4bfc-a714-d692743e9766 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:41.330143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-58650f54-33dc-4629-9461-70e0c055941d req-9ad58250-3e4f-4bfc-a714-d692743e9766 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:41.343918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-58650f54-33dc-4629-9461-70e0c055941d req-9ad58250-3e4f-4bfc-a714-d692743e9766 service nova] Creating event network-vif-deleted:810346fc-5efd-46ec-ba9c-2a319bf44dcc for instance 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b on nch1-master-1 Apr 09 21:38:41.350005 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-58650f54-33dc-4629-9461-70e0c055941d req-9ad58250-3e4f-4bfc-a714-d692743e9766 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035630 Apr 09 21:38:41.350627 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3200/6376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:41.968537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:41.969719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] [instance: 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:41.981733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:41.982642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:41.983479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:41.983930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:41.997330 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] HTTP exception thrown: Instance 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b could not be found. Apr 09 21:38:41.997940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] Returning 404 to user: Instance 8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:38:41.998769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1df1078e-6e06-4ce5-9844-93a3232db1e3 tempest-ServersAdminNegativeTestJSON-646216488 tempest-ServersAdminNegativeTestJSON-646216488-project] 10.222.0.30 "GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b" status: 404 len: 111 microversion: 2.1 time: 0.037316 Apr 09 21:38:41.999296 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3177/6377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:41 2022] GET /compute/v2.1/servers/8a5a6ee2-0bc2-4d15-ba7d-d91dd2ef313b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:38:44.829052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2082916027", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "c39ed4ca-d665-44f3-a955-40e63484312f"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:44.887695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] validate_networks() for [('c39ed4ca-d665-44f3-a955-40e63484312f', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:38:45.253772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:38:45.254160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:38:45.254636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:38:45.255043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:38:45.255453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:38:45.264567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:45.265020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:45.265854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:45.266293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:45.284050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Getting quotas for project 8c47c6b05b064cc6b8e62b875f3a9450. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:38:45.289789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Getting quotas for user 36f5c38ad8044ad7a21c100af55f9fe7 and project 8c47c6b05b064cc6b8e62b875f3a9450. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:38:45.303519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:38:45.305914 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:38:45.352360 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1be720b1-e1e5-4ca9-9866-b22717f93524 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645314 Apr 09 21:38:45.353011 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3201/6378] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:38:45.363169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5af4173c-c6da-4b74-8eaa-c5fbc508e639 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:45.363801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5af4173c-c6da-4b74-8eaa-c5fbc508e639 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:45.419328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5af4173c-c6da-4b74-8eaa-c5fbc508e639 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:45.425493 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5af4173c-c6da-4b74-8eaa-c5fbc508e639 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1215 microversion: 2.1 time: 0.066224 Apr 09 21:38:45.426004 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3178/6379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:45 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:46.444689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:46.445328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:46.452948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:46.454177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:46.454982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:46.455452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:46.524758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:46.533387 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96aa0486-31f9-4207-90aa-8a20d2b0530b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1273 microversion: 2.1 time: 0.094744 Apr 09 21:38:46.534100 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3202/6380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:46 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:47.553731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:47.554447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:47.562805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:47.563268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:47.564054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:47.564500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:47.719915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ff984191-be84-4562-93b7-d8aa7605511c req-93fbf9f5-4701-4ef1-a57d-f3780e72448a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:47.729494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff984191-be84-4562-93b7-d8aa7605511c req-93fbf9f5-4701-4ef1-a57d-f3780e72448a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:47.729945 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff984191-be84-4562-93b7-d8aa7605511c req-93fbf9f5-4701-4ef1-a57d-f3780e72448a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:47.744174 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ff984191-be84-4562-93b7-d8aa7605511c req-93fbf9f5-4701-4ef1-a57d-f3780e72448a service nova] Creating event network-changed:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch1-master-1 Apr 09 21:38:47.749381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ff984191-be84-4562-93b7-d8aa7605511c req-93fbf9f5-4701-4ef1-a57d-f3780e72448a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034383 Apr 09 21:38:47.749984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3203/6381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:38:47.772106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:47.779832 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69fd916d-ec31-427c-9aae-6efaa9913054 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.230166 Apr 09 21:38:47.780407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3179/6382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:47 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:48.803649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:48.804915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:48.815800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:48.816544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:48.817871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:48.818960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:48.995903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:49.004181 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d517b049-a43a-4a64-ac7d-227b183313dd tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.209172 Apr 09 21:38:49.004772 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3204/6383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:48 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:50.021548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:50.023192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:50.032424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:50.032885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:50.033709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:50.034157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:50.179992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:50.187416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-229eca02-e3e4-4178-9a17-ff79f6ee0559 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.170096 Apr 09 21:38:50.187988 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3180/6384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:50 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:51.207087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:51.207979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:51.217901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:51.218544 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:51.219636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:51.220247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:51.353499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:51.361940 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de7a2249-4d2a-439d-8d8e-547f06c60108 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.160659 Apr 09 21:38:51.362484 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3205/6385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:51 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:52.379354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:52.379944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:52.389144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:52.390506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:52.392104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:52.392558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:52.527356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:52.534937 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28138e41-a5b5-40d7-a556-17a212c7a965 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.159782 Apr 09 21:38:52.535514 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3181/6386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:52 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:52.608940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2b28d8c6-ea2f-40da-a271-d8fc03645dae req-5feb4c33-200e-459f-960e-044f493b688e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "name": "network-vif-plugged", "status": "completed", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:52.618295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b28d8c6-ea2f-40da-a271-d8fc03645dae req-5feb4c33-200e-459f-960e-044f493b688e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:52.618747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2b28d8c6-ea2f-40da-a271-d8fc03645dae req-5feb4c33-200e-459f-960e-044f493b688e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:52.631070 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2b28d8c6-ea2f-40da-a271-d8fc03645dae req-5feb4c33-200e-459f-960e-044f493b688e service nova] Creating event network-vif-plugged:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch1-master-1 Apr 09 21:38:52.635825 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2b28d8c6-ea2f-40da-a271-d8fc03645dae req-5feb4c33-200e-459f-960e-044f493b688e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 Apr 09 21:38:52.636631 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3206/6387] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:38:53.555988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:53.557155 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:53.565576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:53.566038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:53.566825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:53.567275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:53.701776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:53.709983 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2a8bf7f4-7200-4e38-85d3-c9715849b179 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1315 microversion: 2.1 time: 0.160482 Apr 09 21:38:53.710571 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3182/6388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:53 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:54.733433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:54.734143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:54.741287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:54.741744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:54.742519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:54.742959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:54.882560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:54.891680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd656b6a-19fd-438d-9f4e-b5f83f46d8fb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1503 microversion: 2.1 time: 0.166206 Apr 09 21:38:54.892272 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3207/6389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:54 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:54.908151 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:38:54.909244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:54.916319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:54.916805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:54.917604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:54.918054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:54.949135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:54.955456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Old instance type m1.heat2, new instance type m1.heat {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:38:54.961912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:38:54.962344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:38:54.962834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:38:54.963272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:38:54.963693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:38:55.028096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15fc3ac0-b8d6-486e-96a9-35797afa356e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "POST /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86/action" status: 202 len: 0 microversion: 2.1 time: 0.123531 Apr 09 21:38:55.028948 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3183/6390] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:38:54 2022] POST /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:38:55.038679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:55.040245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:55.046401 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:55.046864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:55.047641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:55.048126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:55.180020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:55.187799 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1e167671-f2b0-4eb5-a7a4-087789dc94f8 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1512 microversion: 2.1 time: 0.153175 Apr 09 21:38:55.188396 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3208/6391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:55 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:56.205679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:56.206312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:56.213253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:56.213720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:56.214504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:56.215144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:56.360554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:56.368150 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c873cc28-c60b-4dc0-8777-32ef07f7bcc6 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1512 microversion: 2.1 time: 0.166537 Apr 09 21:38:56.368955 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3184/6392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:56 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:57.390225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:57.391053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:57.402578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:57.403319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:57.404590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:57.405347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:57.549890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:57.557944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0ddd561-3833-40d5-8e4b-7de9704af124 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.174417 Apr 09 21:38:57.558537 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3209/6393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:57 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:58.580456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:58.581656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:58.588833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:58.589327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:58.590112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:58.590558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:58.722755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:58.730821 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1fe5587f-8327-4b56-9fbc-1e6716ac1cab tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.156903 Apr 09 21:38:58.731407 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3185/6394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:58 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:38:59.751888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:38:59.752884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:38:59.764536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:59.765342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:59.766618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:38:59.767360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:38:59.906447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:38:59.914801 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a1b37806-3fc1-453c-a2dd-c7b104bbc513 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.169538 Apr 09 21:38:59.915376 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3210/6395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:38:59 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:00.936122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:00.937279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:00.946882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:00.947349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:00.948138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:00.948586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:01.080124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:01.089755 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-09fe65de-0f64-4ebb-8be8-ef1bb1557692 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.160108 Apr 09 21:39:01.090528 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3186/6396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:00 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:02.114181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:02.114937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:02.121796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:02.122243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:02.123010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:02.123420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:02.264218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:02.272627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8eec4126-1717-4df9-9d9b-3d250eace134 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.165640 Apr 09 21:39:02.273230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3211/6397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:02 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:03.294440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:03.295448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:03.307178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:03.307948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:03.309302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:03.310048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:03.445587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:03.453563 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d1126c03-b0f4-40ab-9f51-4ec14648ae4d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.166179 Apr 09 21:39:03.454177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3187/6398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:03 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:04.470582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:04.471190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:04.478447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:04.478892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:04.479663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:04.480097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:04.615669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:04.627234 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a6e9e3b1-3413-45ab-a469-929d7cffcc04 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.160495 Apr 09 21:39:04.628071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3212/6399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:04 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:05.646371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:05.646983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:05.654472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:05.654978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:05.655841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:05.656331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:05.788355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:05.795987 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d88f3623-14e9-4606-b8fc-cfc09d72d6c2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.154223 Apr 09 21:39:05.796566 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3188/6400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:05 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:06.817509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:06.818482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:06.825750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:06.826209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:06.827004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:06.827491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:06.969371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:06.977647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a41d08a4-dc5e-4cd4-a6a9-ffd94b4cd93b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.166909 Apr 09 21:39:06.978229 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3213/6401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:06 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:07.996563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:07.997302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:08.005573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:08.006172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:08.007099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:08.007733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:08.163424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:08.172504 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e5878d3-7b32-404c-b148-2cec7e00a1b2 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.180632 Apr 09 21:39:08.173181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3189/6402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:07 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:09.194689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:09.195668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:09.203889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:09.204444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:09.205398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:09.205911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:09.340131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:09.349927 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7294708f-e320-4f5c-8de1-bd0a4333b436 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.162490 Apr 09 21:39:09.350554 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3214/6403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:09 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:10.370584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:10.371426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:10.380802 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:10.381475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:10.382577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:10.383202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:10.519007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:10.527854 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d43569d0-3b09-4162-acc8-c6bba95c1d6e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.163242 Apr 09 21:39:10.528439 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3190/6404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:10 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:11.548790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:11.549850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:11.561505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:11.562254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:11.563525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:11.564253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:11.707857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:11.715888 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-464121c6-7d8a-4dff-9f3f-1345967a9e95 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.173681 Apr 09 21:39:11.716477 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3215/6405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:11 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:12.736938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:12.738029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:12.746712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:12.747205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:12.748002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:12.748459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:12.882484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:12.890151 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2ad7ff1-6b48-4d0c-b337-6390ef87352e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.159932 Apr 09 21:39:12.890746 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3191/6406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:12 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:13.911323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:13.912482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:13.923795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:13.924542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:13.925825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:13.926548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:14.065303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:14.076854 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c47cf93-c2e8-4511-977b-2979a542521b tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.171837 Apr 09 21:39:14.077688 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3216/6407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:13 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:15.100142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:15.101410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:15.113069 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:15.113849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:15.115137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:15.115878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:15.253314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:15.265408 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-19fb4fcc-57a3-40a8-a593-22e17cff7a12 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.171583 Apr 09 21:39:15.266187 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3192/6408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:15 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:16.290644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:16.291388 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:16.300232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:16.300802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:16.301811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:16.302373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:16.440461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:16.448885 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f05deb03-f80c-4748-a3b0-567650a72440 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.165011 Apr 09 21:39:16.449512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3217/6409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:16 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:17.467282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:17.467935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:17.475478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:17.475971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:17.476723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:17.477207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:17.614786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:17.622848 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6b9f61f0-0bdc-464f-9b2e-24e5ae4b765a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.159596 Apr 09 21:39:17.623424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3193/6410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:17 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:18.643763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:18.644386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:18.651154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:18.651619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:18.652390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:18.652819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:18.802861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:18.812091 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d59c4bdc-7613-49f2-8221-eda309fdbc8f tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.173109 Apr 09 21:39:18.812645 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3218/6411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:18 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:19.832578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:19.833243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:19.841647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:19.842310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:19.842913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:19.843365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:19.978317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:19.986450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17698347-d513-4c38-9dd9-b53d735e9a77 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.160178 Apr 09 21:39:19.987006 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3194/6412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:19 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:21.007600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:21.008651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:21.016178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:21.016632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:21.017444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:21.017882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:21.149565 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:21.157150 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e39eab50-6e5b-4bf7-97c9-80bb84891939 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.156081 Apr 09 21:39:21.157760 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3219/6413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:20 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:22.178667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:22.179743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:22.191143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:22.191980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:22.193727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:22.194486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:22.339170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:22.350455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-865172c6-4cf0-4c41-a5d1-ebe43d0bc45e tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.178181 Apr 09 21:39:22.351252 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3195/6414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:22 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:23.368959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:23.369552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:23.376448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:23.376900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:23.377715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:23.378157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:23.520120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:23.528235 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5e0cdb0-8d92-4b68-9ae0-40a777436ebe tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1517 microversion: 2.1 time: 0.163559 Apr 09 21:39:23.528820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3220/6415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:23 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:24.506985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "name": "network-vif-unplugged", "status": "completed", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:24.515701 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:24.516167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:24.527893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] Creating event network-vif-unplugged:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch2-master-1 Apr 09 21:39:24.533743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] Instance a34162b3-73f7-48b0-980e-4320046c4c86 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:39:24.545445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:24.546311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:24.553213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:24.557353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:24.558414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:24.558960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:24.559087 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5f2e8013-08cd-4a77-8cef-960ace71cbc3 req-fc8ef501-25dd-40c3-85fc-8b84766252c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125543 Apr 09 21:39:24.559645 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3196/6416] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:39:24.713247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:24.721146 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6cf13473-c222-4e90-9d29-ea7523842114 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1516 microversion: 2.1 time: 0.179663 Apr 09 21:39:24.721743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3221/6417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:24 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:39:25.744990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:25.746265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:25.753427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:25.753913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:25.754737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:25.755217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:25.892462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:25.900414 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d9092b2-6d37-4a43-9b6f-0aadc5f99a2a tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1514 microversion: 2.1 time: 0.163894 Apr 09 21:39:25.901073 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3197/6418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:25 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:26.580770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:26.590127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:26.590589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:26.604642 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] Creating event network-changed:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch2-master-1 Apr 09 21:39:26.610940 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] Instance a34162b3-73f7-48b0-980e-4320046c4c86 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:39:26.621908 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-542f405b-7dbe-44a7-9e36-a5f0b118fcf6 req-c6f3bf77-59e4-470a-9a49-07226659b90a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044905 Apr 09 21:39:26.622486 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3222/6419] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:39:26.919780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:26.920419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:26.927604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:26.928034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:26.929068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:26.929546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:27.141659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:27.149676 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81c53b8c-7465-4ffa-be11-7eb3d4d8ff44 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1514 microversion: 2.1 time: 0.235336 Apr 09 21:39:27.150516 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3198/6420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:26 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:28.170202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:28.170918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:28.178855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:28.179554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:28.180545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:28.180990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:28.326525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:28.334265 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c14eb2cb-e39b-4a3a-9481-619594c8475d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1511 microversion: 2.1 time: 0.170477 Apr 09 21:39:28.334855 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3223/6421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:28 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:28.352419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:28.353745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:28.361550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:28.362020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:28.362781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:28.363352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:28.389248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:39:28.444050 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.compute.api [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Found an unconfirmed migration during delete, id: 16, status: finished Apr 09 21:39:29.788740 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8830bc39-499b-4e9a-bd7a-91ad761a971c tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 204 len: 0 microversion: 2.1 time: 1.441278 Apr 09 21:39:29.789489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3199/6422] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:39:28 2022] DELETE /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 0 bytes in 1443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:39:29.798002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:29.798619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:29.805584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:29.806043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:29.806824 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:29.807269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:30.195525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:30.203270 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e42332e-21ca-4307-aff4-8a6d5590484d tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1503 microversion: 2.1 time: 0.409261 Apr 09 21:39:30.203994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-53f5a660-e4f7-4fac-8425-bb86b6e5576b req-6366a32a-ca54-4f1c-862b-a3410a2f6c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "name": "network-vif-plugged", "status": "completed", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:30.212928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-53f5a660-e4f7-4fac-8425-bb86b6e5576b req-6366a32a-ca54-4f1c-862b-a3410a2f6c4f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:30.213121 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3224/6423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:29 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:30.213689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-53f5a660-e4f7-4fac-8425-bb86b6e5576b req-6366a32a-ca54-4f1c-862b-a3410a2f6c4f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:30.225637 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-53f5a660-e4f7-4fac-8425-bb86b6e5576b req-6366a32a-ca54-4f1c-862b-a3410a2f6c4f service nova] Creating event network-vif-plugged:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch2-master-1 Apr 09 21:39:30.230417 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-53f5a660-e4f7-4fac-8425-bb86b6e5576b req-6366a32a-ca54-4f1c-862b-a3410a2f6c4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030948 Apr 09 21:39:30.231197 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3200/6424] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:39:31.220201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:31.220825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:31.227763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:31.228220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:31.228996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:31.229454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:31.358224 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f5c38ad8044ad7a21c100af55f9fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c47c6b05b064cc6b8e62b875f3a9450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:31.365714 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3b29000f-6888-4472-81e9-5289ea538ee9 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 200 len: 1503 microversion: 2.1 time: 0.149786 Apr 09 21:39:31.366338 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3225/6425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:31 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:31.626196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-40cd5f0a-268f-401a-87c4-d344fbad4c1e req-2acf73ce-72bf-4c53-a136-e8496994f591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34162b3-73f7-48b0-980e-4320046c4c86", "name": "network-vif-deleted", "tag": "85b09974-e77c-4e71-8e7b-04c71d36b3a6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:31.635870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-40cd5f0a-268f-401a-87c4-d344fbad4c1e req-2acf73ce-72bf-4c53-a136-e8496994f591 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:31.636329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-40cd5f0a-268f-401a-87c4-d344fbad4c1e req-2acf73ce-72bf-4c53-a136-e8496994f591 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:31.650728 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-40cd5f0a-268f-401a-87c4-d344fbad4c1e req-2acf73ce-72bf-4c53-a136-e8496994f591 service nova] Creating event network-vif-deleted:85b09974-e77c-4e71-8e7b-04c71d36b3a6 for instance a34162b3-73f7-48b0-980e-4320046c4c86 on nch2-master-1 Apr 09 21:39:31.655733 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-40cd5f0a-268f-401a-87c4-d344fbad4c1e req-2acf73ce-72bf-4c53-a136-e8496994f591 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Apr 09 21:39:31.656365 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3201/6426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:39:32.386917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:32.387907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:32.399360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.400113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.401460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.402189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.416423 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] HTTP exception thrown: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. Apr 09 21:39:32.417022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Returning 404 to user: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:39:32.417887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4036c23b-ad43-4519-abc0-ca69caaa7fdb tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 404 len: 111 microversion: 2.1 time: 0.037657 Apr 09 21:39:32.418428 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3226/6427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:32 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:39:32.435431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:32.436040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:32.443095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.443580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.444384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.444835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.458358 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] HTTP exception thrown: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. Apr 09 21:39:32.458972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Returning 404 to user: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:39:32.459826 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-21daca51-033e-45d5-be1c-0ed47cb0d131 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 404 len: 111 microversion: 2.1 time: 0.029501 Apr 09 21:39:32.460363 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3202/6428] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:39:32 2022] DELETE /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:39:32.468691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:32.469421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] [instance: a34162b3-73f7-48b0-980e-4320046c4c86] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:32.475616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.476082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.476859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:32.477325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:32.490657 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] HTTP exception thrown: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. Apr 09 21:39:32.491240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] Returning 404 to user: Instance a34162b3-73f7-48b0-980e-4320046c4c86 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:39:32.492064 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c277520-f7d3-4328-914d-8461b620e532 tempest-DeleteServersTestJSON-718786743 tempest-DeleteServersTestJSON-718786743-project] 10.222.0.30 "GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86" status: 404 len: 111 microversion: 2.1 time: 0.027422 Apr 09 21:39:32.492589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3227/6429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:32 2022] GET /compute/v2.1/servers/a34162b3-73f7-48b0-980e-4320046c4c86 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:39:35.009570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-569565538", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "813b1f76-437b-409a-a6b2-df7c5fca753a"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:35.063704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] validate_networks() for [('813b1f76-437b-409a-a6b2-df7c5fca753a', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:39:35.433573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:39:35.434011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:39:35.434494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:39:35.434974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:39:35.435385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:39:35.446829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:35.447324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:35.448157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:35.448614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:35.467210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Getting quotas for project 3b7ac04d687340c8a08ac58bdde56a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:39:35.473103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Getting quotas for user ef047f7b0e534c059c06045004189775 and project 3b7ac04d687340c8a08ac58bdde56a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:39:35.487456 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:39:35.489925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:39:35.540015 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b097571e-1db2-4190-938f-516a1cff0781 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648193 Apr 09 21:39:35.540670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3203/6430] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:39:35.551145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11a8ea85-42fb-4a5f-86b1-655592f2e703 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:35.551905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11a8ea85-42fb-4a5f-86b1-655592f2e703 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:35.613240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11a8ea85-42fb-4a5f-86b1-655592f2e703 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:35.621249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11a8ea85-42fb-4a5f-86b1-655592f2e703 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1217 microversion: 2.1 time: 0.073946 Apr 09 21:39:35.621835 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3228/6431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:35 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:36.638983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:36.639667 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:36.646527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:36.647024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:36.647881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:36.648364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:36.711913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:36.719582 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ec9bf2ce-62d8-4d07-8829-d1353ad8b466 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1275 microversion: 2.1 time: 0.085519 Apr 09 21:39:36.729165 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3204/6432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:36 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:37.737128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:37.737776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:37.745083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:37.745569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:37.746358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:37.746796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:37.883151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:37.892231 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3c8e3376-4f46-471c-8fe7-88d81fab2343 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.159052 Apr 09 21:39:37.892818 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3229/6433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:37 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:38.042310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c8499700-6ecb-4e44-8a51-a6b0e93a6905 req-4168cbd6-1570-4097-bc9d-0eb911c1ed85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:38.052029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c8499700-6ecb-4e44-8a51-a6b0e93a6905 req-4168cbd6-1570-4097-bc9d-0eb911c1ed85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:38.052519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c8499700-6ecb-4e44-8a51-a6b0e93a6905 req-4168cbd6-1570-4097-bc9d-0eb911c1ed85 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:38.077769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c8499700-6ecb-4e44-8a51-a6b0e93a6905 req-4168cbd6-1570-4097-bc9d-0eb911c1ed85 service nova] Creating event network-changed:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch2-master-1 Apr 09 21:39:38.082841 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c8499700-6ecb-4e44-8a51-a6b0e93a6905 req-4168cbd6-1570-4097-bc9d-0eb911c1ed85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045030 Apr 09 21:39:38.083469 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3205/6434] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:39:38.911129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:38.911823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:38.919372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:38.919821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:38.920592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:38.921066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:39.063922 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:39.072554 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-973fe40b-ce88-4694-9d2d-fb0cc52ad0f7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.166426 Apr 09 21:39:39.073210 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3230/6435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:38 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:40.094091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:40.095186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:40.102650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:40.103107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:40.103891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:40.104333 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:40.243336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:40.251884 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2f5e0ca-26e0-4882-8e07-537ae35157a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.164895 Apr 09 21:39:40.252475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3206/6436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:40 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:41.273078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:41.274074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:41.285627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:41.286383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:41.287649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:41.288373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:41.429705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:41.439147 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11f8658d-632c-4c82-ab1c-4889bbedecce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.172680 Apr 09 21:39:41.439738 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3231/6437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:41 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:42.459833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:42.460961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:42.471553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:42.472045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:42.472838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:42.473332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:42.613707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:42.621505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-218dd947-6f17-45ec-817c-9c73a7e8b339 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.168178 Apr 09 21:39:42.622077 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3207/6438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:42 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:43.642833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:43.643481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:43.650890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:43.651355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:43.652171 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:43.652610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:43.784662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:43.792958 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b5fc02cc-8d1f-46cf-8963-edb63fb94de3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.156926 Apr 09 21:39:43.793584 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3232/6439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:43 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:44.250969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-90e26539-caad-4d59-94cb-70a48b89bbe7 req-f7add867-f7f3-479d-9819-cf961830bd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "name": "network-vif-plugged", "status": "completed", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:44.260622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-90e26539-caad-4d59-94cb-70a48b89bbe7 req-f7add867-f7f3-479d-9819-cf961830bd25 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:44.261108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-90e26539-caad-4d59-94cb-70a48b89bbe7 req-f7add867-f7f3-479d-9819-cf961830bd25 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:44.273749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-90e26539-caad-4d59-94cb-70a48b89bbe7 req-f7add867-f7f3-479d-9819-cf961830bd25 service nova] Creating event network-vif-plugged:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch2-master-1 Apr 09 21:39:44.278834 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-90e26539-caad-4d59-94cb-70a48b89bbe7 req-f7add867-f7f3-479d-9819-cf961830bd25 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032101 Apr 09 21:39:44.279480 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3208/6440] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:39:44.814311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:44.815375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:44.827240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:44.827995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:44.829336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:44.830024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:44.961730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:44.969442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78dbf5b9-5ecd-4695-afdc-f4325dac50f5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1317 microversion: 2.1 time: 0.161685 Apr 09 21:39:44.970028 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3233/6441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:44 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:45.992844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:45.994084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.004470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.004928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.005766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.006213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.138822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:46.146858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99ad9109-194d-4d21-8c57-2f7d0cb7d408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1508 microversion: 2.1 time: 0.161285 Apr 09 21:39:46.147447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3209/6442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:45 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:46.162933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:46.163555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.170834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.171300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.172079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.172522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.306726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:46.318291 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-929b0b8f-b1a7-4b82-9688-d3cc6d1a34cb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1508 microversion: 2.1 time: 0.159054 Apr 09 21:39:46.319115 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3234/6443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:46 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:46.338367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:46.339707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.346441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.346912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.347710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.348168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.416006 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-73094d5c-f528-4bb2-be17-36593a364857 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "PUT /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1080 microversion: 2.1 time: 0.081423 Apr 09 21:39:46.416758 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3210/6444] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Apr 9 21:39:46 2022] PUT /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1080 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:46.433326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:46.433943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.440284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.440747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.441907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.442348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.573878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:46.583866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b4ea631f-e7ff-4679-b546-4f4ab2817c91 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1506 microversion: 2.1 time: 0.154479 Apr 09 21:39:46.584484 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3235/6445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:46 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:46.599845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:46.600469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.607034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.607499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.608482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.608743 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.742146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:46.749793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-adcf4dda-1f52-425e-a682-b0939f89032d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1506 microversion: 2.1 time: 0.153928 Apr 09 21:39:46.750383 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3211/6446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:46 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:46.766512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:39:46.767504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.773771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.774230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.775115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.775555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.849300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:46.855624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Old instance type m1.heat2, new instance type m1.heat {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:39:46.862369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:39:46.862789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:39:46.863263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:39:46.863667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:39:46.864076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:39:46.977189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b0055eac-1aab-45cb-b5a7-d0dd9a80d725 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27/action" status: 202 len: 0 microversion: 2.1 time: 0.214792 Apr 09 21:39:46.977804 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3236/6447] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:39:46 2022] POST /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:39:46.986240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:46.986900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:46.993740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.994280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:46.994984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:46.995428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:47.128677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:47.136427 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f4020ea-4815-460e-833f-a614c875886a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1517 microversion: 2.1 time: 0.154119 Apr 09 21:39:47.137010 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3212/6448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:46 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:48.159736 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:48.160693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:48.172290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:48.173084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:48.174033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:48.174467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:48.309230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:48.317417 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11443044-90a3-4ac5-9444-8c7c197da22a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1517 microversion: 2.1 time: 0.165767 Apr 09 21:39:48.318226 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3237/6449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:48 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:49.338801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:49.339785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:49.351214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:49.351982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:49.353330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:49.354059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:49.494905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:49.502470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c73055a1-8ebb-47e6-825f-32b730c35ac2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.170181 Apr 09 21:39:49.503020 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3213/6450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:49 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:50.520177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:50.520883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:50.529072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:50.529594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:50.530515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:50.530947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:50.666178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:50.674133 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d0ae1a42-51d4-43cd-b816-6892ec4b7c7e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.158086 Apr 09 21:39:50.674743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3238/6451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:50 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:51.696182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:51.697084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:51.707229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:51.707684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:51.708459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:51.708901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:51.848031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:51.859862 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-13b1ed0e-5193-4c4e-85fb-966991ac161f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.170781 Apr 09 21:39:51.860836 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3214/6452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:51 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:52.879404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:52.880006 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:52.886632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:52.887073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:52.887833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:52.888264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:53.026466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:53.036339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07e88ffb-86eb-4c8d-81fd-7081f88e1cd7 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.162026 Apr 09 21:39:53.036930 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3239/6453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:52 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:54.057566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:54.058578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:54.070533 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:54.071309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:54.072603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:54.073410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:54.205843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:54.213342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1377e8cc-3b71-46dc-b065-095c1eebda8e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.162314 Apr 09 21:39:54.213929 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3215/6454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:54 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:55.234250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:55.235216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:55.246093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:55.246807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:55.248035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:55.248745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:55.396478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:55.404400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf3b57fe-a4a5-4d1c-9810-9942837bfe73 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.176557 Apr 09 21:39:55.404989 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3240/6455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:55 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:56.425880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:56.426956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:56.438558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:56.439339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:56.440864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:56.442120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:56.577288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:56.589018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-062b04a1-877e-42c5-8615-0b986d8521a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.169575 Apr 09 21:39:56.589677 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3216/6456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:56 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:57.610868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:57.611916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:57.620424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:57.620882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:57.621701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:57.622147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:57.759150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:57.766743 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0f05fc11-d489-46fa-9a02-e0d0c820aa0d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.162589 Apr 09 21:39:57.767335 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3241/6457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:57 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:58.789172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:58.789997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:58.799233 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:58.799856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:58.800874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:58.801502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:58.933585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:39:58.941933 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18c57a7b-a469-4823-8f8e-5791ca336e2d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.158928 Apr 09 21:39:58.942521 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3217/6458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:58 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:39:59.961849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:39:59.962534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:39:59.970826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:59.971365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:39:59.972276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:39:59.972770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:00.112540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:00.120286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3039cc63-a00c-47f3-aa56-da86c9609a39 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.163858 Apr 09 21:40:00.120881 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3242/6459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:39:59 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:01.137625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:01.138271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:01.145598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:01.146060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:01.146845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:01.147294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:01.283742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:01.292053 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6f3aacff-f094-4e0e-acb1-c8ead66c782f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.158441 Apr 09 21:40:01.292674 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3218/6460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:01 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:02.313735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:02.314721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:02.322938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:02.323422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:02.324196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:02.324632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:02.455087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:02.466424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c438ee7-837d-4d20-9643-1f545ba5c10c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.159381 Apr 09 21:40:02.467171 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3243/6461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:02 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:03.486652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:03.487279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:03.495112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:03.495546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:03.496351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:03.496797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:03.640961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:03.649267 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-10b0999a-3166-407c-b662-2ec0411cd191 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.166614 Apr 09 21:40:03.649865 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3219/6462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:03 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:04.674284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:04.675265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:04.686934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:04.687684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:04.688976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:04.689885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:04.830004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:04.837538 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec221c8a-6778-4d4a-9fbd-6050ec30dcf8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.169775 Apr 09 21:40:04.838110 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3244/6463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:04 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:05.859146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:05.860230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:05.869074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:05.869567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:05.870353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:05.870805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:06.010160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:06.018177 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-56ec99a2-0989-4c32-ae4a-2ed5bf5fa075 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.165672 Apr 09 21:40:06.018758 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3220/6464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:05 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:07.035591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:07.036300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:07.043547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:07.044003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:07.044780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:07.045270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:07.188325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:07.196837 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5de423f-8c12-4055-9fe7-191358a492f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.165274 Apr 09 21:40:07.197466 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3245/6465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:07 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:08.218196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:08.219157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:08.230733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:08.231500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:08.232800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:08.233594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:08.372850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:08.380813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ad22806-2aaa-4b95-a1d3-c9863a7c279f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.169256 Apr 09 21:40:08.381415 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3221/6466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:08 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:09.402106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:09.403123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:09.413529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:09.413978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:09.414744 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:09.415175 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:09.554747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:09.562968 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a0ebcb0-96a7-4883-896d-5b19c9d4f86e tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.167434 Apr 09 21:40:09.563547 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3246/6467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:09 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:10.584530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:10.585535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:10.597739 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:10.598519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:10.599484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:10.599934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:10.736331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:10.744255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-355e63ae-4bba-40df-8058-27c64f673d6b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.166314 Apr 09 21:40:10.744840 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3222/6468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:10 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:11.765700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:11.767714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:11.779485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:11.780089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:11.781290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:11.781872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:11.924419 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:11.932390 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-790042b1-74b5-4b1e-928d-03eaa4f6f82b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.173552 Apr 09 21:40:11.932960 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3247/6469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:11 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:12.955466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:12.956085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:12.963429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:12.963893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:12.964682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:12.965183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:13.098440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:13.106956 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f1ae0d84-29ca-4275-ace9-ae6d751866e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.155532 Apr 09 21:40:13.107579 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3223/6470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:12 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:14.129812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:14.130795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:14.142303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:14.143061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:14.144346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:14.145104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:14.281521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:14.293545 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1d487c56-c2b2-43f4-b1da-8ccd7e7222e6 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.170013 Apr 09 21:40:14.294409 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3248/6471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:14 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:15.318092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:15.318836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:15.327690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:15.328270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:15.329326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:15.329865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:15.465323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:15.472946 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4309cbda-70a3-45bc-b330-7652449f3926 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1522 microversion: 2.1 time: 0.161754 Apr 09 21:40:15.473617 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3224/6472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:15 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:16.425194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "name": "network-vif-unplugged", "status": "completed", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:16.434576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:16.435027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:16.449067 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] Creating event network-vif-unplugged:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch1-master-1 Apr 09 21:40:16.455343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] Instance 115a92f7-9068-4a4b-9026-764d1b85da27 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:40:16.466442 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3e95d4d6-09ed-42c4-b634-98ca28626829 req-4eb743ad-e01a-4865-a75d-983be2729f9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045000 Apr 09 21:40:16.467061 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3249/6473] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:40:16.490222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:16.490855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:16.501526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:16.501998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:16.502837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:16.503297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:16.692234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:16.702081 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1b022146-0377-4d65-8c9f-dbb0821a8341 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1521 microversion: 2.1 time: 0.215681 Apr 09 21:40:16.702728 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3225/6474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:16 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:17.721535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:17.722231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:17.729088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:17.729524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:17.730302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:17.730769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:17.859960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:17.867780 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2f578c2c-ac3d-4ac0-9c35-672f2d0adeee tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1519 microversion: 2.1 time: 0.151550 Apr 09 21:40:17.868365 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3250/6475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:17 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:18.483105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:18.492469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:18.492931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:18.504649 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] Creating event network-changed:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch1-master-1 Apr 09 21:40:18.510376 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] Instance 115a92f7-9068-4a4b-9026-764d1b85da27 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:40:18.521647 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-24cbe750-762f-4581-b7bb-5e5783d6cdc4 req-5a6fee31-f01f-4441-ad2b-c053b58b6ce3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042289 Apr 09 21:40:18.522265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3226/6476] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:40:18.885321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:18.886118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:18.893454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:18.894218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:18.895269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:18.895783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:19.120613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:19.128818 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-912c1c75-142a-4acd-874d-839e877873ca tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1516 microversion: 2.1 time: 0.247869 Apr 09 21:40:19.139739 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3251/6477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:18 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:19.145955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:19.146598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:19.153186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:19.153628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:19.154626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:19.155079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:19.217424 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d613ee64-03a4-46c9-b0c4-88ebc53b6dba tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27/action" status: 204 len: 0 microversion: 2.1 time: 0.075661 Apr 09 21:40:19.218370 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3227/6478] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:40:19 2022] POST /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:40:19.226535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:19.227153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:19.235778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:19.236315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:19.237356 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:19.237741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:19.651724 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:19.660156 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5b1995a5-f884-42d8-a8e4-73d8c0eb7dc9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1516 microversion: 2.1 time: 0.437661 Apr 09 21:40:19.660939 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3252/6479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:19 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:20.679575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:20.680282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:20.687054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:20.687520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:20.688304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:20.688747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:20.842987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:20.850608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ae87d750-84cb-44c5-94d9-f1068c084379 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1508 microversion: 2.1 time: 0.176357 Apr 09 21:40:20.851196 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3228/6480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:20 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:20.866877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:20.867467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:20.874291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:20.874732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:20.875515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:20.875943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.005329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:21.012807 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1909d656-0b94-4800-9664-c894b4ad3220 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1508 microversion: 2.1 time: 0.149906 Apr 09 21:40:21.013417 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3253/6481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:20 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:21.029297 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:21.029925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:21.035941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.036400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.037202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.037652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.172265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:21.181306 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-816d237b-0baa-44af-961b-23a7f9302401 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 200 len: 1508 microversion: 2.1 time: 0.156007 Apr 09 21:40:21.181883 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3229/6482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:21 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:40:21.197771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:21.198268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:21.204442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.204898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.205840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.206282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.230105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:40:21.309328 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ed787e06-8d1e-4373-b3b1-7250b99e06c1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 204 len: 0 microversion: 2.1 time: 0.114972 Apr 09 21:40:21.309730 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3254/6483] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:40:21 2022] DELETE /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:40:21.361509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-921496749", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "813b1f76-437b-409a-a6b2-df7c5fca753a"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:21.411378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] validate_networks() for [('813b1f76-437b-409a-a6b2-df7c5fca753a', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:40:21.786162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:40:21.786770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:40:21.787058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:40:21.787471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:40:21.787953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:40:21.797712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.798170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.798981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:21.799423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:21.816847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Getting quotas for project 3b7ac04d687340c8a08ac58bdde56a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:40:21.822302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Getting quotas for user ef047f7b0e534c059c06045004189775 and project 3b7ac04d687340c8a08ac58bdde56a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:40:21.835110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:40:21.837513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:40:21.884901 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2319488f-beb9-4f59-aba0-0e208a351abb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527167 Apr 09 21:40:21.885387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3230/6484] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:40:21.896517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf742aad-f107-42cc-ae5b-25cc16f3d210 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:21.897255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf742aad-f107-42cc-ae5b-25cc16f3d210 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:21.957882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf742aad-f107-42cc-ae5b-25cc16f3d210 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:21.965576 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf742aad-f107-42cc-ae5b-25cc16f3d210 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1217 microversion: 2.1 time: 0.073559 Apr 09 21:40:21.966259 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3255/6485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:21 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:22.938855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e8843d48-d651-4235-a448-341b202772e7 req-a95e287d-daf6-41db-a1f1-c3f33ba45644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "name": "network-vif-plugged", "status": "completed", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:22.947716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8843d48-d651-4235-a448-341b202772e7 req-a95e287d-daf6-41db-a1f1-c3f33ba45644 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:22.948500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8843d48-d651-4235-a448-341b202772e7 req-a95e287d-daf6-41db-a1f1-c3f33ba45644 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:22.961308 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e8843d48-d651-4235-a448-341b202772e7 req-a95e287d-daf6-41db-a1f1-c3f33ba45644 service nova] Creating event network-vif-plugged:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch1-master-1 Apr 09 21:40:22.968180 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e8843d48-d651-4235-a448-341b202772e7 req-a95e287d-daf6-41db-a1f1-c3f33ba45644 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Apr 09 21:40:22.969637 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3231/6486] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:40:22.983379 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:22.984713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:22.991850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:22.992591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:22.993636 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:22.994228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:23.110939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:23.119262 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-455d67ff-9d07-4986-b104-097f08e5a80f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1277 microversion: 2.1 time: 0.140412 Apr 09 21:40:23.120133 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3256/6487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:22 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:23.296505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3cf1948d-dbe5-4115-9be6-54b88dcc3803 req-307fd881-b7fd-492a-8235-56ebc82f27b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a92f7-9068-4a4b-9026-764d1b85da27", "name": "network-vif-deleted", "tag": "fe235f29-a5f6-4e12-8d91-f8916d764470"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:23.308502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3cf1948d-dbe5-4115-9be6-54b88dcc3803 req-307fd881-b7fd-492a-8235-56ebc82f27b3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:23.309309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3cf1948d-dbe5-4115-9be6-54b88dcc3803 req-307fd881-b7fd-492a-8235-56ebc82f27b3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:23.322531 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3cf1948d-dbe5-4115-9be6-54b88dcc3803 req-307fd881-b7fd-492a-8235-56ebc82f27b3 service nova] Creating event network-vif-deleted:fe235f29-a5f6-4e12-8d91-f8916d764470 for instance 115a92f7-9068-4a4b-9026-764d1b85da27 on nch1-master-1 Apr 09 21:40:23.328091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3cf1948d-dbe5-4115-9be6-54b88dcc3803 req-307fd881-b7fd-492a-8235-56ebc82f27b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035983 Apr 09 21:40:23.328717 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3232/6488] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:40:24.136084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:24.136686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:24.144054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:24.144610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:24.145499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:24.146000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:24.369197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:24.377562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6f6b003a-ddce-4ac1-8c59-113a819758d0 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.245088 Apr 09 21:40:24.378124 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3257/6489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:24 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:25.344650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cc3cb5fe-bf35-4603-b62f-9135230d54fe req-a53e6031-090e-4110-9880-9c88765ec988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:25.353303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cc3cb5fe-bf35-4603-b62f-9135230d54fe req-a53e6031-090e-4110-9880-9c88765ec988 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:25.353770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cc3cb5fe-bf35-4603-b62f-9135230d54fe req-a53e6031-090e-4110-9880-9c88765ec988 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:25.364664 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cc3cb5fe-bf35-4603-b62f-9135230d54fe req-a53e6031-090e-4110-9880-9c88765ec988 service nova] Creating event network-changed:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch1-master-1 Apr 09 21:40:25.369591 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cc3cb5fe-bf35-4603-b62f-9135230d54fe req-a53e6031-090e-4110-9880-9c88765ec988 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029888 Apr 09 21:40:25.370172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3233/6490] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:40:25.396212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:25.396840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:25.404198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:25.404644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:25.405451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:25.405885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:25.541142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:25.552628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb78f262-fe45-4d28-b652-a06205324e7c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.162302 Apr 09 21:40:25.553594 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3258/6491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:25 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:26.580643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:26.581875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:26.592942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:26.593794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:26.595156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:26.595910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:26.730830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:26.738673 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b3861a5a-a2af-43b2-bf8c-030bcc754e7b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.166603 Apr 09 21:40:26.739248 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3234/6492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:26 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:27.759834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:27.760846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:27.772425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:27.772869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:27.773678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:27.774110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:27.916237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:27.924214 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-52dda606-f178-47fe-a30d-895fdc11d061 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.171027 Apr 09 21:40:27.924801 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3259/6493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:27 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:28.942257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:28.942874 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:28.949886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:28.950345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:28.951130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:28.951575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:28.983674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-42fc1098-654f-41e0-9912-639f6f79b0f6 req-edcc528f-671b-4ecd-b96a-5865ab8629d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "name": "network-vif-plugged", "status": "completed", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:28.992656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-42fc1098-654f-41e0-9912-639f6f79b0f6 req-edcc528f-671b-4ecd-b96a-5865ab8629d5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:28.993420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-42fc1098-654f-41e0-9912-639f6f79b0f6 req-edcc528f-671b-4ecd-b96a-5865ab8629d5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:29.007014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-42fc1098-654f-41e0-9912-639f6f79b0f6 req-edcc528f-671b-4ecd-b96a-5865ab8629d5 service nova] Creating event network-vif-plugged:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch1-master-1 Apr 09 21:40:29.012239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-42fc1098-654f-41e0-9912-639f6f79b0f6 req-edcc528f-671b-4ecd-b96a-5865ab8629d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032286 Apr 09 21:40:29.012856 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3260/6494] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:40:29.117016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:29.124596 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0df5d7a-85ec-40c0-992f-39602dab6e43 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.186657 Apr 09 21:40:29.125200 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3235/6495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:28 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:30.142097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:30.142823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:30.150247 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:30.150691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:30.151459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:30.151892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:30.283139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:30.290763 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5e11d02a-523e-494a-88b6-2f79b531e408 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1317 microversion: 2.1 time: 0.152960 Apr 09 21:40:30.291343 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3261/6496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:30 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:31.311921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:31.312991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:31.325181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.325965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.327272 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.328024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.533655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:31.543401 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0a87245a-d598-4436-8478-1845699450e9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1508 microversion: 2.1 time: 0.238168 Apr 09 21:40:31.544023 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3236/6497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:31 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:31.559833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:31.560454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:31.567793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.568196 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.568963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.569466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.708180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:31.715844 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ea3c0f19-117c-46f4-9546-431eefbbbcf5 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1508 microversion: 2.1 time: 0.160149 Apr 09 21:40:31.716424 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3262/6498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:31 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:31.732239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:40:31.733413 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:31.739720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.740186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.740969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.741462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.775300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:31.781378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Old instance type m1.heat2, new instance type m1.heat {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:40:31.788061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:40:31.788492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:40:31.788969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:40:31.789422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:40:31.789839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:40:31.854880 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9161688-9e51-49b7-a8fd-b78c6468c3ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be/action" status: 202 len: 0 microversion: 2.1 time: 0.126621 Apr 09 21:40:31.855403 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3237/6499] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:40:31 2022] POST /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:40:31.863594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:31.864321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:31.870493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.870953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:31.871705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:31.872169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:32.002962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:32.010419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8509383-7679-46c9-a4fa-89bf7b30b6a4 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1515 microversion: 2.1 time: 0.150753 Apr 09 21:40:32.010993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3263/6500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:31 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:33.029539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:33.030125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:33.036985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:33.037504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:33.038305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:33.038760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:33.255149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:33.265013 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f0bb9749-2928-4654-9c5c-0fe3c4ea658f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1515 microversion: 2.1 time: 0.240928 Apr 09 21:40:33.265620 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3238/6501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:33 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:34.286876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:34.287827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:34.299512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:34.300265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:34.301592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:34.302324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:34.700719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:34.708649 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c43fd7b-f2f0-44e2-823b-88fc709bebd8 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.428516 Apr 09 21:40:34.709312 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3264/6502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:34 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:35.725470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:35.726106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:35.733434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:35.733900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:35.734688 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:35.735133 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:35.867459 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:35.875197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-164f1f7b-012d-4709-ad33-cd4a6574e31f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.153726 Apr 09 21:40:35.875779 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3239/6503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:35 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:36.893932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:36.894646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:36.902620 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:36.903122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:36.903979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:36.904469 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:37.040343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:37.048002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51b8dba8-7af5-46a9-99fd-5a7530f8da67 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.158588 Apr 09 21:40:37.048580 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3265/6504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:36 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:38.069889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:38.070974 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:38.082597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:38.083373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:38.084690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:38.085546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:38.222859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:38.230779 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f117111b-b4e5-4557-8ba6-9708ed1af860 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.168236 Apr 09 21:40:38.231365 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3240/6505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:38 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:39.253267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:39.254229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:39.265065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:39.265517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:39.266288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:39.266718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:39.415576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:39.427510 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64c2f513-2371-4c87-a994-8838070c95dc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.180434 Apr 09 21:40:39.428220 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3266/6506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:39 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:40.451693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:40.452325 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:40.459506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:40.459973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:40.460763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:40.461247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:40.595780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:40.604156 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8475dc8-cbc3-40e8-9859-070f8dc3b19b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.159426 Apr 09 21:40:40.604745 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3241/6507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:40 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:41.624932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:41.625592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:41.632860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:41.633345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:41.634131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:41.634578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:41.767818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:41.777249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f3b53dc8-6a8c-4a5b-9520-eba0c547569c tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.158191 Apr 09 21:40:41.777803 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3267/6508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:41 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:42.798450 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:42.799171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:42.808059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:42.808633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:42.809644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:42.810203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:42.945156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:42.953254 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c734d728-d121-4d51-bd85-b3a46a7f9ca3 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.161005 Apr 09 21:40:42.953832 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3242/6509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:42 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:43.973218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:43.973856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:43.981228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:43.981676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:43.982471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:43.982881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:44.125917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:44.133836 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3ab37445-88e5-4578-8d96-f3cf5f314b18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.165401 Apr 09 21:40:44.134425 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3268/6510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:43 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:45.155124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:45.156190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:45.167864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:45.168650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:45.170036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:45.170827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:45.306797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:45.314560 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9dc09c71-f5b4-4cc3-b500-2b918ce70bda tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.165955 Apr 09 21:40:45.315155 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3243/6511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:45 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:46.340711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:46.341753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:46.353181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:46.353952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:46.355207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:46.355978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:46.488349 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:46.496247 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-72d4ce05-bab7-4a84-8649-6138d5c93443 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.162227 Apr 09 21:40:46.496863 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3269/6512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:46 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:47.517350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:47.518384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:47.530173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:47.530934 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:47.532214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:47.532950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:47.667430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:47.679085 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e2cacb34-1e2a-4bd0-a052-0f1839a66bfa tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.167999 Apr 09 21:40:47.679936 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3244/6513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:47 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:48.704553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:48.705711 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:48.718374 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:48.719067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:48.720368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:48.721064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:48.863193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:48.870804 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49117981-8687-4aa4-946d-d9d333ff2cdd tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.173539 Apr 09 21:40:48.871387 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3270/6514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:48 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:49.892227 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:49.893156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:49.900362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:49.900818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:49.901642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:49.902078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:50.032415 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:50.040299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-196dfd37-322f-40bf-b34f-78edff0c77ff tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.154638 Apr 09 21:40:50.040881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3245/6515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:49 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:51.061513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:51.062591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:51.071234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:51.071694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:51.072479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:51.072924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:51.207286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:51.215371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04274f28-0412-4683-a6fa-aba6cfbe481a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.160443 Apr 09 21:40:51.215990 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3271/6516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:51 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:52.236269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:52.237345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:52.245466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:52.245945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:52.246752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:52.247243 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:52.391270 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:52.399210 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20e92de0-04f7-4c4c-bff3-6923339227f1 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.169557 Apr 09 21:40:52.399778 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3246/6517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:52 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:53.420546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:53.421503 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:53.430578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:53.433208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:53.434008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:53.434455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:53.574756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:53.585206 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1f4d79fd-0e7f-4250-b838-d21c2ffc29ce tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.171326 Apr 09 21:40:53.585793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3272/6518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:53 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:54.606285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:54.607090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:54.617891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:54.618566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:54.619976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:54.621011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:54.754246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:54.762722 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6a217d95-4fc9-40c6-a9ba-3f4113023cdc tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.162962 Apr 09 21:40:54.763304 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3247/6519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:54 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:55.789217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:55.790237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:55.801938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:55.802501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:55.803289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:55.803728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:55.946780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:55.958441 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-232f2569-8287-4305-9df5-6606dd43b268 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.175924 Apr 09 21:40:55.959052 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3273/6520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:55 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:56.978412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:56.979070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:56.987132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:56.987621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:56.988506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:56.988995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:57.404547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:57.415776 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5947ab1e-739f-45fd-bc56-fb86165751a2 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.442026 Apr 09 21:40:57.416553 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3248/6521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:56 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:58.439953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:58.440892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:58.450249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:58.450701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:58.451476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:58.451933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:58.591797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:58.603048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4342c406-a5fc-4d45-99e0-f38d3a52733d tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.169648 Apr 09 21:40:58.603640 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3274/6522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:58 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:40:59.624369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:40:59.625404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:40:59.636808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:59.637652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:59.638976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:40:59.639737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:40:59.781904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:40:59.791562 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5f6ccea-75fe-434d-8179-d6f9fc81aceb tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1520 microversion: 2.1 time: 0.173832 Apr 09 21:40:59.792126 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3249/6523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:40:59 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:00.808686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:00.809415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:00.816124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:00.816584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:00.817355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:00.817841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:00.931597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "name": "network-vif-unplugged", "status": "completed", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:00.940534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:00.941006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:00.956052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:00.961830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] Creating event network-vif-unplugged:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch2-master-1 Apr 09 21:41:00.967748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] Instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:41:00.968664 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f84fd4d7-9385-444a-8436-9035f445945b tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1519 microversion: 2.1 time: 0.164138 Apr 09 21:41:00.969648 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3275/6524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:00 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:00.985981 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a3f59ce5-1877-4adc-b802-239d44d32fb3 req-2a7e20f9-8165-4ed2-9652-389aa5fb12bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058136 Apr 09 21:41:00.986975 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3250/6525] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:41:01.991110 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:01.991702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:01.999002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:01.999449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:02.000218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:02.000650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:02.134519 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:02.142444 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fd19dade-224e-43ea-86f2-a54e69bfe136 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1517 microversion: 2.1 time: 0.158759 Apr 09 21:41:02.143071 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3276/6526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:01 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:03.006005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:03.015229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:03.015725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:03.027388 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] Creating event network-changed:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch2-master-1 Apr 09 21:41:03.033126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] Instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:41:03.043845 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7f887cee-27a7-4898-b77c-a4de9aa19886 req-1987fcf4-7130-42d0-ae35-a00355fda402 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043370 Apr 09 21:41:03.044430 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3251/6527] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:03.161966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:03.162593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:03.169832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:03.170307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:03.171088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:03.171526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:03.439758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:03.448003 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-21099c50-7860-4629-804f-69b6c3a7dc79 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1517 microversion: 2.1 time: 0.290498 Apr 09 21:41:03.448850 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3277/6528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:03 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:04.466867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:04.467605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:04.474791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:04.475396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:04.476251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:04.476735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:04.637608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:04.655925 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7f063277-7392-4075-9a46-aa1d31e084db tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1517 microversion: 2.1 time: 0.194142 Apr 09 21:41:04.656529 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3252/6529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:04 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:05.676439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:05.677399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:05.688035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.688731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:05.689962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.690647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:05.833491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:05.841855 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce09925d-c194-49a5-bcf1-68ae563690c9 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1514 microversion: 2.1 time: 0.171661 Apr 09 21:41:05.842435 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3278/6530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:05 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:41:05.858916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:05.859458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:05.866651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.867125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:05.867930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.868390 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:05.928267 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-307f0da1-4c80-4dd8-80bb-d6c8774f5998 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "POST /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be/action" status: 204 len: 0 microversion: 2.1 time: 0.073290 Apr 09 21:41:05.928895 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3253/6531] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:41:05 2022] POST /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:41:05.937444 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:05.938056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:05.944995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.945484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:05.946270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:05.946727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:06.152197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:06.161080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2ff6aeb-fd8c-49b9-983d-b5ec283d4e92 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1514 microversion: 2.1 time: 0.227631 Apr 09 21:41:06.161717 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3279/6532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:05 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:06.729634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "name": "network-vif-plugged", "status": "completed", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:06.738083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:06.738541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:06.750766 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] Creating event network-vif-plugged:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch2-master-1 Apr 09 21:41:06.756475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] Instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:41:06.766792 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5b7cfb04-17e8-4dcd-b2a1-87ddee07a884 req-f79f9762-1c36-4693-b022-2576de43ca94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041537 Apr 09 21:41:06.767397 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3254/6533] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:41:07.178715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.179687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.186779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.187238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.188008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.188450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.323521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:07.331219 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07294e9e-bee5-4369-9579-e489313fb770 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1506 microversion: 2.1 time: 0.156551 Apr 09 21:41:07.331774 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3280/6534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:07 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:07.349027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.349697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.356056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.356519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.357330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.357782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.496835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:07.504692 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0282e621-8409-4a89-a66b-c6a123f919da tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1506 microversion: 2.1 time: 0.160920 Apr 09 21:41:07.505343 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3255/6535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:07 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:07.520857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.521523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.528185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.528676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.529506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.529957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.678718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:07.686431 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-37d3ff94-61c9-4fb1-bc61-9060204b74ef tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1506 microversion: 2.1 time: 0.169586 Apr 09 21:41:07.687019 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3281/6536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:07 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:07.702795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.703316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.709353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.709840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.710614 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.711076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.734703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:41:07.813499 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b4ed6045-a20b-4c71-9c86-6694705b894f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 204 len: 0 microversion: 2.1 time: 0.114468 Apr 09 21:41:07.814097 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3256/6537] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:41:07 2022] DELETE /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 21:41:07.830487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.830990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.837289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.837746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.838513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.839014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.862795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:41:07.908619 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.compute.api [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Instance is already in deleting state, ignoring this request Apr 09 21:41:07.909413 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-40382f1b-caa0-4112-8012-2557a987efae tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 204 len: 0 microversion: 2.1 time: 0.082882 Apr 09 21:41:07.910092 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3282/6538] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:41:07 2022] DELETE /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:41:07.918941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:07.919663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:07.926351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.926821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:07.927624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:07.928116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:08.072665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:08.080989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d85fe94-316a-40bd-9479-c5e43a57e138 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1512 microversion: 2.1 time: 0.166431 Apr 09 21:41:08.081674 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3257/6539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:07 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:09.104346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:09.105276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:09.116805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:09.118510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:09.119818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:09.120557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:09.256093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef047f7b0e534c059c06045004189775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7ac04d687340c8a08ac58bdde56a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:09.267759 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59f5ffe1-0f12-4cb9-a384-8f8da74ba885 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 200 len: 1512 microversion: 2.1 time: 0.170927 Apr 09 21:41:09.268522 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3283/6540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:09 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:09.847798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-29ef9276-40fc-41de-994d-6b3dccf8cc06 req-e5db39b8-f183-4a1c-a639-5cdc44d87767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ad809d-6d5b-4fb2-907d-f8dedea0c8be", "name": "network-vif-deleted", "tag": "8d184cc5-e0de-49f9-a35f-586f7726d525"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:09.856762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-29ef9276-40fc-41de-994d-6b3dccf8cc06 req-e5db39b8-f183-4a1c-a639-5cdc44d87767 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:09.857324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-29ef9276-40fc-41de-994d-6b3dccf8cc06 req-e5db39b8-f183-4a1c-a639-5cdc44d87767 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:09.870496 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-29ef9276-40fc-41de-994d-6b3dccf8cc06 req-e5db39b8-f183-4a1c-a639-5cdc44d87767 service nova] Creating event network-vif-deleted:8d184cc5-e0de-49f9-a35f-586f7726d525 for instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be on nch2-master-1 Apr 09 21:41:09.878956 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-29ef9276-40fc-41de-994d-6b3dccf8cc06 req-e5db39b8-f183-4a1c-a639-5cdc44d87767 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034611 Apr 09 21:41:09.879673 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3258/6541] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:10.288041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:10.288616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 65ad809d-6d5b-4fb2-907d-f8dedea0c8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:10.296163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.296621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.297433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.297881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.311252 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] HTTP exception thrown: Instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be could not be found. Apr 09 21:41:10.311818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Returning 404 to user: Instance 65ad809d-6d5b-4fb2-907d-f8dedea0c8be could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:41:10.312780 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e0af864e-9ef5-480d-82ec-1ab973675f18 tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be" status: 404 len: 111 microversion: 2.1 time: 0.029230 Apr 09 21:41:10.314029 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3284/6542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:10 2022] GET /compute/v2.1/servers/65ad809d-6d5b-4fb2-907d-f8dedea0c8be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:41:10.322702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:10.323367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:10.329669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.330140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.330933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.331385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.344460 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] HTTP exception thrown: Instance 115a92f7-9068-4a4b-9026-764d1b85da27 could not be found. Apr 09 21:41:10.345145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Returning 404 to user: Instance 115a92f7-9068-4a4b-9026-764d1b85da27 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:41:10.345961 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53029b56-1fa7-4e75-865a-be4b413f1e2f tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 404 len: 111 microversion: 2.1 time: 0.028178 Apr 09 21:41:10.346502 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3259/6543] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:41:10 2022] DELETE /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:41:10.354778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:10.355408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] [instance: 115a92f7-9068-4a4b-9026-764d1b85da27] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:10.361541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.361990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.362785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:10.363215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:10.376645 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] HTTP exception thrown: Instance 115a92f7-9068-4a4b-9026-764d1b85da27 could not be found. Apr 09 21:41:10.377266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] Returning 404 to user: Instance 115a92f7-9068-4a4b-9026-764d1b85da27 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:41:10.378093 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4e16eea-4f87-4d02-af8b-cdb50e16c14a tempest-ServerDiskConfigTestJSON-262150675 tempest-ServerDiskConfigTestJSON-262150675-project] 10.222.0.30 "GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27" status: 404 len: 111 microversion: 2.1 time: 0.027385 Apr 09 21:41:10.378636 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3285/6544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:10 2022] GET /compute/v2.1/servers/115a92f7-9068-4a4b-9026-764d1b85da27 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:41:16.741460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: .version_select at 0x7fb08da66940>, body: {"keypair": {"name": "tempest-keypair-1281286957"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:16.756251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:41:16.762637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:41:17.021841 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:41:17.026804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:41:17.041649 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b49efcc1-8200-44db-87e2-67d6eff73630 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.421053 Apr 09 21:41:17.042258 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3260/6545] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:41:16 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:18.312960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-896419828", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03b745cd-5e10-41bf-b629-61d061eff991"}], "security_groups": [{"name": "tempest-securitygroup--1323145368"}], "key_name": "tempest-keypair-1281286957", "user_data": "}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:18.426873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] validate_networks() for [('03b745cd-5e10-41bf-b629-61d061eff991', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:41:18.913133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:41:18.913656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:41:18.914273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:41:18.915067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:41:18.915596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:41:18.926474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:18.927234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:18.928106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:18.928797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:18.951861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:41:18.957622 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:41:18.970685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:41:18.973018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:41:19.021632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18f1bc88-2bb6-4145-9a7f-6fd5ae9d1087 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.712900 Apr 09 21:41:19.022885 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3286/6546] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:41:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:41:19.032888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-360a36c6-b2cd-4ace-97f4-4a74da6dbf4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:19.033557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-360a36c6-b2cd-4ace-97f4-4a74da6dbf4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:19.139831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-360a36c6-b2cd-4ace-97f4-4a74da6dbf4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:19.159441 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-360a36c6-b2cd-4ace-97f4-4a74da6dbf4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1238 microversion: 2.1 time: 0.129940 Apr 09 21:41:19.166602 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3261/6547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:19 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:20.176535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:20.178029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:20.194975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:20.196124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:20.196984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:20.197548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:20.282048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:20.289676 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-08c46411-3ea6-42a4-993e-effaae838f65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1296 microversion: 2.1 time: 0.117380 Apr 09 21:41:20.290913 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3287/6548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:20 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1296 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:41:21.309680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:21.310279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:21.318147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:21.318664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:21.319734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:21.319995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:21.531554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:21.539267 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-499125a7-340f-4c59-86c0-e136e2d34f1d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.235465 Apr 09 21:41:21.540034 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3262/6549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:21 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:21.665654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-a5202ffb-f37c-491b-b035-8b2bc8f84be9 req-19c0117c-076b-435a-8c45-028ba2cc0271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:21.679894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a5202ffb-f37c-491b-b035-8b2bc8f84be9 req-19c0117c-076b-435a-8c45-028ba2cc0271 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:21.680366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-a5202ffb-f37c-491b-b035-8b2bc8f84be9 req-19c0117c-076b-435a-8c45-028ba2cc0271 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:21.694140 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-a5202ffb-f37c-491b-b035-8b2bc8f84be9 req-19c0117c-076b-435a-8c45-028ba2cc0271 service nova] Creating event network-changed:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch1-master-1 Apr 09 21:41:21.700311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-a5202ffb-f37c-491b-b035-8b2bc8f84be9 req-19c0117c-076b-435a-8c45-028ba2cc0271 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040754 Apr 09 21:41:21.701390 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3288/6550] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:22.560076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:22.560829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:22.569266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:22.569828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:22.571135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:22.571666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:22.715164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:22.723035 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d082cf4-4e8c-4370-b8ea-095ccc59268b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.169239 Apr 09 21:41:22.723618 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3263/6551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:22 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:23.745126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:23.746358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:23.757729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:23.758476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:23.759786 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:23.760476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:23.897576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:23.905481 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f8060264-5799-43bc-b4b7-fc602d3b6162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.167988 Apr 09 21:41:23.906061 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3289/6552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:23 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:24.923210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:24.923811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:24.930993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:24.931487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:24.932324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:24.932800 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:25.067340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:25.075390 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5e09bde7-a7b3-409c-adc5-84f084c722e7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.156727 Apr 09 21:41:25.081088 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3264/6553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:24 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:26.092043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:26.092666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:26.100058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:26.100523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:26.101421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:26.101859 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:26.237416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:26.245723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da62dcc7-210c-455d-ab4f-63232e7defb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.157678 Apr 09 21:41:26.246277 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3290/6554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:26 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:27.209646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2cb7d0d1-df91-42b6-b157-c2a0bf9f8647 req-94ddceb3-9e65-42f1-b5cb-9c9ee0124d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "name": "network-vif-plugged", "status": "completed", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:27.219446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2cb7d0d1-df91-42b6-b157-c2a0bf9f8647 req-94ddceb3-9e65-42f1-b5cb-9c9ee0124d5f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:27.220012 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2cb7d0d1-df91-42b6-b157-c2a0bf9f8647 req-94ddceb3-9e65-42f1-b5cb-9c9ee0124d5f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:27.232580 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2cb7d0d1-df91-42b6-b157-c2a0bf9f8647 req-94ddceb3-9e65-42f1-b5cb-9c9ee0124d5f service nova] Creating event network-vif-plugged:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch1-master-1 Apr 09 21:41:27.237703 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2cb7d0d1-df91-42b6-b157-c2a0bf9f8647 req-94ddceb3-9e65-42f1-b5cb-9c9ee0124d5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Apr 09 21:41:27.238485 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3265/6555] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:27.262875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:27.263858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:27.271483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:27.271962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:27.272802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:27.273551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:27.445523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:27.454198 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f633ebd-6ebf-4210-a445-523896fed3a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.195325 Apr 09 21:41:27.454915 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3291/6556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:27 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:28.477612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:28.478731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:28.486627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:28.487077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:28.487896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:28.488345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:28.629123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:28.637295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-28243b10-4370-40d7-8cdd-d7fd233824da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1364 microversion: 2.1 time: 0.169388 Apr 09 21:41:28.637872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3266/6557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:28 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:29.655578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:29.656209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:29.664500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:29.665051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:29.665971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:29.666484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:29.797798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:29.807841 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78941f50-67f9-4657-93b0-435cfcbc7ed8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1552 microversion: 2.1 time: 0.156588 Apr 09 21:41:29.808767 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3292/6558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:29 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:29.827781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:29.828301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:29.835477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:29.835933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:29.836714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:29.837198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:29.926203 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d5adc351-f11c-4390-ab5d-66af67e97ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104408 Apr 09 21:41:29.927124 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3267/6559] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:41:29 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:31.216425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8684e6be-5287-459f-a102-e60560d94800 req-33818803-9365-4455-959e-a230133c4649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:31.218743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:31.219424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:31.226450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:31.226906 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:31.227712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:31.228145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:31.230120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8684e6be-5287-459f-a102-e60560d94800 req-33818803-9365-4455-959e-a230133c4649 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:31.230707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8684e6be-5287-459f-a102-e60560d94800 req-33818803-9365-4455-959e-a230133c4649 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:31.242031 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8684e6be-5287-459f-a102-e60560d94800 req-33818803-9365-4455-959e-a230133c4649 service nova] Creating event network-changed:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch1-master-1 Apr 09 21:41:31.247229 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8684e6be-5287-459f-a102-e60560d94800 req-33818803-9365-4455-959e-a230133c4649 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Apr 09 21:41:31.248042 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3268/6560] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:41:31.447541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:31.456874 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d3dee5df-f906-421a-a492-a8cfba89397a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1552 microversion: 2.1 time: 0.249512 Apr 09 21:41:31.457604 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3293/6561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:31 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:31.473859 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:31.474576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:31.481134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:31.481871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:31.482864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:31.483543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:31.672460 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:31.680968 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0e34ecac-4620-402c-98c7-1c31f62cffff tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1552 microversion: 2.1 time: 0.211240 Apr 09 21:41:31.682057 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3269/6562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:31 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:41:32.703028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:32.703710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:32.711612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:32.712117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:32.712965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:32.713482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:32.856857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:32.864870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e29a4dc5-aff3-488e-bc7d-9a29740b2b16 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1671 microversion: 2.1 time: 0.168623 Apr 09 21:41:32.865835 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3294/6563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:32 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:32.883662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:32.884319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:32.892482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:32.892948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:32.893758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:32.894203 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:33.030397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:33.037902 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-94715b82-81c8-4ce1-8845-27116b97b9f3 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1671 microversion: 2.1 time: 0.160685 Apr 09 21:41:33.038714 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3270/6564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:32 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:33.054334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:41:33.055429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:33.062125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:33.062590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:33.063369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:33.063812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:33.091169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:33.097093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Old instance type m1.heat2, new instance type m1.heat {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:41:33.106140 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:41:33.106656 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:41:33.107370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:41:33.107889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:41:33.108505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:41:33.188858 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12ea6fad-6314-481f-a96a-ed88646ee7e8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/action" status: 202 len: 0 microversion: 2.1 time: 0.138436 Apr 09 21:41:33.189475 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3295/6565] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:41:33 2022] POST /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:41:33.198108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:33.198733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:33.204943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:33.205520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:33.206307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:33.206752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:33.342197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:33.350116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-850c48f4-ebd2-43c0-a4b2-2c4ef60a7cbc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1680 microversion: 2.1 time: 0.156259 Apr 09 21:41:33.350695 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3271/6566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:33 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:34.373767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:34.374703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:34.384938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:34.385748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:34.387083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:34.388038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:34.579067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:34.587052 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e32243a4-8014-4035-8c67-88d42993d493 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1680 microversion: 2.1 time: 0.221739 Apr 09 21:41:34.587644 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3296/6567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:34 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:35.604944 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:35.605637 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:35.613431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:35.613929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:35.614715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:35.615171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:35.753906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:35.764960 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3edcb45b-7177-4922-8640-02d1ff1e9049 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.163925 Apr 09 21:41:35.765882 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3272/6568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:35 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:36.786960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:36.787961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:36.798840 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:36.799585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:36.800839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:36.801607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:36.940901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:36.949306 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eaac7788-add0-4e26-a2b3-4843494c7a19 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.168948 Apr 09 21:41:36.949885 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3297/6569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:36 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:37.970689 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:37.971820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:37.983426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:37.984199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:37.985563 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:37.986326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:38.119814 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:38.127549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0eca397c-47ff-4c3a-bd0e-ad22f0f49a2c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.163565 Apr 09 21:41:38.128129 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3273/6570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:37 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:39.148795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:39.149794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:39.160531 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:39.160975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:39.161778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:39.162206 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:39.299137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:39.306982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-268832a1-c918-4085-8ac6-a91dcec0ff7a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.164693 Apr 09 21:41:39.307605 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3298/6571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:39 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:40.328829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:40.329933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:40.337818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:40.338280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:40.339084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:40.339554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:40.474604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:40.482284 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-95ddd3cf-d703-4ff7-911c-ee52afe1f84b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.160438 Apr 09 21:41:40.482856 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3274/6572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:40 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:41.503614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:41.504609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:41.516677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:41.517483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:41.518755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:41.519484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:41.671133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:41.679171 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-142aed73-e0fc-4662-8c81-603b266e0631 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.182182 Apr 09 21:41:41.679749 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3299/6573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:41 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:42.701101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:42.702112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:42.713910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:42.714682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:42.715988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:42.716732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:42.856418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:42.868018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-aaec6c0f-e182-4fc2-b5cf-a371039f0a90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.173681 Apr 09 21:41:42.868847 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3275/6574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:42 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:43.889754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:43.890817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:43.899884 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:43.900333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:43.901130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:43.901569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:44.039156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:44.050525 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12d17a57-5a89-483f-bde8-6de4ee2e6a41 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.167147 Apr 09 21:41:44.051433 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3300/6575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:43 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:45.074845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:45.075468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:45.082908 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:45.083384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:45.084298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:45.084820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:45.219189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:45.227052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c26e10e0-888e-43e0-95eb-eb11c154a7f9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.156730 Apr 09 21:41:45.227627 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3276/6576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:45 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:46.248275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:46.249365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:46.259575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:46.260021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:46.260787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:46.261336 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:46.394460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:46.403190 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae756cb3-832d-4199-8200-1cc42e2edf68 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.161420 Apr 09 21:41:46.403826 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3301/6577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:46 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:47.424828 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:47.425954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:47.434360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:47.434817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:47.435604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:47.436048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:47.567789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:47.576477 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-64523760-4ad9-42fc-8728-d863b8e5ef33 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.158242 Apr 09 21:41:47.577080 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3277/6578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:47 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:48.597909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:48.598953 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:48.610477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:48.611231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:48.612493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:48.613246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:48.754495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:48.766681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-39dc39a7-b90e-46ce-a80c-ee3cb6bb7f12 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.175107 Apr 09 21:41:48.767480 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3302/6579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:48 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:49.788366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:49.789027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:49.796619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:49.797150 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:49.797985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:49.798458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:49.940370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:49.948371 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-12db9115-5a7b-4fc6-8b72-fb23bd9b28fe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.165191 Apr 09 21:41:49.948966 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3278/6580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:49 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:50.966097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:50.966702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:50.973965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:50.974415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:50.975199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:50.975609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:51.106990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:51.114742 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ae902cb4-793b-4301-8bd5-db6084dc22a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.152572 Apr 09 21:41:51.115320 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3303/6581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:50 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:52.136055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:52.136765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:52.146670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:52.147295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:52.148313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:52.148872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:52.284805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:52.292900 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c1da57ae-aa94-49bc-b7f9-ba3929640422 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.163666 Apr 09 21:41:52.293525 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3279/6582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:52 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:53.311265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:53.311917 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:53.319563 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:53.320059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:53.320905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:53.321438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:53.462169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:53.473719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e7731bd7-c9a7-4207-85aa-9cd01c9f117f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.166626 Apr 09 21:41:53.474439 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3304/6583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:53 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:54.491790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:54.492382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:54.499306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:54.499770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:54.500562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:54.501018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:54.636091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:54.646924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-42d04e55-e86e-4e42-89aa-b4a4436de469 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.159358 Apr 09 21:41:54.647708 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3280/6584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:54 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:55.664372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:55.664973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:55.672258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:55.672703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:55.673501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:55.673932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:55.813011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:55.820829 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-caee5e1b-452b-4927-9498-c20214eddb22 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.160477 Apr 09 21:41:55.821446 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3305/6585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:55 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:56.842801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:56.843769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:56.855173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:56.855972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:56.857303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:56.858066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:57.001654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:57.009660 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-59cf3a8a-1154-4bc9-9123-857453cd5326 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.173925 Apr 09 21:41:57.010245 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3281/6586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:56 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:58.031109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:58.031960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:58.043198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:58.043683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:58.044441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:58.044893 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:58.179821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:58.187868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2393fec5-9c30-4680-809f-68cc4b7434ca tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.163447 Apr 09 21:41:58.188457 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3306/6587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:58 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:41:59.208300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:41:59.208914 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:41:59.216279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:59.216753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:59.217591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:41:59.218047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:41:59.361649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:41:59.369529 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-96b77c34-7e94-4d33-a650-b65645f3477e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.165340 Apr 09 21:41:59.370162 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3282/6588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:41:59 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:00.388228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:00.388878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:00.396145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:00.396607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:00.397417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:00.397857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:00.535159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:00.546511 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e555fcee-f5ba-4ff5-a229-b7b10a615e49 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.162266 Apr 09 21:42:00.547317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3307/6589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:00 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:01.568326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:01.569419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:01.581349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:01.582141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:01.583434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:01.584214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:01.721341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:01.729450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5dcdd7b-6a2a-42fc-925e-59bf4408b987 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.167936 Apr 09 21:42:01.730112 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3283/6590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:01 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:02.749897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:02.750625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:02.759111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:02.759669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:02.760621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:02.761269 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:02.901298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:02.909399 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f8302c91-fe42-4cde-90ed-caf889ad49c6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.165164 Apr 09 21:42:02.909995 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3308/6591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:02 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:03.931596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:03.932653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:03.943451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:03.944223 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:03.945571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:03.946362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:04.086354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:04.094370 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-884a72ce-6200-4400-bc8b-a1a0331a4767 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.169885 Apr 09 21:42:04.094954 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3284/6592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:03 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:05.111445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:05.112054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:05.119080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:05.119587 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:05.120376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:05.120802 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:05.255054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:05.264292 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8101e76-6081-4476-b7f0-6d1f7d508e43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.156582 Apr 09 21:42:05.265054 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3309/6593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:05 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:06.291384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:06.292345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:06.300498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:06.300960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:06.301811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:06.302286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:06.438771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:06.447409 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9ea88d87-ac40-49d1-8577-89b196500856 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.162794 Apr 09 21:42:06.448008 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3285/6594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:06 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:07.469184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:07.469777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:07.477074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:07.477539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:07.478325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:07.478765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:07.940973 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:07.952267 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f8bd1514-f29d-4514-bb02-6bef6470fe07 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1685 microversion: 2.1 time: 0.489274 Apr 09 21:42:07.952882 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3310/6595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:07 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1685 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:08.592261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "name": "network-vif-unplugged", "status": "completed", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:08.603242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:08.603754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:08.616163 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] Creating event network-vif-unplugged:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch2-master-1 Apr 09 21:42:08.622382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] Instance 079d8390-daf2-43df-9100-0ae251499630 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:42:08.636117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f18915b2-de44-4a83-849b-8232ab1aa5af req-d45134b6-a469-4fae-b272-c3c10917791f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048249 Apr 09 21:42:08.636747 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3286/6596] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:08.970345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:08.970931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:08.978065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:08.978600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:08.979416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:08.979852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:09.143509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:09.152239 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-703aa400-a13a-4c7c-afaf-9c03bf209813 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1684 microversion: 2.1 time: 0.186020 Apr 09 21:42:09.156461 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3311/6597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:08 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:10.171274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:10.171955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:10.178747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:10.179205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:10.179980 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:10.180431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:10.311543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:10.319639 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0bf20fd-4eec-457b-9828-110b8953722c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1682 microversion: 2.1 time: 0.153675 Apr 09 21:42:10.320215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3287/6598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:10 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:10.658876 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:10.672927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:10.673413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:10.685153 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] Creating event network-changed:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch2-master-1 Apr 09 21:42:10.690611 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] Instance 079d8390-daf2-43df-9100-0ae251499630 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:42:10.702109 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3d9a7493-2ab0-42f6-b2a1-106d0b817884 req-dd01bb21-1927-4ceb-849e-49a420962d48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049728 Apr 09 21:42:10.702703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3312/6599] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:11.342042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:11.342930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:11.354573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:11.355540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:11.356830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:11.357612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:11.489882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:11.497768 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a36cd4f9-280d-4d17-860b-b5ec7c25fda0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1682 microversion: 2.1 time: 0.162757 Apr 09 21:42:11.498351 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3288/6600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:11 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:12.520287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:12.521464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:12.532822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:12.533777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:12.535041 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:12.535765 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:12.680931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:12.688978 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b87fcc4-3503-471b-97c4-01b3a3aff7e5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1682 microversion: 2.1 time: 0.176123 Apr 09 21:42:12.689815 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3313/6601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:12 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:13.706971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:13.708315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:13.715508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.715975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:13.716774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.717276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:13.847300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:13.854769 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-235dc0ad-84f5-410d-97ec-b0f23ac32e39 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1679 microversion: 2.1 time: 0.151972 Apr 09 21:42:13.855319 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3289/6602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:13 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:13.871392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:13.871911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:13.879200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.879646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:13.880411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.880842 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:13.955354 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83f7c010-9eb1-48e2-827c-3367e027e4d0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/action" status: 204 len: 0 microversion: 2.1 time: 0.087642 Apr 09 21:42:13.956000 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3314/6603] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:42:13 2022] POST /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:42:13.965004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:13.966109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:13.973198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.973636 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:13.974597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:13.975104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:14.183845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:14.191646 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9b9889e9-9ce8-4626-ae4d-c2ed15d249e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1679 microversion: 2.1 time: 0.230957 Apr 09 21:42:14.192252 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3290/6604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:13 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:15.148122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0235a69f-fcbf-4fd5-8537-f5594c50566b req-14cb436f-8465-46ec-b966-37a35fba5bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "name": "network-vif-plugged", "status": "completed", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:15.157352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0235a69f-fcbf-4fd5-8537-f5594c50566b req-14cb436f-8465-46ec-b966-37a35fba5bc0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.157916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0235a69f-fcbf-4fd5-8537-f5594c50566b req-14cb436f-8465-46ec-b966-37a35fba5bc0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.170785 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0235a69f-fcbf-4fd5-8537-f5594c50566b req-14cb436f-8465-46ec-b966-37a35fba5bc0 service nova] Creating event network-vif-plugged:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch2-master-1 Apr 09 21:42:15.176840 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0235a69f-fcbf-4fd5-8537-f5594c50566b req-14cb436f-8465-46ec-b966-37a35fba5bc0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Apr 09 21:42:15.177715 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3315/6605] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:15.209728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:15.210359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:15.218171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.218732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.220373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.220857 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.361495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:15.372716 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5a1f8ac7-0db1-4bdf-a1dd-3c9df93b71ad tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1671 microversion: 2.1 time: 0.167038 Apr 09 21:42:15.373578 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3291/6606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:15 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:15.391337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:15.392162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:15.398604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.399059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.399827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.400264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.534500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:15.545823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8adbf43-b037-4b1e-b454-05b6ac1a00e1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1671 microversion: 2.1 time: 0.158661 Apr 09 21:42:15.546664 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3316/6607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:15 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:15.562493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:15.563310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:15.569435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.569896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.570673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.571115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.708970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:15.716593 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-16080d96-923c-4057-ba6b-b252b4013adb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1671 microversion: 2.1 time: 0.158272 Apr 09 21:42:15.717454 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3292/6608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:15 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:15.734764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:15.735183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:15.741380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.741833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.742640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.743062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.767532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:42:15.848950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4ceed29-f06b-484a-8d8b-b858ff313657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 204 len: 0 microversion: 2.1 time: 0.117888 Apr 09 21:42:15.849778 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3317/6609] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:42:15 2022] DELETE /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:42:15.858501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:15.859131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:15.865497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.865963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:15.866942 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:15.867396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:16.004713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:16.012824 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-057a5305-0193-4919-b066-3bfa46e2b5ae tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1677 microversion: 2.1 time: 0.158427 Apr 09 21:42:16.013448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3293/6610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:15 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:17.035078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:17.036377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:17.047668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:17.048461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:17.049746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:17.050208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:17.189921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:17.197564 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89f7ea48-eec8-49d4-867a-423e5a8b69af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1677 microversion: 2.1 time: 0.169658 Apr 09 21:42:17.198110 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3318/6611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:17 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:18.217062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:18.217746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:18.225271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:18.225737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:18.226553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:18.227010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:18.292016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:18.300788 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f070d2f1-5a76-4c4d-9a67-5edc7597ad61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 200 len: 1609 microversion: 2.1 time: 0.088204 Apr 09 21:42:18.301631 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3294/6612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:18 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 1609 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:18.482237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-ff002642-cc87-4413-ae7e-f6cd34aa6b64 req-30a6f967-edfc-4911-bc57-395200089385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079d8390-daf2-43df-9100-0ae251499630", "name": "network-vif-deleted", "tag": "52bdfacd-7192-4691-89c6-e2afd287ee88"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:18.492065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff002642-cc87-4413-ae7e-f6cd34aa6b64 req-30a6f967-edfc-4911-bc57-395200089385 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:18.492524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-ff002642-cc87-4413-ae7e-f6cd34aa6b64 req-30a6f967-edfc-4911-bc57-395200089385 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:18.514245 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-ff002642-cc87-4413-ae7e-f6cd34aa6b64 req-30a6f967-edfc-4911-bc57-395200089385 service nova] Creating event network-vif-deleted:52bdfacd-7192-4691-89c6-e2afd287ee88 for instance 079d8390-daf2-43df-9100-0ae251499630 on nch2-master-1 Apr 09 21:42:18.519172 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-ff002642-cc87-4413-ae7e-f6cd34aa6b64 req-30a6f967-edfc-4911-bc57-395200089385 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040661 Apr 09 21:42:18.519784 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3319/6613] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:19.319752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:19.320610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:19.328146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.328608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.329448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.329896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.344835 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. Apr 09 21:42:19.345524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:42:19.346358 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b53b6299-bbb5-43da-8ff7-2ff6b70f03b5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 404 len: 111 microversion: 2.1 time: 0.032074 Apr 09 21:42:19.347486 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3295/6614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:19 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:42:19.367709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:19.368408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:19.375148 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.375608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.376458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.376897 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.390875 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. Apr 09 21:42:19.391493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:42:19.392336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-11d07469-58af-45a4-804a-629ed6cffdf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 404 len: 111 microversion: 2.1 time: 0.029697 Apr 09 21:42:19.392928 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3320/6615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:19 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:42:19.440182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-453444893", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "03b745cd-5e10-41bf-b629-61d061eff991"}], "security_groups": [{"name": "tempest-securitygroup--1323145368"}], "key_name": "tempest-keypair-1281286957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:19.546618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] validate_networks() for [('03b745cd-5e10-41bf-b629-61d061eff991', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:42:19.934228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:42:19.934664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:42:19.935149 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:42:19.935577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:42:19.936051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:42:19.945683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.946200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.947048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:19.947498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:19.965461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:42:19.971341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:42:19.985481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:42:19.987895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:42:20.035465 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad052a9a-ad8b-43d1-afff-aac64b8a5969 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.599458 Apr 09 21:42:20.036116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3296/6616] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:42:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 21:42:20.046652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ffe8d12-e19f-4933-b575-13d57ab03852 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:20.047257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ffe8d12-e19f-4933-b575-13d57ab03852 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:20.102908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7ffe8d12-e19f-4933-b575-13d57ab03852 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:20.109698 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ffe8d12-e19f-4933-b575-13d57ab03852 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1238 microversion: 2.1 time: 0.066996 Apr 09 21:42:20.110354 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3321/6617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:20 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:21.130623 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:21.131440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:21.138937 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:21.139404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:21.140207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:21.140652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:21.235677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:21.243689 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-81672cb2-8f53-4253-b094-8c882ff3c01f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1296 microversion: 2.1 time: 0.120044 Apr 09 21:42:21.244281 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3297/6618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:21 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:22.261645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:22.262924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:22.270778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:22.271238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:22.272038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:22.272481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:22.477807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:22.486497 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a78b3d3b-2d74-4793-bdf0-8a71a294c0c5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.228549 Apr 09 21:42:22.487990 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3322/6619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:22 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:22.502904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-056ad9fb-d3b0-4f31-954b-74a1eadaad45 req-486abffe-03f6-4898-b124-05e249a1bfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:22.525927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-056ad9fb-d3b0-4f31-954b-74a1eadaad45 req-486abffe-03f6-4898-b124-05e249a1bfe1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:22.526479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-056ad9fb-d3b0-4f31-954b-74a1eadaad45 req-486abffe-03f6-4898-b124-05e249a1bfe1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:22.540235 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-056ad9fb-d3b0-4f31-954b-74a1eadaad45 req-486abffe-03f6-4898-b124-05e249a1bfe1 service nova] Creating event network-changed:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch1-master-1 Apr 09 21:42:22.546754 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-056ad9fb-d3b0-4f31-954b-74a1eadaad45 req-486abffe-03f6-4898-b124-05e249a1bfe1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047943 Apr 09 21:42:22.547685 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3298/6620] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:23.504363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:23.504978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:23.512191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:23.512640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:23.513441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:23.513873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:23.644136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:23.651794 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-875d61cc-acd7-4a24-bb87-d2e216978bb2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.151481 Apr 09 21:42:23.652373 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3323/6621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:23 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:24.673029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:24.673998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:24.681237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:24.681704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:24.682490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:24.682941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:24.818220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:24.826519 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3950860c-ff2b-4c7c-9920-8446424af3bc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.160132 Apr 09 21:42:24.827115 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3299/6622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:24 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:25.844142 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:25.844732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:25.852010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:25.852461 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:25.853276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:25.853692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:25.987545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:25.995178 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b84b0595-b7c9-4b94-822f-96953d2043af tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.155020 Apr 09 21:42:25.995752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3324/6623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:25 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:27.016680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:27.017745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:27.029568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:27.030346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:27.031679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:27.032427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:27.171119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:27.178866 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ea1de163-ff2d-449a-a4a6-9d54b0c10cf4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.168841 Apr 09 21:42:27.179450 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3300/6624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:27 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:27.483585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7a43efa1-eed1-4802-bfc8-e070f038c228 req-c9cbfd3a-acde-40b1-b00c-db88f01d0c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "name": "network-vif-plugged", "status": "completed", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:27.492813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7a43efa1-eed1-4802-bfc8-e070f038c228 req-c9cbfd3a-acde-40b1-b00c-db88f01d0c95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:27.493347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7a43efa1-eed1-4802-bfc8-e070f038c228 req-c9cbfd3a-acde-40b1-b00c-db88f01d0c95 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:27.504852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7a43efa1-eed1-4802-bfc8-e070f038c228 req-c9cbfd3a-acde-40b1-b00c-db88f01d0c95 service nova] Creating event network-vif-plugged:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch1-master-1 Apr 09 21:42:27.510069 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7a43efa1-eed1-4802-bfc8-e070f038c228 req-c9cbfd3a-acde-40b1-b00c-db88f01d0c95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Apr 09 21:42:27.510984 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3325/6625] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:28.201480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:28.202509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:28.212144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:28.212609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:28.213512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:28.213964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:28.351995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:28.359912 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-78031786-4ab5-474a-b39f-5a6183c110fd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1364 microversion: 2.1 time: 0.166049 Apr 09 21:42:28.360492 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3301/6626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:28 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:29.379097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:29.379804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:29.386702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:29.387154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:29.387932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:29.388373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:29.532604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:29.541378 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0833c3c6-31d9-498b-a3fe-c79d2d63656b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1552 microversion: 2.1 time: 0.167152 Apr 09 21:42:29.541980 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3326/6627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:29 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:29.565134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:29.565711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:29.574031 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:29.574522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:29.575324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:29.575774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:29.656049 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36b7cb05-694d-44a2-a1a6-ee4c59831634 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097406 Apr 09 21:42:29.656673 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3302/6628] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:42:29 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:42:30.976095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-81c52d18-9c85-4e03-a4a7-7c20cd26c941 req-86a5a912-a153-4503-b971-b756fb2caa11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:30.981617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-79f0e062-1d0d-4279-9be4-6ccbc8de259d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:30.985657 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-81c52d18-9c85-4e03-a4a7-7c20cd26c941 req-86a5a912-a153-4503-b971-b756fb2caa11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:30.986389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-81c52d18-9c85-4e03-a4a7-7c20cd26c941 req-86a5a912-a153-4503-b971-b756fb2caa11 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:30.988446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f0e062-1d0d-4279-9be4-6ccbc8de259d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:30.988895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-79f0e062-1d0d-4279-9be4-6ccbc8de259d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:30.998507 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-81c52d18-9c85-4e03-a4a7-7c20cd26c941 req-86a5a912-a153-4503-b971-b756fb2caa11 service nova] Creating event network-changed:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch1-master-1 Apr 09 21:42:31.004158 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-81c52d18-9c85-4e03-a4a7-7c20cd26c941 req-86a5a912-a153-4503-b971-b756fb2caa11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Apr 09 21:42:31.005064 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3303/6629] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:42:31.018663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-79f0e062-1d0d-4279-9be4-6ccbc8de259d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Going to try to stop instance {{(pid=141818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:42:31.065767 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-79f0e062-1d0d-4279-9be4-6ccbc8de259d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action" status: 202 len: 0 microversion: 2.1 time: 0.097149 Apr 09 21:42:31.066671 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3327/6630] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:42:30 2022] POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:42:31.084373 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:31.085276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:31.093408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:31.093868 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:31.094668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:31.095119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:31.323494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:31.332368 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d72b5e2b-ae01-4915-8beb-e1246a760fa2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1562 microversion: 2.1 time: 0.252323 Apr 09 21:42:31.333068 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3304/6631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:31 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:32.351726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:32.352472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:32.359313 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:32.359779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:32.360561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:32.361024 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:32.496986 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:32.504926 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2e270aa6-0493-4001-b57f-4f79b0b88413 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.158535 Apr 09 21:42:32.505547 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3328/6632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:32 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:33.526062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:33.526685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:33.533658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:33.534119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:33.534881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:33.535359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:33.677616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:33.686457 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-544c2b49-bff8-475d-8901-e67623ed30ac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.166496 Apr 09 21:42:33.687039 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3305/6633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:33 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:34.711333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:34.712348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:34.723886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:34.724649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:34.726056 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:34.726803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:34.854801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:34.863082 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aecfd206-0596-4539-ae7d-a852dbfc5f11 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.158521 Apr 09 21:42:34.863638 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3329/6634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:34 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:35.886219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:35.887361 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:35.894924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:35.895441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:35.896266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:35.896733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:36.044258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:36.052161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a1d8380e-d5b6-4f2b-b032-ec8045d18feb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.173151 Apr 09 21:42:36.052741 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3306/6635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:35 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:37.072787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:37.073782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:37.085826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:37.086579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:37.087853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:37.088579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:37.231051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:37.242684 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6b855511-8b98-4bd3-87cb-7df94bb53c18 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.176168 Apr 09 21:42:37.243481 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3330/6636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:37 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:38.264090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:38.265622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:38.274028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:38.274540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:38.275408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:38.275897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:38.415105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:38.423626 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dc7859e-3217-4730-b1a8-f4729f358ada tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.166024 Apr 09 21:42:38.424584 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3307/6637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:38 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:39.446164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:39.446815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:39.458841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:39.459592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:39.460877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:39.461660 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:39.597555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:39.605520 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3129533e-dbb5-4051-975c-6f5c69bc87d2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.166677 Apr 09 21:42:39.606102 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3331/6638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:39 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:40.625821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:40.626419 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:40.634092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:40.634562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:40.635350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:40.635793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:40.774843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:40.782964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a8e648f1-8f57-429b-ac3b-ade1a7e52145 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.162619 Apr 09 21:42:40.783551 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3308/6639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:40 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:41.800849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:41.801776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:41.808974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:41.809463 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:41.810231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:41.810659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:41.947695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:41.956004 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-034d160d-58a5-4b93-ab80-4a959cc37843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.159052 Apr 09 21:42:41.956612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3332/6640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:41 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:42.977074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:42.978050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:42.989443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:42.990208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:42.991500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:42.992281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:43.140185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:43.148612 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-841a20af-31b3-4491-b79b-ff825d114346 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.178344 Apr 09 21:42:43.149238 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3309/6641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:42 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:44.171151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:44.171763 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:44.178956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:44.179414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:44.180212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:44.180633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:44.314499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:44.322529 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-05b09642-98d2-4bab-9175-715d05aca178 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.158447 Apr 09 21:42:44.323084 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3333/6642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:44 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:45.344823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:45.345622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:45.354608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:45.355187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:45.356171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:45.356731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:45.493612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:45.501676 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0735a03f-3f3f-410a-b8e1-233327f2d4a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.163594 Apr 09 21:42:45.502263 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3310/6643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:45 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:46.521329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:46.522085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:46.530368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:46.530896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:46.531793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:46.532300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:46.671050 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:46.679125 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c651833-aab9-49a1-971b-e608ee089f5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.163316 Apr 09 21:42:46.679715 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3334/6644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:46 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:47.700725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:47.701798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:47.710593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:47.711059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:47.711839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:47.712289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:47.840589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:47.848947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8447df5-d3b5-4a3d-b6db-b134e0587333 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.154881 Apr 09 21:42:47.849601 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3311/6645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:47 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:48.871729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:48.872666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:48.880869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:48.881341 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:48.882111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:48.882546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:49.022267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:49.034031 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49604789-4c44-4da2-b8e0-2f1a726cc7b4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.171227 Apr 09 21:42:49.034647 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3335/6646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:48 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:50.052187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:50.052881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:50.060104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:50.060573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:50.061403 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:50.061855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:50.200183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:50.208534 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b8d21068-c0dc-4d26-abc1-4f042b1c4743 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.160950 Apr 09 21:42:50.209359 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3312/6647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:50 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:51.226202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:51.226816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:51.233696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:51.234143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:51.234900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:51.235338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:51.371689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:51.380237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f9545561-56cf-4b87-958a-a91a68f6acdf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.157919 Apr 09 21:42:51.380821 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3336/6648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:51 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:52.399502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:52.400199 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:52.408288 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:52.408840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:52.409796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:52.410298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:52.549497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:52.557061 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6066af8d-dae5-4b4a-ad90-38e820ea8d90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.162060 Apr 09 21:42:52.557640 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3313/6649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:52 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:53.579470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:53.580517 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:53.591699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:53.592442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:53.593751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:53.594471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:53.736178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:53.744062 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95e981da-bc34-4ffe-8f92-45f631c5e21c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.172096 Apr 09 21:42:53.744657 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3337/6650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:53 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:54.769735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:54.770720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:54.782212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:54.782990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:54.784294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:54.785114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:54.923684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:54.931893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2745307a-d23a-490f-8948-d27e72431aa6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.168889 Apr 09 21:42:54.932517 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3314/6651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:54 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:55.953642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:55.954697 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:55.966404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:55.967151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:55.968430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:55.969200 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:56.103644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:56.111570 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1c21cfe3-4877-4cf4-8591-84af5b532657 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.164908 Apr 09 21:42:56.112157 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3338/6652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:55 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:57.129952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:57.130655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:57.137274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.137742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.138534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.138985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.277823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:57.286117 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7337c464-a2a4-4d7a-a88e-205f1649d5dc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1658 microversion: 2.1 time: 0.161837 Apr 09 21:42:57.286673 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3315/6653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:57 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1658 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:57.303767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:42:57.304718 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:57.311814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.312268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.313072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.313532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.620864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:57.627108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Old instance type m1.heat2, new instance type m1.heat {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:42:57.634185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:42:57.634584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:42:57.635065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:42:57.635476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:42:57.635885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:42:57.700112 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-46270814-6882-4ddd-a5e5-d3f8b89044d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action" status: 202 len: 0 microversion: 2.1 time: 0.401279 Apr 09 21:42:57.700790 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3339/6654] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:42:57 2022] POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:42:57.709705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:57.710400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:57.716824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.717377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.718201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:57.718645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:57.853686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:57.861666 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-972b1c6c-1b69-4163-8126-bda9647a20cf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.155995 Apr 09 21:42:57.862242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3316/6655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:57 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:42:58.880652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:42:58.881325 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:42:58.888371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:58.888818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:58.889609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:42:58.890057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:42:59.033735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:42:59.042027 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc377edf-64f9-4c7f-9848-b6a91ccfed5c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1681 microversion: 2.1 time: 0.166339 Apr 09 21:42:59.042586 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3340/6656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:42:58 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:00.064159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:00.065139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:00.076709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:00.077698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:00.079386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:00.080247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:00.218865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:00.226600 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f2669a95-5af4-493a-956f-11fe49ecc24b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1686 microversion: 2.1 time: 0.169430 Apr 09 21:43:00.227187 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3317/6657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:00 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:01.248467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:01.249617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:01.259432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:01.259899 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:01.260699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:01.261194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:01.410011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:01.418100 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fa10a4ca-e31b-4752-9be2-3e65fc5a8847 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1686 microversion: 2.1 time: 0.176300 Apr 09 21:43:01.418735 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3341/6658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:01 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:01.902776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "name": "network-vif-unplugged", "status": "completed", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:01.913104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:01.913625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:01.925402 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] Creating event network-vif-unplugged:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch2-master-1 Apr 09 21:43:01.931056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:43:01.942083 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9bcd426d-dbc4-4e40-8b06-016fb8296e10 req-3cd8f667-3bec-401b-849d-55832b674387 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043106 Apr 09 21:43:01.942862 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3318/6659] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:43:02.435676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:02.436299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:02.444977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:02.445540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:02.446409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:02.447053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:02.586948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:02.595333 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-24c1dff7-1645-4968-948d-f163075ac2aa tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1685 microversion: 2.1 time: 0.163345 Apr 09 21:43:02.600994 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3342/6660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:02 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:03.619261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:03.620443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:03.631271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:03.632124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:03.632922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:03.633416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:03.776551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:03.785474 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75de1002-1f96-4445-9ec8-ad4b5604a80d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1683 microversion: 2.1 time: 0.174799 Apr 09 21:43:03.786031 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3319/6661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:03 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:03.962826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:03.972009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:03.972456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:03.984454 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] Creating event network-changed:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch2-master-1 Apr 09 21:43:03.990745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:43:04.001723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-53d27c9a-ea2c-4b3c-9b9d-3cca17e77367 req-beb000c1-d279-429e-ae21-dcef067f2d48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043864 Apr 09 21:43:04.002317 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3343/6662] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:04.806642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:04.807418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:04.816201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:04.816773 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:04.817787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:04.818348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:04.958418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:04.966638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b5129be4-5a22-4f4b-99c6-ab92df57dcbf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1683 microversion: 2.1 time: 0.165957 Apr 09 21:43:04.967224 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3320/6663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:04 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:05.993096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:05.993674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:06.000670 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.001152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.001931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.002370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.143186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:06.151419 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c94bd9d2-2172-4281-adaf-6309e747f35e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1679 microversion: 2.1 time: 0.166375 Apr 09 21:43:06.151971 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3344/6664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:05 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:06.168036 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:06.168710 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:06.176038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.176508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.177440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.177890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.241801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-914ec5f2-3b7e-4830-9f44-edb1b965bdc5 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action" status: 204 len: 0 microversion: 2.1 time: 0.077560 Apr 09 21:43:06.242433 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3321/6665] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:43:06 2022] POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:43:06.251633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:06.252193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:06.258394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.258896 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.259743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:06.260235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:06.464992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:06.472696 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee4371d9-ac29-4ef2-b20f-d50011645f54 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1679 microversion: 2.1 time: 0.225857 Apr 09 21:43:06.473306 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3345/6666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:06 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:07.394115 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "name": "network-vif-plugged", "status": "completed", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:07.403002 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:07.403463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:07.415845 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] Creating event network-vif-plugged:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch2-master-1 Apr 09 21:43:07.421822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:43:07.432879 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-7ef0360c-cb5f-4189-9fad-950bcbe9e9ca req-186ed74a-fa9d-4f3b-ae90-b21cc38a665a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042884 Apr 09 21:43:07.433510 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3322/6667] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:07.490535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:07.491155 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:07.498488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:07.498951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:07.499741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:07.500178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:07.635494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:07.644338 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-31426e32-9af1-45d3-8e7d-b0feb62b58d4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1679 microversion: 2.1 time: 0.157983 Apr 09 21:43:07.644906 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3346/6668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:07 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:08.667501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:08.668254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:08.677537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:08.678152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:08.679308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:08.679898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:08.824570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:08.833018 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-812db61b-656c-47f6-8af1-f7cb8f8c3d52 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1658 microversion: 2.1 time: 0.173269 Apr 09 21:43:08.833644 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3323/6669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:08 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1658 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:08.849871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:08.850496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:08.858726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:08.859472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:08.860321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:08.860803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:09.006023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:09.014203 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8bf80631-c269-415e-9fe8-fe36522e87e2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1658 microversion: 2.1 time: 0.168268 Apr 09 21:43:09.014740 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3347/6670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:08 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1658 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:09.030848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d1d601c6-12ee-4c40-95c8-9a992c91f545 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:09.037464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1d601c6-12ee-4c40-95c8-9a992c91f545 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:09.037943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d1d601c6-12ee-4c40-95c8-9a992c91f545 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:09.060130 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d1d601c6-12ee-4c40-95c8-9a992c91f545 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Going to try to start instance {{(pid=141819) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:43:09.109074 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d1d601c6-12ee-4c40-95c8-9a992c91f545 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action" status: 202 len: 0 microversion: 2.1 time: 0.081619 Apr 09 21:43:09.109914 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3324/6671] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:43:09 2022] POST /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:43:09.118474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:09.119229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:09.125596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:09.126039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:09.127013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:09.127458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:09.262149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:09.269942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4adc2795-df52-449b-8528-9fac6436ccc0 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1667 microversion: 2.1 time: 0.155414 Apr 09 21:43:09.270546 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3348/6672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:09 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:10.288616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:10.289362 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:10.296365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.296819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.297647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.298099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.435966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:10.447036 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7279be9-5315-490d-8b91-af8f26d9c4e6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1671 microversion: 2.1 time: 0.163486 Apr 09 21:43:10.447636 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3325/6673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:10 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:10.465934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:10.466438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:10.473682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.474132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.474898 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.475304 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.499191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:43:10.578401 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e7a5df7-6880-4bfe-8c72-c24b26943b45 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 204 len: 0 microversion: 2.1 time: 0.117187 Apr 09 21:43:10.578948 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3349/6674] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:43:10 2022] DELETE /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:43:10.587997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:10.588660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:10.594837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.595396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.596081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:10.596526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:10.741906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:10.750404 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d90832a-76bb-4fc9-b061-a40d580e5b96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1677 microversion: 2.1 time: 0.166403 Apr 09 21:43:10.751055 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3326/6675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:10 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:11.772885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:11.774125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:11.785477 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:11.786227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:11.787497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:11.788221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:11.933189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:11.941123 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4314c0c8-9aa1-493e-9671-a9bfed32f97e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1677 microversion: 2.1 time: 0.175425 Apr 09 21:43:11.941723 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3350/6676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:11 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:12.959079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:12.959658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:12.966707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:12.967167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:12.968070 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:12.968568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:13.108715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:13.117522 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99406d98-fe8e-497f-b15a-04e5d9ea81a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 200 len: 1677 microversion: 2.1 time: 0.162757 Apr 09 21:43:13.118135 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3327/6677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:12 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:13.371557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-34ce92f2-e89a-4c01-ab0e-3c7f17ce4f6a req-4c91cdd9-86ce-4f83-95ca-7c5ddeaa9dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae1abfd-487c-47b6-8246-1f3ecec6cd04", "name": "network-vif-deleted", "tag": "f7c3ec3c-2674-48e5-b1a3-696a4344fc21"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:13.380473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34ce92f2-e89a-4c01-ab0e-3c7f17ce4f6a req-4c91cdd9-86ce-4f83-95ca-7c5ddeaa9dbd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:13.380918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34ce92f2-e89a-4c01-ab0e-3c7f17ce4f6a req-4c91cdd9-86ce-4f83-95ca-7c5ddeaa9dbd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:13.394339 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-34ce92f2-e89a-4c01-ab0e-3c7f17ce4f6a req-4c91cdd9-86ce-4f83-95ca-7c5ddeaa9dbd service nova] Creating event network-vif-deleted:f7c3ec3c-2674-48e5-b1a3-696a4344fc21 for instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 on nch2-master-1 Apr 09 21:43:13.399832 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-34ce92f2-e89a-4c01-ab0e-3c7f17ce4f6a req-4c91cdd9-86ce-4f83-95ca-7c5ddeaa9dbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 Apr 09 21:43:13.400935 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3351/6678] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:14.135580 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:14.136252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:14.143741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.144211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.145082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.145589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.159640 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. Apr 09 21:43:14.160254 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:43:14.161114 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7c21612e-b358-4f80-8d78-f17dd366be97 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 404 len: 111 microversion: 2.1 time: 0.030206 Apr 09 21:43:14.161670 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3328/6679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:14 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:43:14.178535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:14.179340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:14.186521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.186978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.187797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.188267 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.203249 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. Apr 09 21:43:14.203854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:43:14.205127 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9173011f-063f-4d7a-9a07-6830332f918e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 404 len: 111 microversion: 2.1 time: 0.030944 Apr 09 21:43:14.205701 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3352/6680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:14 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:43:14.252801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1914141284", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "03b745cd-5e10-41bf-b629-61d061eff991"}], "security_groups": [{"name": "tempest-securitygroup--1323145368"}], "key_name": "tempest-keypair-1281286957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:14.356568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] validate_networks() for [('03b745cd-5e10-41bf-b629-61d061eff991', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:43:14.769543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:43:14.769981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:43:14.770470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:43:14.770890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:43:14.771311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:43:14.780542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.780946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.781818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:14.782275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:14.798940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:43:14.804140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:43:14.816278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:43:14.818631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:43:14.868971 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2b0602f1-c712-46ef-bd29-f1b0cc3eb4a7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620113 Apr 09 21:43:14.869699 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3329/6681] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:43:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:43:14.880032 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4fdc2e8e-e9c9-4c88-a20a-7a898da74f2b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:14.880644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4fdc2e8e-e9c9-4c88-a20a-7a898da74f2b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:14.938276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4fdc2e8e-e9c9-4c88-a20a-7a898da74f2b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:14.946230 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4fdc2e8e-e9c9-4c88-a20a-7a898da74f2b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1239 microversion: 2.1 time: 0.070309 Apr 09 21:43:14.946804 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3353/6682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:14 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:15.964871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:15.965696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:15.972237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:15.972679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:15.973509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:15.973954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:16.045224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:16.052965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9636d8e8-6294-4a9d-b4c6-8e0e05eaf9cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1309 microversion: 2.1 time: 0.092857 Apr 09 21:43:16.053493 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3330/6683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:15 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:17.075512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:17.076253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:17.084703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:17.085183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:17.085987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:17.086458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:17.294826 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:17.303078 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a0aade3d-666e-45e5-b9c4-42d5eab31c65 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.233165 Apr 09 21:43:17.303722 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3354/6684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:17 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:17.502313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-d2197943-73b4-4ae6-b359-a4ecff12562c req-03647cb3-a3c5-423c-9e2b-09aba4a56dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:17.512553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d2197943-73b4-4ae6-b359-a4ecff12562c req-03647cb3-a3c5-423c-9e2b-09aba4a56dea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:17.513020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-d2197943-73b4-4ae6-b359-a4ecff12562c req-03647cb3-a3c5-423c-9e2b-09aba4a56dea service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:17.524480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-d2197943-73b4-4ae6-b359-a4ecff12562c req-03647cb3-a3c5-423c-9e2b-09aba4a56dea service nova] Creating event network-changed:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:43:17.529601 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-d2197943-73b4-4ae6-b359-a4ecff12562c req-03647cb3-a3c5-423c-9e2b-09aba4a56dea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117949 Apr 09 21:43:17.530226 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3331/6685] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:17.809823 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:43:17.809995 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:43:18.325454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:18.326229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:18.334815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:18.335276 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:18.336061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:18.336525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:18.467285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:18.475163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bc8741e-b5ed-4c7c-a48c-2591622cd636 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.156779 Apr 09 21:43:18.475743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3355/6686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:18 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:19.493777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:19.494494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:19.501404 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:19.501875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:19.502640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:19.503088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:19.639649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:19.647435 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de4be734-5e03-4bce-b834-f5b3fa48cdbd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.159004 Apr 09 21:43:19.647999 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3332/6687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:19 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:20.669003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:20.669647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:20.676909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:20.677398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:20.678187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:20.678628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:20.818275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:20.826900 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-db1f64d4-95b1-4c30-b1d9-b3ccc7cd114a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.164218 Apr 09 21:43:20.827521 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3356/6688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:20 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:21.451574 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:43:21.451762 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:43:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:43:21.844384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:21.844987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:21.848705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-8804e9db-38ce-4426-92ac-ff817115c3ff req-ec5e3e19-1289-4919-a6bf-33e367d4d443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-plugged", "status": "completed", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:21.854248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:21.854480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:21.855368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:21.855918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:21.858712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8804e9db-38ce-4426-92ac-ff817115c3ff req-ec5e3e19-1289-4919-a6bf-33e367d4d443 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:21.859170 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8804e9db-38ce-4426-92ac-ff817115c3ff req-ec5e3e19-1289-4919-a6bf-33e367d4d443 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:21.872139 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-8804e9db-38ce-4426-92ac-ff817115c3ff req-ec5e3e19-1289-4919-a6bf-33e367d4d443 service nova] Creating event network-vif-plugged:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:43:21.877699 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-8804e9db-38ce-4426-92ac-ff817115c3ff req-ec5e3e19-1289-4919-a6bf-33e367d4d443 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Apr 09 21:43:21.878524 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3357/6689] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:22.040837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:22.048971 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1144013-e0fe-495f-92bb-76710820955d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.208906 Apr 09 21:43:22.049611 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3333/6690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:21 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:23.068123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:23.069058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:23.075866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:23.076432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:23.077266 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:23.077712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:23.214464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:23.222180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48c5f08e-3664-45b0-8066-e7896deddd90 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1365 microversion: 2.1 time: 0.159391 Apr 09 21:43:23.232392 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3358/6691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:23 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:24.244653 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:24.245720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:24.256983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:24.257823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:24.260496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:24.261673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:24.399107 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:24.411791 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7037f64-97ab-459d-af59-786d1969d5b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1553 microversion: 2.1 time: 0.173536 Apr 09 21:43:24.412646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3334/6692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:24 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:24.431127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:24.431664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:24.438863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:24.439289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:24.440063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:24.440499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:24.518398 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ea6e54b7-c364-49bc-b047-3eacabe61429 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091139 Apr 09 21:43:24.519009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3359/6693] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:43:24 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:43:25.836237 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:25.837369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:25.838502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-de81de33-7ed3-4041-a4ec-236a68c63c9b req-03d1311a-deca-428c-9576-e45a3464862c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:43:25.844878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:25.845384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:25.846170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:25.846612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:25.847162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-de81de33-7ed3-4041-a4ec-236a68c63c9b req-03d1311a-deca-428c-9576-e45a3464862c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:25.847678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-de81de33-7ed3-4041-a4ec-236a68c63c9b req-03d1311a-deca-428c-9576-e45a3464862c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:25.863672 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-de81de33-7ed3-4041-a4ec-236a68c63c9b req-03d1311a-deca-428c-9576-e45a3464862c service nova] Creating event network-changed:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:43:25.870039 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-de81de33-7ed3-4041-a4ec-236a68c63c9b req-03d1311a-deca-428c-9576-e45a3464862c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036157 Apr 09 21:43:25.871409 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3360/6694] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:43:25.875369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:25.882642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Old instance type m1.heat2, new instance type m1.heat {{(pid=141819) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:43:25.890453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:43:25.890886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:43:25.891366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:43:25.891786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:43:25.892213 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:43:25.961486 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef777b3c-31ad-46a6-9d16-782d071e8a0e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/action" status: 202 len: 0 microversion: 2.1 time: 0.129126 Apr 09 21:43:25.962099 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3335/6695] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:43:25 2022] POST /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:43:25.975038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:25.981008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:25.988455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:25.988928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:25.990069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:25.990686 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:26.239853 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:26.249649 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de7581a9-6734-463d-a6d0-1ac8d1b6be80 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1562 microversion: 2.1 time: 0.282612 Apr 09 21:43:26.250275 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3361/6696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:25 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1562 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:27.268988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:27.269610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:27.275583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:27.276440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:27.276808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:27.277295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:27.496086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:27.503670 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39505141-6ca7-4972-8b07-23d100f4c7b1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1681 microversion: 2.1 time: 0.239881 Apr 09 21:43:27.504239 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3336/6697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:27 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:28.527359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:28.528371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:28.536209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:28.536664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:28.537484 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:28.537925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:28.669846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:28.681523 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b427946d-50d0-4663-ae91-04cd56743b27 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.160718 Apr 09 21:43:28.682298 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3362/6698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:28 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:29.703714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:29.704487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:29.713470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:29.714023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:29.714991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:29.715480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:29.849323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:29.861307 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ea11d3c-bb72-45d6-acaa-53efccfeae87 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.163477 Apr 09 21:43:29.862116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3337/6699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:29 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:30.888408 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:30.889442 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:30.900513 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:30.901368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:30.902618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:30.903397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:31.038066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:31.046080 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6a65fe4-24a4-401e-b2f0-62a91781d0d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.164584 Apr 09 21:43:31.046679 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3363/6700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:30 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:32.068220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:32.069163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:32.079609 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:32.080074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:32.081245 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:32.081693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:32.219363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:32.227258 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5f956488-d686-45cd-9429-60759bb1df85 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.165766 Apr 09 21:43:32.227870 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3338/6701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:32 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:33.245417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:33.245965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:33.253295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:33.253751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:33.254614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:33.255058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:33.393112 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:33.400977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6756e1f7-0d52-4e01-8705-a25bb4b8efe2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.160011 Apr 09 21:43:33.401793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3364/6702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:33 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:34.422127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:34.423305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:34.435068 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:34.435833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:34.437016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:34.437504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:34.567393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:34.575638 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bc30502d-b556-42f9-9aa2-62f336f84c61 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.160579 Apr 09 21:43:34.576190 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3339/6703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:34 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:35.597502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:35.598586 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:35.610138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:35.610603 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:35.611393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:35.611849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:35.747256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:35.755098 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71b9aa50-3fe9-40a4-a910-cf939bc655b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.164297 Apr 09 21:43:35.756126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3365/6704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:35 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:36.772769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:36.773427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:36.780591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:36.781160 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:36.781945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:36.782379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:36.927790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:36.935497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93e3ef16-4ced-4436-ba6b-81c9dc1afa21 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.166826 Apr 09 21:43:36.936089 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3340/6705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:36 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:37.956815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:37.957678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:37.967271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:37.967879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:37.968908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:37.969555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:38.110695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:38.122588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a723ed0-0fa6-4990-a03b-1af2a889ab9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.171739 Apr 09 21:43:38.123357 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3366/6706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:37 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:39.144098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:39.145176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:39.156646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:39.157141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:39.157950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:39.158407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:39.293178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:39.301431 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f75e5c0a-1eaa-4457-973a-b6d0def10a4b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.164024 Apr 09 21:43:39.302013 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3341/6707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:39 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:40.326318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:40.327282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:40.338947 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:40.339708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:40.340999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:40.341816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:40.480972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:40.488704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5f3c1704-5861-4e93-9e53-8203ceea8843 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.169383 Apr 09 21:43:40.489292 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3367/6708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:40 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:43:41.506280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:41.506862 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:41.514893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:41.515365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:41.516317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:41.516990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:41.649985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:41.657492 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de068838-ea4d-42fe-b223-8b2e2ed08e8a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.155221 Apr 09 21:43:41.658069 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3342/6709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:41 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:42.679088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:42.680062 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:42.690321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:42.690775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:42.691551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:42.691990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:42.823671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:42.836054 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5604b269-311f-4704-bff6-6d81119431ab tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.163288 Apr 09 21:43:42.836910 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3368/6710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:42 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:43.858443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:43.859280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:43.866827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:43.867295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:43.868084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:43.868535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:44.009835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:44.017606 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d0674fd5-dc82-497f-96f7-d82ff76b6ec1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.164520 Apr 09 21:43:44.018179 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3343/6711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:43 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:45.035780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:45.036507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:45.044178 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:45.044653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:45.045509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:45.045976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:45.179308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:45.187099 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ef7302f3-a70f-49be-a887-6c91dcf25be4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.155575 Apr 09 21:43:45.187684 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3369/6712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:45 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:46.205441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:46.206081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:46.213727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:46.214184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:46.215023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:46.215423 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:46.346590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:46.354509 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-016311d3-3530-4b3c-95c2-c84035e5ce1b tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.153861 Apr 09 21:43:46.355078 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3344/6713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:46 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:47.371596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:47.372219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:47.379827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:47.380291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:47.381070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:47.381532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:47.518778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:47.526862 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3598f6a9-69d5-4d88-92df-b47c3d0703cb tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.159314 Apr 09 21:43:47.527464 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3370/6714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:47 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:48.548577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:48.549716 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:48.561182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:48.561959 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:48.563266 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:48.564016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:48.707877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:48.716294 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c542b02-ab64-41fc-99f8-5b837979fe74 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.174484 Apr 09 21:43:48.716881 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3345/6715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:48 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:49.738813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:49.739791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:49.751434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:49.752202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:49.753580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:49.754228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:49.895970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:49.904290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-82803be4-6d2d-4477-80b0-4b897d103f86 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.172186 Apr 09 21:43:49.904870 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3371/6716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:49 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:50.927408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:50.928110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:50.936666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:50.937261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:50.938185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:50.938708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:51.071719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:51.079297 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-52fc3f63-a498-47ac-9de0-33d8e5c4449c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.158238 Apr 09 21:43:51.079889 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3346/6717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:50 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:52.100047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:52.100673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:52.109066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:52.109608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:52.110514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:52.111030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:52.247879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:52.259640 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-73717f6b-cd8d-4259-be8e-862f586b45c1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.165423 Apr 09 21:43:52.260367 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3372/6718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:52 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:53.281279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:53.281921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:53.289583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:53.290136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:53.290987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:53.291457 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:53.423760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:53.431489 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ab52ecd-4911-46c3-9411-a4f34463c655 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.154598 Apr 09 21:43:53.432063 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3347/6719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:53 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:54.450033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:54.450753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:54.459179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:54.459632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:54.460393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:54.460827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:54.605502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:54.613461 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-55281259-e074-453f-9cfd-d34e92f75cf7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.168290 Apr 09 21:43:54.614059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3373/6720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:54 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:55.633887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:55.634476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:55.642496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:55.643017 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:55.646719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:55.646719 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:55.789065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:55.797340 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-daaa9415-d94b-4883-8312-1488da08d81e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.169050 Apr 09 21:43:55.797908 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3348/6721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:55 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:56.818105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:56.818994 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:56.829598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:56.830312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:56.831508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:56.832540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:56.963651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:56.971632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6ce7b56-78c8-4e7d-a151-13d9bce926a1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.159647 Apr 09 21:43:56.972194 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3374/6722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:56 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:57.992884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:57.993575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:58.001504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:58.001994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:58.002832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:58.003306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:58.140358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:58.149899 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-96629ffa-2b9e-4eab-8723-9236c4383f6a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.163477 Apr 09 21:43:58.150486 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3349/6723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:57 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:43:59.168202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:43:59.168813 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:43:59.176102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:59.176557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:59.177361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:43:59.177828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:43:59.315911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:43:59.325516 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4566c322-bb04-46ec-b6ac-249521d1e857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1686 microversion: 2.1 time: 0.161142 Apr 09 21:43:59.326136 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3375/6724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:43:59 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:00.260943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-unplugged", "status": "completed", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:00.269905 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:00.270646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:00.284048 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] Creating event network-vif-unplugged:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch2-master-1 Apr 09 21:44:00.289490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] Instance eca2442e-03de-4d78-be3e-3cff659dcad6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:00.300434 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9ca4dc27-f926-4e33-9089-bab50a1bf2e7 req-4f4e5aab-bdaf-463e-93ed-b22b7c8ebbcc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043724 Apr 09 21:44:00.301293 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3350/6725] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:00.345970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:00.346573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:00.354193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:00.354931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:00.356002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:00.356447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:00.512992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:00.520750 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a3d9d41-124a-40c2-8463-065414924f94 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1685 microversion: 2.1 time: 0.179515 Apr 09 21:44:00.521372 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3376/6726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:00 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:01.544900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:01.546121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:01.556899 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:01.557714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:01.558497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:01.558975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:01.699768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:01.708478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7251ba58-11a0-4b6c-89fd-e8c0fe684603 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1683 microversion: 2.1 time: 0.172070 Apr 09 21:44:01.709144 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3351/6727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:01 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:02.322047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:02.336839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:02.337629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:02.350832 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] Creating event network-changed:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch2-master-1 Apr 09 21:44:02.356510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] Instance eca2442e-03de-4d78-be3e-3cff659dcad6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:02.367723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-42a9ba36-f1de-4378-80f6-379148e4b4f2 req-7abec23a-4db3-4c17-bde8-5d1edfcd09f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052519 Apr 09 21:44:02.368324 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3377/6728] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:02.735813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:02.736420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:02.743684 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:02.744156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:02.744988 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:02.745478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:02.951229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:02.959500 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89551a46-1198-4308-88a0-bd26dcd99380 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1683 microversion: 2.1 time: 0.227691 Apr 09 21:44:02.960215 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3352/6729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:02 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:03.979500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:03.980809 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:03.988351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:03.989120 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:03.989908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:03.990346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:04.129023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:04.136976 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bc702cc1-67c0-424d-9e54-23567e423ca8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1683 microversion: 2.1 time: 0.162191 Apr 09 21:44:04.137589 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3378/6730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:03 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:05.155057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:05.155626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:05.162678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.163143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.163935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.164388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.306174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:05.314602 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca20149d-9a42-49b0-a73c-72ea2c132446 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1680 microversion: 2.1 time: 0.163709 Apr 09 21:44:05.315193 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3353/6731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:05 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:05.331757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:05.332291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:05.340197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.340657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.341485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.341931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.379683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.380147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.381042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.381491 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.402759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:44:05.408426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:44:05.534723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85dff524-15e9-4ae7-a499-675e1921cdac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/action" status: 202 len: 0 microversion: 2.1 time: 0.206800 Apr 09 21:44:05.535412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3379/6732] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:44:05 2022] POST /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:44:05.544568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:05.545225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:05.551240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.551699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.552612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.553102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.688889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:05.697998 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca892e21-5474-456d-af3f-9bd26981b387 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1679 microversion: 2.1 time: 0.158315 Apr 09 21:44:05.699042 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3354/6733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:05 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:05.953075 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-plugged", "status": "completed", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:05.961959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:05.962418 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:05.974290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] Creating event network-vif-plugged:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch2-master-1 Apr 09 21:44:05.979860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] Instance eca2442e-03de-4d78-be3e-3cff659dcad6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:05.991352 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7bad73bd-d331-4a07-b2b2-586968e77643 req-b3c269de-94aa-482c-b6bb-2ec246e846b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116560 Apr 09 21:44:05.991972 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3380/6734] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:06.719889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:06.720686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:06.729793 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:06.730464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:06.731472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:06.732050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:06.876992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:06.885027 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0eb6ae35-7a9b-4191-8489-daf2c5ac8906 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1679 microversion: 2.1 time: 0.171987 Apr 09 21:44:06.885638 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3355/6735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:06 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:07.902974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:07.903819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:07.911343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:07.911800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:07.912609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:07.913066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:08.055044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:08.062905 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e72e1978-675f-4d54-80e1-63a9cfcd4d6e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1679 microversion: 2.1 time: 0.164321 Apr 09 21:44:08.063494 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3381/6736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:07 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:08.861796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-unplugged", "status": "completed", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:08.873447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:08.873915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:08.885976 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] Creating event network-vif-unplugged:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:44:08.891950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] Instance eca2442e-03de-4d78-be3e-3cff659dcad6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:08.903077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8950b566-f8f7-44e8-a1f2-353ca8dc5b3c req-5caee3cf-7f5e-40b4-ab13-713fb52546c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046683 Apr 09 21:44:08.904667 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3356/6737] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:09.079960 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:09.080567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:09.088195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:09.088659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:09.089506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:09.090028 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:09.567078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:09.574852 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-48df7978-a66e-47eb-b53b-1b6c74bc846a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1679 microversion: 2.1 time: 0.498869 Apr 09 21:44:09.575445 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3382/6738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:09 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1679 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:10.597780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:10.598797 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:10.610586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:10.611346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:10.612645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:10.613441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:10.762825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:10.774370 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3b778cf7-5d52-4d5d-996e-db2663b5e1a4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1679 microversion: 2.1 time: 0.183795 Apr 09 21:44:10.775240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3357/6739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:10 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:10.923907 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:10.933321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:10.933773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:10.946290 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] Creating event network-changed:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:44:10.952347 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] Instance eca2442e-03de-4d78-be3e-3cff659dcad6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:10.966777 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-63154130-735d-46b5-a3d6-6456e96d7b47 req-54fb7e8e-ed89-4306-b831-739d32bb7c54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048116 Apr 09 21:44:10.967518 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3383/6740] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:11.794334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:11.795610 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:11.802407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:11.802880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:11.803681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:11.804131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:11.989983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:11.997805 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba4fb467-0e4b-48c6-af44-a5af4be847e9 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1672 microversion: 2.1 time: 0.207484 Apr 09 21:44:11.998394 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3358/6741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:11 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:12.015518 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:12.016218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:12.022637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.023087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.023862 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.024292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.159516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:12.167681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-23e43810-0aea-4726-80ed-155e1153ab5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1672 microversion: 2.1 time: 0.157215 Apr 09 21:44:12.168241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3384/6742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:12 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:12.183926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:12.184587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:12.190912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.191371 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.192156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.192596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.320451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:12.328503 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d51dceac-5247-42c3-8f5d-ed27608ad857 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1672 microversion: 2.1 time: 0.148723 Apr 09 21:44:12.329146 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3359/6743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:12 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:12.348177 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:12.348887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:12.358167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.358834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.360020 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.360470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.384641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:44:12.468743 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f5dd6200-519b-4422-b1d4-fd38c657883c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 204 len: 0 microversion: 2.1 time: 0.127023 Apr 09 21:44:12.469525 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3385/6744] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:44:12 2022] DELETE /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:44:12.478120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:12.478756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:12.485262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.485836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.486729 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:12.487255 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:12.620531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:12.632126 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c5ecddec-cafa-45f4-84af-747b9a2e2dd8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1678 microversion: 2.1 time: 0.157789 Apr 09 21:44:12.632908 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3360/6745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:12 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:13.655557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:13.656749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:13.664376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:13.664827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:13.665628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:13.666068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:13.841411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:13.849555 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-51768aff-b73f-4348-bae8-f18111dc334e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1678 microversion: 2.1 time: 0.201611 Apr 09 21:44:13.850124 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3386/6746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:13 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:14.210856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-27bcba30-59a9-4513-bd8c-df39a415a311 req-0071e461-4a78-4b8b-978b-350c6a206f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-plugged", "status": "completed", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:14.220474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-27bcba30-59a9-4513-bd8c-df39a415a311 req-0071e461-4a78-4b8b-978b-350c6a206f58 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:14.221116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-27bcba30-59a9-4513-bd8c-df39a415a311 req-0071e461-4a78-4b8b-978b-350c6a206f58 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:14.233547 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-27bcba30-59a9-4513-bd8c-df39a415a311 req-0071e461-4a78-4b8b-978b-350c6a206f58 service nova] Creating event network-vif-plugged:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:44:14.238682 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-27bcba30-59a9-4513-bd8c-df39a415a311 req-0071e461-4a78-4b8b-978b-350c6a206f58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Apr 09 21:44:14.239464 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3361/6747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:14.735158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b02e44c9-7bd9-4f0f-a0a0-92d10945a6f5 req-4ebafcf0-b000-4a9a-8e15-effe98b57595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2442e-03de-4d78-be3e-3cff659dcad6", "name": "network-vif-deleted", "tag": "312becff-ee82-49e8-89ad-5b80e8185eed"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:14.746146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b02e44c9-7bd9-4f0f-a0a0-92d10945a6f5 req-4ebafcf0-b000-4a9a-8e15-effe98b57595 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:14.746675 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b02e44c9-7bd9-4f0f-a0a0-92d10945a6f5 req-4ebafcf0-b000-4a9a-8e15-effe98b57595 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:14.760286 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b02e44c9-7bd9-4f0f-a0a0-92d10945a6f5 req-4ebafcf0-b000-4a9a-8e15-effe98b57595 service nova] Creating event network-vif-deleted:312becff-ee82-49e8-89ad-5b80e8185eed for instance eca2442e-03de-4d78-be3e-3cff659dcad6 on nch1-master-1 Apr 09 21:44:14.766093 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b02e44c9-7bd9-4f0f-a0a0-92d10945a6f5 req-4ebafcf0-b000-4a9a-8e15-effe98b57595 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034640 Apr 09 21:44:14.767453 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3387/6748] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:14.867995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:14.868753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:14.875539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:14.876004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:14.876786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:14.877327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:14.909921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:14.910384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:14.910829 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lazy-loading 'fault' on Instance uuid eca2442e-03de-4d78-be3e-3cff659dcad6 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:44:14.955550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:14.964312 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-04aab146-7868-463f-b348-da73aab69f6f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 200 len: 1329 microversion: 2.1 time: 0.100798 Apr 09 21:44:14.964919 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3362/6749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:14 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:15.982567 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:15.983273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:15.990865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:15.991322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:15.992104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:15.992541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:16.006251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. Apr 09 21:44:16.006847 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:44:16.007680 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a0bc8bb-b6d8-41aa-b1e9-ee4fd79da2da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 404 len: 111 microversion: 2.1 time: 0.029523 Apr 09 21:44:16.008214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3388/6750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:15 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:44:16.029112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:16.029745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:16.036748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:16.037259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:16.038049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:16.038500 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:16.051875 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. Apr 09 21:44:16.052470 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:44:16.053356 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fceb3825-bd33-4b88-a4dd-bcf7f68c9a96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 404 len: 111 microversion: 2.1 time: 0.028313 Apr 09 21:44:16.053888 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3363/6751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:16 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:44:16.103007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-478159977", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "03b745cd-5e10-41bf-b629-61d061eff991"}], "security_groups": [{"name": "tempest-securitygroup--1323145368"}], "key_name": "tempest-keypair-1281286957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:16.207350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] validate_networks() for [('03b745cd-5e10-41bf-b629-61d061eff991', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:44:16.589105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:44:16.589650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:44:16.590280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:44:16.591096 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:44:16.591293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:44:16.602069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:16.602535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:16.603353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:16.603795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:16.620843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:44:16.626407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:44:16.639272 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:44:16.641618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:44:16.690254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-68b679e5-105d-417a-b755-f5f6b170f57f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.593036 Apr 09 21:44:16.691146 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3389/6752] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:44:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:44:16.701398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a47e9f4a-8765-46c0-a3ef-8ddd9fe75542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:16.702142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a47e9f4a-8765-46c0-a3ef-8ddd9fe75542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:16.755758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a47e9f4a-8765-46c0-a3ef-8ddd9fe75542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:16.762905 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a47e9f4a-8765-46c0-a3ef-8ddd9fe75542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1238 microversion: 2.1 time: 0.065610 Apr 09 21:44:16.763476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3364/6753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:16 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:17.782931 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:17.783909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:17.792427 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:17.792882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:17.793870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:17.794505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:17.885946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:17.894275 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-89bd706c-8e0c-40e9-9f9a-1b051756b126 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1296 microversion: 2.1 time: 0.117546 Apr 09 21:44:17.894861 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3390/6754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:17 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1296 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:18.912994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:18.913960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:18.922417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:18.922989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:18.924121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:18.924806 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:19.129099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-34fca34a-67be-43c1-b4d6-911e2aed266d req-9f27158f-30cb-40ab-a52c-caea0956e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:19.135073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:19.143063 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-05e64572-3509-4517-a711-c674915f640c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.234746 Apr 09 21:44:19.143672 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3365/6755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:18 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:19.158887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34fca34a-67be-43c1-b4d6-911e2aed266d req-9f27158f-30cb-40ab-a52c-caea0956e7ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:19.159606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-34fca34a-67be-43c1-b4d6-911e2aed266d req-9f27158f-30cb-40ab-a52c-caea0956e7ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:19.175642 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-34fca34a-67be-43c1-b4d6-911e2aed266d req-9f27158f-30cb-40ab-a52c-caea0956e7ac service nova] Creating event network-changed:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:44:19.181185 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-34fca34a-67be-43c1-b4d6-911e2aed266d req-9f27158f-30cb-40ab-a52c-caea0956e7ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056546 Apr 09 21:44:19.181816 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3391/6756] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:20.160435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:20.161009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:20.168323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:20.168784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:20.169600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:20.170045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:20.665028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:20.672986 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92e08542-8b74-460d-9ed1-57db1f0f79a6 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.516709 Apr 09 21:44:20.673693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3366/6757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:20 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:21.691918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:21.692499 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:21.700030 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:21.700487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:21.701303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:21.701743 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:21.841052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:21.848761 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-790f9126-b0a8-4eea-8e7d-91860a12e37f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.161469 Apr 09 21:44:21.849378 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3392/6758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:21 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:22.870503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:22.871578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:22.882454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:22.883217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:22.884510 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:22.885293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:23.022302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:23.030030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d9ba8b97-e52a-4f3f-97ef-919598005173 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.166323 Apr 09 21:44:23.030613 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3367/6759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:22 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:24.047163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:24.047781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:24.054448 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:24.054878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:24.055671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:24.056106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:24.194210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:24.202196 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c6251c5-03f7-4245-a2ca-d5c5fe0d4748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.159330 Apr 09 21:44:24.202786 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3393/6760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:24 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:24.255028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-cd637d36-a306-48a6-910c-c0ebe3e699f5 req-87c8590f-78bb-4512-8f0d-d49531276438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:24.264063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cd637d36-a306-48a6-910c-c0ebe3e699f5 req-87c8590f-78bb-4512-8f0d-d49531276438 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:24.264561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-cd637d36-a306-48a6-910c-c0ebe3e699f5 req-87c8590f-78bb-4512-8f0d-d49531276438 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:24.276452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-cd637d36-a306-48a6-910c-c0ebe3e699f5 req-87c8590f-78bb-4512-8f0d-d49531276438 service nova] Creating event network-vif-plugged:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:44:24.281569 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-cd637d36-a306-48a6-910c-c0ebe3e699f5 req-87c8590f-78bb-4512-8f0d-d49531276438 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030573 Apr 09 21:44:24.282176 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3368/6761] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:25.224033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:25.225100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:25.236457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:25.236918 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:25.237753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:25.238198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:25.381902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:25.392762 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a83acb1f-fe71-4d5e-9855-e0eb90e7b64c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1364 microversion: 2.1 time: 0.175376 Apr 09 21:44:25.393395 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3394/6762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:25 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:26.412123 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:26.412754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:26.419244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:26.419704 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:26.420482 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:26.420924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:26.558783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:26.567016 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-281c7573-56d3-4e72-8e40-41c1320cb7bf tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1551 microversion: 2.1 time: 0.160368 Apr 09 21:44:26.567624 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3369/6763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:26 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:26.584561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:26.585135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:26.591964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:26.592412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:26.593213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:26.593647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:26.680214 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f9f21ed2-3724-470e-a9fa-be373d96d162 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100157 Apr 09 21:44:26.680824 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3395/6764] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Apr 9 21:44:26 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:44:27.736795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-08754eb4-9df9-4eb8-93a8-b2129024c265 req-f2541a90-46c4-425a-b3ef-859c318602a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:27.746165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08754eb4-9df9-4eb8-93a8-b2129024c265 req-f2541a90-46c4-425a-b3ef-859c318602a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:27.746864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-08754eb4-9df9-4eb8-93a8-b2129024c265 req-f2541a90-46c4-425a-b3ef-859c318602a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:27.758480 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-08754eb4-9df9-4eb8-93a8-b2129024c265 req-f2541a90-46c4-425a-b3ef-859c318602a9 service nova] Creating event network-changed:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:44:27.763436 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-08754eb4-9df9-4eb8-93a8-b2129024c265 req-f2541a90-46c4-425a-b3ef-859c318602a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 Apr 09 21:44:27.764847 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3370/6765] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:29.097693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:29.098315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:29.104984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:29.105478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:29.106265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:29.106739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:29.241505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:29.249632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9bccf5a4-5cce-4b2c-80d0-7c28788cee89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1670 microversion: 2.1 time: 0.156809 Apr 09 21:44:29.250228 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3396/6766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:29 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:29.267737 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ab8d030-830e-4da1-8980-0f5616179eb1"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:29.269125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:29.275833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:29.276296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:29.277127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:29.277583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:29.537552 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-474dd5ee-0548-4cd6-85c1-a3578344de91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274903 Apr 09 21:44:29.538310 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3371/6767] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:44:29 2022] POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:31.778291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:31.779289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:31.785856 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:31.786314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:31.787092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:31.787536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:31.815076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:31.821270 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Old instance type m1.heat2, new instance type m1.heat {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:44:31.828259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:44:31.828684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:44:31.829201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:44:31.829615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:44:31.830027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:44:31.898168 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7449752a-96a4-4ca4-82cb-005b695e3d43 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/action" status: 202 len: 0 microversion: 2.1 time: 0.124038 Apr 09 21:44:31.898983 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3397/6768] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:44:31 2022] POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:44:31.907903 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:31.908627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:31.916141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:31.916602 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:31.917420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:31.917863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:32.056982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:32.065376 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c18190a5-cb85-4f6f-9cf6-6e3bd256c6d1 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1725 microversion: 2.1 time: 0.161962 Apr 09 21:44:32.066128 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3372/6769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:31 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:33.087128 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:33.087696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:33.097366 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:33.097828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:33.098627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:33.099065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:33.232083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:33.241482 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a2fd3b55-411d-47eb-b383-6229dcd59e89 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1725 microversion: 2.1 time: 0.162066 Apr 09 21:44:33.242058 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3398/6770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:33 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:34.263777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:34.264916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:34.273491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:34.273960 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:34.274753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:34.275211 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:34.409645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:34.418295 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-068c57fe-5a28-4282-a65c-707a0cdc4d5d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.161499 Apr 09 21:44:34.418885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3373/6771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:34 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:35.440429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:35.441351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:35.448650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:35.449132 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:35.449905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:35.450340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:35.589995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:35.602362 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-711bfaee-4c09-498b-84ce-2ea4e1045e13 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.168509 Apr 09 21:44:35.603207 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3399/6772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:35 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:36.628103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:36.629138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:36.637056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:36.637576 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:36.638462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:36.638970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:36.773715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:36.781923 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-071b0380-be44-4e4f-b9db-692034846fcc tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.160599 Apr 09 21:44:36.782482 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3374/6773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:36 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:37.802963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:37.803721 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:37.811787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:37.812470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:37.813421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:37.813934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:37.952547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:37.961028 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1a5a2348-2700-41b5-a1b1-9642d3c2a32d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.164130 Apr 09 21:44:37.961857 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3400/6774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:37 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:38.979382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:38.980050 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:38.987755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:38.988252 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:38.989097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:38.989589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:39.123120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:39.131659 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ba89199d-913a-43b2-9f93-085769d941cd tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.156554 Apr 09 21:44:39.132251 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3375/6775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:38 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:40.150234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:40.150836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:40.158045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:40.158533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:40.159321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:40.159769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:40.290328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:40.299022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-81058090-f77f-41ef-a904-7d82326e97da tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.153012 Apr 09 21:44:40.299832 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3401/6776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:40 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:41.320597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:41.321328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:41.329204 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:41.329733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:41.330630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:41.331138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:41.468198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:41.476825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3d937a90-926f-4375-b432-0fd6fc9aca96 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.161552 Apr 09 21:44:41.477449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3376/6777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:41 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:42.494704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:42.495315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:42.502621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:42.503073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:42.503841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:42.504277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:42.651127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:42.659371 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-12585f8f-e022-46df-a03e-d682d823f116 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.168743 Apr 09 21:44:42.659967 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3402/6778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:42 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:43.678590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:43.679418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:43.688479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:43.689081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:43.690116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:43.690691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:43.844778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:43.853069 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e5ea4dbd-3932-4639-8136-119353ee97d7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.179602 Apr 09 21:44:43.853678 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3377/6779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:43 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:44.874900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:44.875970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:44.885249 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:44.885707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:44.886526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:44.886944 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:45.025227 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:45.033289 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1fd2d753-d554-489c-b6a9-4d7232eed068 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.165299 Apr 09 21:44:45.033871 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3403/6780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:44 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:46.054861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:46.055695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:46.065458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:46.066086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:46.067170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:46.067776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:46.218132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:46.226680 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6c893c5c-64cc-4892-b6be-bfcf21aabfac tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.178134 Apr 09 21:44:46.227277 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3378/6781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:46 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:47.244241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:47.244886 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:47.252238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:47.252702 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:47.253524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:47.253971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:47.387274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:47.395656 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b75b22c-1883-4291-a526-537dfffa06ef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.155568 Apr 09 21:44:47.396402 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3404/6782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:47 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:48.413455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:48.414106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:48.421047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:48.421534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:48.422346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:48.422799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:48.552216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:48.560825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bb2eaac2-9af5-4778-bf8a-97cd6d7cd83f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.151469 Apr 09 21:44:48.561491 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3379/6783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:48 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:49.582430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:49.583452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:49.592082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:49.592559 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:49.593412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:49.593869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:49.739254 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:49.747870 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc472029-fc28-411b-89b1-6f49456ea468 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.172091 Apr 09 21:44:49.748468 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3405/6784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:49 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:50.769174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:50.770247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:50.782098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:50.782902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:50.784301 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:50.785106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:50.926351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:50.935012 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6d001ef4-bb0e-45b7-84a7-f78d769d448d tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1730 microversion: 2.1 time: 0.172643 Apr 09 21:44:50.935612 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3380/6785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:50 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:51.914890 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-unplugged", "status": "completed", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:51.924214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:51.924759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:51.941903 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] Creating event network-vif-unplugged:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch2-master-1 Apr 09 21:44:51.948264 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:51.954496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:51.955898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:51.961656 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5987a0f0-4547-419a-a474-7c3e9bd1916d req-19c31584-b329-4456-bc5c-202d219da287 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128675 Apr 09 21:44:51.962666 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3406/6786] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:51.965583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:51.966125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:51.967015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:51.967540 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:52.115282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:52.123744 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8740220-990f-43be-9604-46a497f71249 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1729 microversion: 2.1 time: 0.174409 Apr 09 21:44:52.124571 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3381/6787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:51 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:53.143753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:53.144467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:53.151046 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:53.151607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:53.152407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:53.152962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:53.286457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:53.294853 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e58680d5-d313-4759-bcef-353464a21dbe tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1727 microversion: 2.1 time: 0.157266 Apr 09 21:44:53.295429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3407/6788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:53 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:54.226399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:54.235833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:54.236290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:54.248574 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] Creating event network-changed:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch2-master-1 Apr 09 21:44:54.254114 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:44:54.264804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-f8381e26-cbf7-475e-b01a-d3d57360a0b5 req-26ace90a-d832-412d-beff-19c4b941d44c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043687 Apr 09 21:44:54.265424 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3382/6789] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:44:54.312119 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:54.312834 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:54.319854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:54.320306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:54.321174 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:54.321609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:54.549693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:54.559016 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6c222efb-e903-4272-b3d6-bb4bc34291c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1727 microversion: 2.1 time: 0.250906 Apr 09 21:44:54.559703 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3408/6790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:54 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:55.577681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:55.578420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:55.585273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:55.586076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:55.586940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:55.587383 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:55.736626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:55.745222 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a296eb7b-a9c9-480f-baef-c51c89a7f11e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1727 microversion: 2.1 time: 0.172927 Apr 09 21:44:55.745809 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3383/6791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:55 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:56.766121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:56.766719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:56.776113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:56.776571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:56.777378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:56.777818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:56.912679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:56.924632 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f422087f-0b0e-41aa-894d-ad71015627c2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1727 microversion: 2.1 time: 0.164949 Apr 09 21:44:56.925465 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3409/6792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:56 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:57.944157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:57.944768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:57.952271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:57.952732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:57.953554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:57.954003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:58.086762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:58.095389 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-86da416b-54db-4a7c-b453-980d2728b907 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1727 microversion: 2.1 time: 0.155235 Apr 09 21:44:58.096310 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3384/6793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:57 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:59.116525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:59.117555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:59.125493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.125963 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.126759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.127205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.259536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:59.268251 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d8aff292-2f5e-448c-aebd-887342d80bef tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1724 microversion: 2.1 time: 0.158576 Apr 09 21:44:59.268858 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3410/6794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:59 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:44:59.284722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:44:59.285358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:59.292612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.293087 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.293896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.294345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.330628 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.331084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.331889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.332334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.352757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:44:59.358039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Getting quotas for user bc98c87ca47647008da1ddc42a738b29 and project 67f62a23dbf04cfca2a3403c6a2186b0. Resources: {'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:44:59.467489 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/action" status: 202 len: 0 microversion: 2.1 time: 0.186539 Apr 09 21:44:59.468132 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3385/6795] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:44:59 2022] POST /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:44:59.477309 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:44:59.477934 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:44:59.484292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.484868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.485820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:44:59.486363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:44:59.616288 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:44:59.624424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c2d6449c-c6eb-43a3-883a-228c78e8611c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.152011 Apr 09 21:44:59.625006 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3411/6796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:44:59 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:00.290440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:00.300963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:00.301607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:00.313456 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] Creating event network-vif-plugged:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch2-master-1 Apr 09 21:45:00.320164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:45:00.331111 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-a8b9b1fa-1a99-4270-8767-a3f71b30addd req-48924d55-04db-4305-a44d-48b75234c1f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046755 Apr 09 21:45:00.332128 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3386/6797] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:00.647928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:00.648825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:00.656645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:00.657147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:00.657937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:00.658384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:00.791207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:00.799814 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f034f386-60e0-412d-94ca-3aa395eede26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.159234 Apr 09 21:45:00.800399 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3412/6798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:00 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:01.821436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:01.822256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:01.828818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:01.829328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:01.830096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:01.830546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:01.968643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:01.978453 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-18bcd2d3-226c-424f-ad91-4eff5ee7696f tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.162063 Apr 09 21:45:01.979400 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3387/6799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:01 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:03.000464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:03.001148 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:03.004920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-unplugged", "status": "completed", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:03.012553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:03.013020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:03.013852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:03.014298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:03.014568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:03.015246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:03.027866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] Creating event network-vif-unplugged:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:45:03.033397 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:45:03.047275 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-009ec4b0-7c6e-4466-823c-a654fddd71ad req-6bd74a28-1dea-4462-8752-cc677d418862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055844 Apr 09 21:45:03.048041 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3413/6800] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:03.270579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:03.278868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db051b53-32bd-4b32-a109-d753b1beaca7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.282402 Apr 09 21:45:03.279451 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3388/6801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:02 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:04.297796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:04.298480 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:04.305473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:04.305923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:04.306695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:04.307166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:04.455153 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:04.463724 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83a9186b-3dee-46a5-91c9-0c10e3ec511e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.171319 Apr 09 21:45:04.464359 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3414/6802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:04 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:05.067124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:05.076357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:05.076840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:05.089430 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] Creating event network-changed:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:45:05.095198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:45:05.106807 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4e9400e6-9c40-4ab3-8d80-8b5d22312b64 req-6bb96348-a133-4146-b732-e355633e3ea5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043579 Apr 09 21:45:05.107420 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3389/6803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:05.480199 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:05.480848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:05.488278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:05.488741 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:05.489574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:05.490051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:05.680710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:05.690547 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-99742b24-0a89-4f1c-8c11-71c00a824ec8 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.214271 Apr 09 21:45:05.691214 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3415/6804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:05 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:06.710190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:06.711889 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:06.718989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:06.719479 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:06.720261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:06.720708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:06.869356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:06.882627 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cdc98a36-0c00-4e56-a254-ef318410440a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1723 microversion: 2.1 time: 0.177545 Apr 09 21:45:06.883498 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3390/6805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:06 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:07.902167 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:07.902739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:07.910202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:07.910651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:07.911420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:07.911857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.041831 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:08.050698 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9a73eef0-bb3d-45c1-815b-3f68171f108e tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1716 microversion: 2.1 time: 0.152518 Apr 09 21:45:08.051293 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3416/6806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:07 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:08.067650 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:08.068290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:08.075867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.076339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.077173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.077632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.206104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:08.214942 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9abdca01-84c3-4787-9673-698565540916 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1716 microversion: 2.1 time: 0.151419 Apr 09 21:45:08.215531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3391/6807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:08 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:08.231240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:08.231871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:08.238069 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.238528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.239305 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.239746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.376851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:08.385478 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7704d752-0de2-47bb-8b91-7c2326a212a2 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1716 microversion: 2.1 time: 0.158159 Apr 09 21:45:08.386073 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3417/6808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:08 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:08.402324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:08.402848 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:08.409324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.410543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.411574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.412071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.437626 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:45:08.521530 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 204 len: 0 microversion: 2.1 time: 0.123162 Apr 09 21:45:08.522233 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3392/6809] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:08 2022] DELETE /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:45:08.530858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:08.531475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:08.537982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.538430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.539233 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:08.539655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:08.668265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:08.676393 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-238e8581-f5a1-4c75-ae8b-a06006772c17 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1722 microversion: 2.1 time: 0.149582 Apr 09 21:45:08.676964 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3418/6810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:08 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:45:09.694507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:09.695090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:09.702385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:09.702850 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:09.703645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:09.704095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:09.844127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:09.852249 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c57e50fa-c482-41ef-b210-9217a9e77b26 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1722 microversion: 2.1 time: 0.162271 Apr 09 21:45:09.852841 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3393/6811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:09 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:10.445504 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9445b1a3-3ed7-4959-a8a1-430e27c7b179 req-0b246f22-b9b5-40d5-b5ba-544f8d2d3011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:10.454772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9445b1a3-3ed7-4959-a8a1-430e27c7b179 req-0b246f22-b9b5-40d5-b5ba-544f8d2d3011 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:10.455600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9445b1a3-3ed7-4959-a8a1-430e27c7b179 req-0b246f22-b9b5-40d5-b5ba-544f8d2d3011 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:10.467913 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9445b1a3-3ed7-4959-a8a1-430e27c7b179 req-0b246f22-b9b5-40d5-b5ba-544f8d2d3011 service nova] Creating event network-vif-plugged:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:45:10.472959 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9445b1a3-3ed7-4959-a8a1-430e27c7b179 req-0b246f22-b9b5-40d5-b5ba-544f8d2d3011 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Apr 09 21:45:10.473615 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3419/6812] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:10.870112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:10.870748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:10.878281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:10.878888 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:10.879747 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:10.880271 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:10.969662 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc98c87ca47647008da1ddc42a738b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f62a23dbf04cfca2a3403c6a2186b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:10.977858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-65f93fc1-8742-4b97-b30b-34368151c8b7 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 200 len: 1654 microversion: 2.1 time: 0.111688 Apr 09 21:45:10.978426 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3394/6813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:10 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 1654 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:11.094664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-b93977b4-196c-4d3a-805f-230b4629c11b req-aec97003-6e80-4354-bace-c7c58fd604bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39838ff4-14a0-4aaa-94d7-0ec6a293dcf9", "name": "network-vif-deleted", "tag": "a30c04d2-3d65-4347-86b8-5bed8c076da6"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:11.103367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b93977b4-196c-4d3a-805f-230b4629c11b req-aec97003-6e80-4354-bace-c7c58fd604bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:11.103956 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-b93977b4-196c-4d3a-805f-230b4629c11b req-aec97003-6e80-4354-bace-c7c58fd604bd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:11.115916 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-b93977b4-196c-4d3a-805f-230b4629c11b req-aec97003-6e80-4354-bace-c7c58fd604bd service nova] Creating event network-vif-deleted:a30c04d2-3d65-4347-86b8-5bed8c076da6 for instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 on nch1-master-1 Apr 09 21:45:11.120917 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-b93977b4-196c-4d3a-805f-230b4629c11b req-aec97003-6e80-4354-bace-c7c58fd604bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Apr 09 21:45:11.121597 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3420/6814] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:11.995425 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:11.996229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:12.003499 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:12.003752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:12.004619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:12.005216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:12.019565 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. Apr 09 21:45:12.020186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:12.021045 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-59f7ffa8-904b-4982-8bb1-9114a0cee542 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 404 len: 111 microversion: 2.1 time: 0.029652 Apr 09 21:45:12.021614 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3395/6815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:11 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:12.079576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:12.081067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:12.088067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:12.088521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:12.089324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:12.089759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:12.103241 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. Apr 09 21:45:12.103846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:12.104674 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ec3d2f2-50c4-412a-b62d-a1e4df1fbb9c tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030748 Apr 09 21:45:12.105268 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3421/6816] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:45:12 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.307573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.308230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.316480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.317090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.317924 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.318350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.332692 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. Apr 09 21:45:13.333338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.334299 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9fe6734a-4b29-4d6b-a8d3-df7e8e9e14df tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 404 len: 111 microversion: 2.1 time: 0.031401 Apr 09 21:45:13.334849 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3396/6817] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:13 2022] DELETE /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.343784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.344464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.351576 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.352042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.352818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.353303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.366735 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. Apr 09 21:45:13.367321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.368160 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-75a6a747-bb55-4676-a1f6-e2bd8bfdfd4a tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9" status: 404 len: 111 microversion: 2.1 time: 0.028474 Apr 09 21:45:13.368802 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3422/6818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:13 2022] GET /compute/v2.1/servers/39838ff4-14a0-4aaa-94d7-0ec6a293dcf9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.376983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.377531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.383695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.384146 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.384927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.385398 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.398713 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. Apr 09 21:45:13.399298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.400116 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9c15ece6-01cb-4d06-a9eb-ccb73665afe4 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 404 len: 111 microversion: 2.1 time: 0.027205 Apr 09 21:45:13.400637 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3397/6819] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:13 2022] DELETE /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.409018 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.409696 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: eca2442e-03de-4d78-be3e-3cff659dcad6] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.416066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.416528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.417344 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.417789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.433292 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. Apr 09 21:45:13.433880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance eca2442e-03de-4d78-be3e-3cff659dcad6 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.434690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-92e55b7a-bded-4bb9-8a5e-64ebf547a163 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6" status: 404 len: 111 microversion: 2.1 time: 0.029844 Apr 09 21:45:13.435455 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3423/6820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:13 2022] GET /compute/v2.1/servers/eca2442e-03de-4d78-be3e-3cff659dcad6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.443708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.444236 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.450946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.451420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.452214 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.452670 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.467112 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. Apr 09 21:45:13.467782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.468647 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-26565433-7ca2-461a-8c39-b0ae8b9ba080 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 404 len: 111 microversion: 2.1 time: 0.028995 Apr 09 21:45:13.469314 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3398/6821] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:13 2022] DELETE /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.477855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.478486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 5ae1abfd-487c-47b6-8246-1f3ecec6cd04] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.484868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.485459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.486268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.486715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.500715 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. Apr 09 21:45:13.501329 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 5ae1abfd-487c-47b6-8246-1f3ecec6cd04 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.502258 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba92ac78-fc4c-4597-b404-404e3cef2748 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04" status: 404 len: 111 microversion: 2.1 time: 0.028527 Apr 09 21:45:13.502796 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3424/6822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:13 2022] GET /compute/v2.1/servers/5ae1abfd-487c-47b6-8246-1f3ecec6cd04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.510948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.511462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.518125 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.518584 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.519396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.519842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.533556 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. Apr 09 21:45:13.534082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.534918 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-497f7b98-3d83-46aa-9556-26adadbba936 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 404 len: 111 microversion: 2.1 time: 0.027959 Apr 09 21:45:13.535440 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3399/6823] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:13 2022] DELETE /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 21:45:13.543708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.544326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] [instance: 079d8390-daf2-43df-9100-0ae251499630] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:13.550820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.551286 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.552039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:13.552474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:13.565999 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] HTTP exception thrown: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. Apr 09 21:45:13.566569 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Returning 404 to user: Instance 079d8390-daf2-43df-9100-0ae251499630 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:13.567378 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8fa89364-ff63-4058-96b2-1ba465612205 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630" status: 404 len: 111 microversion: 2.1 time: 0.027619 Apr 09 21:45:13.567897 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3425/6824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:13 2022] GET /compute/v2.1/servers/079d8390-daf2-43df-9100-0ae251499630 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:13.577432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e275ebcd-89c6-4de9-89a0-aa6d20718e67 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] Calling method '.version_select at 0x7fb08e654310>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:13.605313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e275ebcd-89c6-4de9-89a0-aa6d20718e67 tempest-ServerActionsTestJSON-1381280569 tempest-ServerActionsTestJSON-1381280569-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281286957" status: 202 len: 0 microversion: 2.1 time: 0.031694 Apr 09 21:45:13.605920 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3400/6825] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Apr 9 21:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281286957 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:45:19.941598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-34391624", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "2a40501d-47fe-44a0-88f2-78c99b33bdac"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:20.001189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] validate_networks() for [('2a40501d-47fe-44a0-88f2-78c99b33bdac', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:45:20.373072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:45:20.373606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:45:20.374084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:45:20.374521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:45:20.374910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:45:20.384844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:20.385335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:20.386157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:20.386602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:20.404604 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Getting quotas for project 0e6a8f7f65fb4473bb5959c88ee7b03e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:45:20.410367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Getting quotas for user a175b2076a734c37b6596e0e6c543253 and project 0e6a8f7f65fb4473bb5959c88ee7b03e. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:45:20.426324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:45:20.428617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:45:20.475756 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-678feab0-0d08-4244-821e-677a00f9bb1a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656608 Apr 09 21:45:20.476773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3426/6826] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:45:20.487971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a18eee4a-b276-4f1b-8f17-b84650f4f719 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:20.488665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a18eee4a-b276-4f1b-8f17-b84650f4f719 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:20.542337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a18eee4a-b276-4f1b-8f17-b84650f4f719 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:20.549326 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a18eee4a-b276-4f1b-8f17-b84650f4f719 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1215 microversion: 2.1 time: 0.066541 Apr 09 21:45:20.549885 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3401/6827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:20 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:21.567752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:21.568355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:21.575402 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:21.575846 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:21.576839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:21.577492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:21.672002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:21.679633 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ec30cd86-271f-49de-895e-ed69fd20ce97 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1285 microversion: 2.1 time: 0.116802 Apr 09 21:45:21.680183 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3427/6828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:21 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:22.697158 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:22.697714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:22.704928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:22.705498 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:22.706308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:22.706762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:22.844005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-5218b0d2-3587-4c52-a7cd-5ba405a0f69a req-fda2ca2b-55d1-409e-bf66-065c5aaf7897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83c9840-4a3f-425c-a0c0-4fab86af3f02", "tag": "4f15b059-0f68-4702-a78c-c734c5493dca"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:22.854173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5218b0d2-3587-4c52-a7cd-5ba405a0f69a req-fda2ca2b-55d1-409e-bf66-065c5aaf7897 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:22.855512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-5218b0d2-3587-4c52-a7cd-5ba405a0f69a req-fda2ca2b-55d1-409e-bf66-065c5aaf7897 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:22.867499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-5218b0d2-3587-4c52-a7cd-5ba405a0f69a req-fda2ca2b-55d1-409e-bf66-065c5aaf7897 service nova] Creating event network-changed:4f15b059-0f68-4702-a78c-c734c5493dca for instance d83c9840-4a3f-425c-a0c0-4fab86af3f02 on nch1-master-1 Apr 09 21:45:22.873006 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-5218b0d2-3587-4c52-a7cd-5ba405a0f69a req-fda2ca2b-55d1-409e-bf66-065c5aaf7897 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033013 Apr 09 21:45:22.873838 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3428/6829] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:22.927013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:22.934845 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fb7ac94d-3de3-49ac-828b-17d3f71ea603 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.241999 Apr 09 21:45:22.935447 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3402/6830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:22 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:23.959533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:23.960302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:23.968126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:23.968627 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:23.969525 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:23.970008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:24.139243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:24.147296 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c0a7a8e-85af-4e25-bd5d-3d92f12d2c43 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.196270 Apr 09 21:45:24.147889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3429/6831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:23 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:25.166021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:25.166669 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:25.173598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:25.174062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:25.174864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:25.175312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:25.312300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:25.320319 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b7fbcb96-5562-4ef6-b40c-0221bbe98087 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.158970 Apr 09 21:45:25.320936 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3403/6832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:25 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:26.336958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:26.337946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:26.345827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:26.346282 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:26.347105 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:26.347546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:26.486364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:26.494072 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5174a942-a943-41e2-a91e-88aca13e0fb9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.161077 Apr 09 21:45:26.494673 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3430/6833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:26 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:27.516173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:27.517313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:27.526791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:27.527262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:27.528054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:27.528507 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:27.659774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:27.667655 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14521d20-8714-4d73-afe4-b955022b8ea7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.158252 Apr 09 21:45:27.668250 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3404/6834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:27 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:28.494514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-47fb8e81-8310-4c3f-b3ff-da8c790597ed req-b11e969b-fe1c-4c44-bc33-7cbf87b4cc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c9840-4a3f-425c-a0c0-4fab86af3f02", "name": "network-vif-plugged", "status": "completed", "tag": "4f15b059-0f68-4702-a78c-c734c5493dca"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:28.503412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-47fb8e81-8310-4c3f-b3ff-da8c790597ed req-b11e969b-fe1c-4c44-bc33-7cbf87b4cc0e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:28.503861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-47fb8e81-8310-4c3f-b3ff-da8c790597ed req-b11e969b-fe1c-4c44-bc33-7cbf87b4cc0e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:28.515223 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-47fb8e81-8310-4c3f-b3ff-da8c790597ed req-b11e969b-fe1c-4c44-bc33-7cbf87b4cc0e service nova] Creating event network-vif-plugged:4f15b059-0f68-4702-a78c-c734c5493dca for instance d83c9840-4a3f-425c-a0c0-4fab86af3f02 on nch1-master-1 Apr 09 21:45:28.520189 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-47fb8e81-8310-4c3f-b3ff-da8c790597ed req-b11e969b-fe1c-4c44-bc33-7cbf87b4cc0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029528 Apr 09 21:45:28.520805 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3431/6835] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:28.687079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:28.687726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:28.696706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:28.697196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:28.698015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:28.698471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:28.842385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:28.849926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1ad0ad27-a10b-4832-a355-48e41f48b6e9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1315 microversion: 2.1 time: 0.168891 Apr 09 21:45:28.850484 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3405/6836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:28 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:29.873398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:29.874551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:29.884465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:29.884916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:29.885714 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:29.886150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:30.023776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:30.034752 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bf652680-57e3-49e0-908a-614e6360c2a4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.170095 Apr 09 21:45:30.035541 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3432/6837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:29 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:30.092264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-110186235", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "2a40501d-47fe-44a0-88f2-78c99b33bdac"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:30.147682 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] validate_networks() for [('2a40501d-47fe-44a0-88f2-78c99b33bdac', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:45:30.577220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:45:30.577791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:45:30.578282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:45:30.578864 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:45:30.579463 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:45:30.591592 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:30.592058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:30.592867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:30.593345 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:30.610513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Getting quotas for project 0e6a8f7f65fb4473bb5959c88ee7b03e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:45:30.616086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Getting quotas for user a175b2076a734c37b6596e0e6c543253 and project 0e6a8f7f65fb4473bb5959c88ee7b03e. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:45:30.629334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:45:30.631603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:45:30.677537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2fe05c4-cee4-4b4b-a8ff-23f46b981bc4 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589182 Apr 09 21:45:30.682864 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3406/6838] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:45:30.688357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-926522bb-7c72-42bb-98dd-a25fe4282570 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:30.688967 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-926522bb-7c72-42bb-98dd-a25fe4282570 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:30.745532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-926522bb-7c72-42bb-98dd-a25fe4282570 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:30.752539 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-926522bb-7c72-42bb-98dd-a25fe4282570 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1216 microversion: 2.1 time: 0.068227 Apr 09 21:45:30.753774 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3433/6839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:30 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:31.770796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:31.771513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:31.779097 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:31.779632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:31.780681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:31.781352 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:31.921881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:31.930045 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-679887ae-9d9f-4a36-9cc4-79424d2fc4ca tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1274 microversion: 2.1 time: 0.164089 Apr 09 21:45:31.930902 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3407/6840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:31 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:32.904783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dee15420-fce6-4bca-bbb1-a0e405aa641a req-bf4b0757-aefe-495c-a21c-3b790dd4e523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c060087-cb3b-41f7-98c0-aeb22b9b14f9", "tag": "cacbaf11-bd3d-462e-ae76-917e11586e2d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:32.917011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dee15420-fce6-4bca-bbb1-a0e405aa641a req-bf4b0757-aefe-495c-a21c-3b790dd4e523 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:32.918033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dee15420-fce6-4bca-bbb1-a0e405aa641a req-bf4b0757-aefe-495c-a21c-3b790dd4e523 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:32.930982 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dee15420-fce6-4bca-bbb1-a0e405aa641a req-bf4b0757-aefe-495c-a21c-3b790dd4e523 service nova] Creating event network-changed:cacbaf11-bd3d-462e-ae76-917e11586e2d for instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 on nch2-master-1 Apr 09 21:45:32.935827 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dee15420-fce6-4bca-bbb1-a0e405aa641a req-bf4b0757-aefe-495c-a21c-3b790dd4e523 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034701 Apr 09 21:45:32.936570 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3434/6841] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:32.947768 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:32.948395 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:32.955414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:32.955871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:32.956668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:32.957169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:33.091320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:33.098965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-49100706-108c-4db9-a463-d55f130a34dd tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.155306 Apr 09 21:45:33.099556 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3408/6842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:32 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:34.116610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:34.117420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:34.125076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:34.125534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:34.126308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:34.126740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:34.555672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:34.563662 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-de8b2a3f-4337-4150-be58-76c30e8b148d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.451406 Apr 09 21:45:34.564249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3435/6843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:34 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:35.581953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:35.582686 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:35.590538 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:35.591035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:35.591830 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:35.592282 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:35.725915 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:35.733510 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed60a4a5-5ec9-4f2d-85a1-b6727f09c64a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.156881 Apr 09 21:45:35.734105 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3409/6844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:35 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:36.749691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:36.751014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:36.758793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:36.759275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:36.760287 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:36.760777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:36.902654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:36.910623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6e62a10-9479-426a-81ef-bad4918cde51 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.165146 Apr 09 21:45:36.911212 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3436/6845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:36 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:37.927805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:37.928473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:37.935970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:37.936439 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:37.937298 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:37.937758 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:38.074703 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:38.082924 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d25511ac-d961-4c15-9f86-3ef26b83270b tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.159151 Apr 09 21:45:38.083506 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3410/6846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:37 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:38.388783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-8f0c1242-d9c9-4489-89b1-4cd24f841c3d req-ce0426c3-75c5-44ad-982d-8844057c6c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c060087-cb3b-41f7-98c0-aeb22b9b14f9", "name": "network-vif-plugged", "status": "completed", "tag": "cacbaf11-bd3d-462e-ae76-917e11586e2d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:38.398935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8f0c1242-d9c9-4489-89b1-4cd24f841c3d req-ce0426c3-75c5-44ad-982d-8844057c6c2b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:38.399396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-8f0c1242-d9c9-4489-89b1-4cd24f841c3d req-ce0426c3-75c5-44ad-982d-8844057c6c2b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:38.410916 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-8f0c1242-d9c9-4489-89b1-4cd24f841c3d req-ce0426c3-75c5-44ad-982d-8844057c6c2b service nova] Creating event network-vif-plugged:cacbaf11-bd3d-462e-ae76-917e11586e2d for instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 on nch2-master-1 Apr 09 21:45:38.415800 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-8f0c1242-d9c9-4489-89b1-4cd24f841c3d req-ce0426c3-75c5-44ad-982d-8844057c6c2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030960 Apr 09 21:45:38.416442 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3437/6847] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:39.104135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:39.105347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:39.112654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:39.113264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:39.114065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:39.114522 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:39.254776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:39.262955 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ad978fbf-399d-4a1b-88e0-303e5ba06c31 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1316 microversion: 2.1 time: 0.165556 Apr 09 21:45:39.263554 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3411/6848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:39 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:40.286772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:40.287943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:40.296687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.297179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.297969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.298416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.437229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:40.445074 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-590ca94f-a021-46ed-aeee-5c001e9fdfce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1505 microversion: 2.1 time: 0.167537 Apr 09 21:45:40.445652 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3438/6849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:40 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:40.461421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:40.461951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:40.469595 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.470061 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.470865 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.471321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.496330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:45:40.576600 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9957eda8-5090-4c96-96cb-5ec4eb48de5e tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 204 len: 0 microversion: 2.1 time: 0.118751 Apr 09 21:45:40.577108 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3412/6850] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:40 2022] DELETE /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:45:40.586910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:40.587568 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:40.594185 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.594644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.595422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:40.595863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:40.730277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:40.742130 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9d35cb26-7ee4-48ca-aefc-54c991492542 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1511 microversion: 2.1 time: 0.159859 Apr 09 21:45:40.743021 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3439/6851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:40 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:41.761077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:41.761782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:41.768794 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:41.769290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:41.770073 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:41.770553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:41.910745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:41.919089 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-986c0ec3-872a-453b-b49d-2fcfefafafa7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 200 len: 1511 microversion: 2.1 time: 0.162372 Apr 09 21:45:41.919695 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3413/6852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:41 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:42.390424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-25793e48-58b6-4259-a5c0-320699b3d3c1 req-5266af28-eabe-472e-b622-7f2b4a1a5eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c060087-cb3b-41f7-98c0-aeb22b9b14f9", "name": "network-vif-deleted", "tag": "cacbaf11-bd3d-462e-ae76-917e11586e2d"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:42.400057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-25793e48-58b6-4259-a5c0-320699b3d3c1 req-5266af28-eabe-472e-b622-7f2b4a1a5eb2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:42.400605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-25793e48-58b6-4259-a5c0-320699b3d3c1 req-5266af28-eabe-472e-b622-7f2b4a1a5eb2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:42.421557 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-25793e48-58b6-4259-a5c0-320699b3d3c1 req-5266af28-eabe-472e-b622-7f2b4a1a5eb2 service nova] Creating event network-vif-deleted:cacbaf11-bd3d-462e-ae76-917e11586e2d for instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 on nch2-master-1 Apr 09 21:45:42.426511 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-25793e48-58b6-4259-a5c0-320699b3d3c1 req-5266af28-eabe-472e-b622-7f2b4a1a5eb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040777 Apr 09 21:45:42.427530 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3440/6853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:42.937162 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:42.938536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:42.945690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:42.946152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:42.946936 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:42.947359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:42.960567 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. Apr 09 21:45:42.961207 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 404 to user: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:42.962052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-76c199c4-b245-4f04-9aeb-6c0561e647d5 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 404 len: 111 microversion: 2.1 time: 0.029420 Apr 09 21:45:42.962632 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3414/6854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:42 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:42.973799 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:42.974529 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:42.981067 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:42.981542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:42.982310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:42.982753 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.118536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.126466 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2ca6eac-583f-4f65-bdc0-46ac71f12de8 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.157939 Apr 09 21:45:43.127084 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3441/6855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:42 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:43.143224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0abe0dab-ddc7-4063-a818-0d130a1240a7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:43.144461 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0abe0dab-ddc7-4063-a818-0d130a1240a7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 569240e4-3ad7-41cb-984d-844b81d8ada6] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.150206 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0abe0dab-ddc7-4063-a818-0d130a1240a7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Instance 569240e4-3ad7-41cb-984d-844b81d8ada6 could not be found. Apr 09 21:45:43.150886 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0abe0dab-ddc7-4063-a818-0d130a1240a7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 404 to user: Instance 569240e4-3ad7-41cb-984d-844b81d8ada6 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:43.151690 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0abe0dab-ddc7-4063-a818-0d130a1240a7 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "POST /compute/v2.1/servers/569240e4-3ad7-41cb-984d-844b81d8ada6/action" status: 404 len: 111 microversion: 2.1 time: 0.012657 Apr 09 21:45:43.152240 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3415/6856] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:45:43 2022] POST /compute/v2.1/servers/569240e4-3ad7-41cb-984d-844b81d8ada6/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:43.160612 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:43.161345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.167598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.168047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.168814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.169278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.306868 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.314552 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2a410ff4-6525-4e1d-938e-b2b7cd88c1bf tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.157921 Apr 09 21:45:43.315106 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3442/6857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:43 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:43.332750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:43.333400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.341313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.341775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.342585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.343028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.477247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.484963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-800d944f-4da8-4510-a0d7-a494f242dd66 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.156991 Apr 09 21:45:43.485644 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3416/6858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:43 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:43.501409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d98f5b24-8cf1-497b-9c20-14541d58acac"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:43.502392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.509351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.509801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.510562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.510995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.538807 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.544336 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Flavor d98f5b24-8cf1-497b-9c20-14541d58acac could not be found. Apr 09 21:45:43.544921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 400 to user: Flavor d98f5b24-8cf1-497b-9c20-14541d58acac could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:43.545780 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d9ab2597-0c2a-4de9-95c7-92005bfd4787 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "POST /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02/action" status: 400 len: 107 microversion: 2.1 time: 0.048500 Apr 09 21:45:43.546342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3443/6859] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:45:43 2022] POST /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02/action => generated 107 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:45:43.554928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:43.555553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.561727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.562182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.562958 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.563466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.697569 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.709455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-356a3479-4d9d-4899-b828-cfcacb66cbce tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.158013 Apr 09 21:45:43.710248 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3417/6860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:43 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:43.729995 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:43.730613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.737943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.738399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.739180 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.739624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.886190 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:43.894623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b095b28a-c397-4c6f-8d22-d077e0a7a6d2 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.168412 Apr 09 21:45:43.895050 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3444/6861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:43 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:43.910856 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6376a0e8-9228-4d1e-9453-57b1d3d3b571 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:43.912022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6376a0e8-9228-4d1e-9453-57b1d3d3b571 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:43.912838 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6376a0e8-9228-4d1e-9453-57b1d3d3b571 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "POST /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02/action" status: 400 len: 113 microversion: 2.1 time: 0.006224 Apr 09 21:45:43.913393 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3418/6862] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:45:43 2022] POST /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 21:45:43.921193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:43.921810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:43.928204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.928655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:43.929475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:43.929913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.061405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:44.069301 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5ed9e1d1-fd6e-4195-b218-53ca3e237485 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1503 microversion: 2.1 time: 0.151881 Apr 09 21:45:44.069889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3445/6863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:43 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:45:44.090269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:44.090826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:44.100273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.100748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.101583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.102047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.115218 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. Apr 09 21:45:44.115820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 404 to user: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:44.116668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cc9fbe09-90b5-4716-bd7c-f7b7505e4224 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 404 len: 111 microversion: 2.1 time: 0.031608 Apr 09 21:45:44.117239 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3419/6864] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:44 2022] DELETE /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:44.125766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:44.126394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: 2c060087-cb3b-41f7-98c0-aeb22b9b14f9] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:44.132602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.133061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.133860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.134300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.148164 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. Apr 09 21:45:44.148664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 404 to user: Instance 2c060087-cb3b-41f7-98c0-aeb22b9b14f9 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:44.149513 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb129271-e3d0-48cb-9b34-d59b3d46a3ff tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9" status: 404 len: 111 microversion: 2.1 time: 0.027797 Apr 09 21:45:44.150025 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3446/6865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:44 2022] GET /compute/v2.1/servers/2c060087-cb3b-41f7-98c0-aeb22b9b14f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:45:44.158316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:44.158834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:44.164928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.165539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.166312 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.166755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.190902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:45:44.286752 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf10f024-f91e-4983-8ca8-a1de81af2c65 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 204 len: 0 microversion: 2.1 time: 0.132122 Apr 09 21:45:44.287364 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3420/6866] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:45:44 2022] DELETE /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:45:44.297577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:44.298691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:44.307835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.308457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.309624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:44.310197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:44.448195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:44.456434 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7bd930af-b166-44c0-bfa3-7120905f95b9 tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1509 microversion: 2.1 time: 0.164021 Apr 09 21:45:44.456998 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3447/6867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:44 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:45.475020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:45.475745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:45.483267 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:45.483741 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:45.484541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:45.484997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:45.617531 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a175b2076a734c37b6596e0e6c543253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a8f7f65fb4473bb5959c88ee7b03e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:45:45.629542 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a6f80ee4-8b84-4466-a25d-b7fc3675302a tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 200 len: 1509 microversion: 2.1 time: 0.158569 Apr 09 21:45:45.630434 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3421/6868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:45 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:45:46.140163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c9582c6c-3e50-4776-ad35-b9349a87083c req-785cb938-6871-4438-a867-298662a0e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83c9840-4a3f-425c-a0c0-4fab86af3f02", "name": "network-vif-deleted", "tag": "4f15b059-0f68-4702-a78c-c734c5493dca"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:45:46.149406 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c9582c6c-3e50-4776-ad35-b9349a87083c req-785cb938-6871-4438-a867-298662a0e6c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:46.149861 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c9582c6c-3e50-4776-ad35-b9349a87083c req-785cb938-6871-4438-a867-298662a0e6c1 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:46.161708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c9582c6c-3e50-4776-ad35-b9349a87083c req-785cb938-6871-4438-a867-298662a0e6c1 service nova] Creating event network-vif-deleted:4f15b059-0f68-4702-a78c-c734c5493dca for instance d83c9840-4a3f-425c-a0c0-4fab86af3f02 on nch1-master-1 Apr 09 21:45:46.166796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c9582c6c-3e50-4776-ad35-b9349a87083c req-785cb938-6871-4438-a867-298662a0e6c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030476 Apr 09 21:45:46.167422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3448/6869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:45:46.651137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:45:46.651777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] [instance: d83c9840-4a3f-425c-a0c0-4fab86af3f02] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:45:46.659246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:46.659770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:46.660585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:45:46.661246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:45:46.675091 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] HTTP exception thrown: Instance d83c9840-4a3f-425c-a0c0-4fab86af3f02 could not be found. Apr 09 21:45:46.675711 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] Returning 404 to user: Instance d83c9840-4a3f-425c-a0c0-4fab86af3f02 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:45:46.676582 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-623459f6-bc00-4843-8a6f-4060f446d83d tempest-ServersNegativeTestJSON-2103017953 tempest-ServersNegativeTestJSON-2103017953-project] 10.222.0.30 "GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02" status: 404 len: 111 microversion: 2.1 time: 0.029695 Apr 09 21:45:46.677289 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3422/6870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:45:46 2022] GET /compute/v2.1/servers/d83c9840-4a3f-425c-a0c0-4fab86af3f02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:46:24.578383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'create', calling method: .version_select at 0x7fb08ef7f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1962189652"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:24.594252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for project 4071a76a44224683a79239cce8574953. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:46:24.599863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for user 93a7d4f90ba64dcfaf84d65638e1a652 and project 4071a76a44224683a79239cce8574953. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:46:24.620433 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 21:46:25.633124 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 47952. Apr 09 21:46:25.890278 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for project 4071a76a44224683a79239cce8574953. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:46:25.895581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for user 93a7d4f90ba64dcfaf84d65638e1a652 and project 4071a76a44224683a79239cce8574953. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:46:25.910570 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ce39c90-f906-40d7-93f2-291bdb1102a9 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.337920 Apr 09 21:46:25.911200 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3449/6871] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:46:24 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:46:25.962844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1263478953", "imageRef": "9217d583-c0c2-455a-9f19-de94b2bdc0ae", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1962189652", "networks": [{"uuid": "f35b8989-1bc2-4914-850b-5815c7d95dd9"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:26.018350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] validate_networks() for [('f35b8989-1bc2-4914-850b-5815c7d95dd9', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:46:26.392757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:46:26.393248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:46:26.393750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:46:26.394179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:46:26.394608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:46:26.404930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:26.405348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:26.406174 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:26.406621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:26.425552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for project 4071a76a44224683a79239cce8574953. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:46:26.430816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Getting quotas for user 93a7d4f90ba64dcfaf84d65638e1a652 and project 4071a76a44224683a79239cce8574953. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:46:26.443570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:46:26.445870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9217d583-c0c2-455a-9f19-de94b2bdc0ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:46:26.491980 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d7b9e0e-101f-4135-ab1d-b50b740e53fd tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536028 Apr 09 21:46:26.492632 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3423/6872] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:46:26.502730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-36248449-419e-4e37-87d1-f7d78fc273b2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:26.503594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-36248449-419e-4e37-87d1-f7d78fc273b2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:26.740871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-36248449-419e-4e37-87d1-f7d78fc273b2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:26.747882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-36248449-419e-4e37-87d1-f7d78fc273b2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1259 microversion: 2.1 time: 0.249249 Apr 09 21:46:26.748574 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3450/6873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:26 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:27.767085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:27.767589 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:27.774746 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:27.775597 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:27.776612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:27.777528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:27.875706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:27.891945 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89efc96c-b2fa-4178-a4b4-243e467170e1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1317 microversion: 2.1 time: 0.126463 Apr 09 21:46:27.893373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3424/6874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:27 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1317 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:28.911085 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:28.911910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:28.925778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:28.926235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:28.927037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:28.927488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:29.066298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:29.074803 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5a39f0d1-0947-418c-966b-b681b2acdcea tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.168042 Apr 09 21:46:29.075565 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3451/6875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:28 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:46:30.092724 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:30.093406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:30.100555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:30.101611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:30.103018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:30.103555 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:30.259858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:30.267855 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-533bead3-fb52-4de1-9fcb-5c48123cacd5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.179586 Apr 09 21:46:30.268489 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3425/6876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:30 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:31.286080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:31.286792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:31.294131 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:31.294593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:31.295389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:31.295832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:31.435825 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:31.445722 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3a00a747-b13a-4ffa-8dca-d6b0269ef7d0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.163939 Apr 09 21:46:31.446328 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3452/6877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:31 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:32.462600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:32.464303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:32.472705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:32.473226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:32.474015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:32.474785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:32.614478 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:32.622735 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02fe4d4c-cc55-46ff-8b4b-4f0955b48a04 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.164042 Apr 09 21:46:32.623347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3426/6878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:32 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:33.641352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:33.643063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:33.651467 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:33.652104 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:33.653358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:33.653863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:33.807637 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:33.815659 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8425c256-8668-4dee-8de2-9a640a9d5d8b tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.179549 Apr 09 21:46:33.816250 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3453/6879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:33 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:34.834775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:34.835508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:34.843049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:34.843553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:34.844561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:34.845260 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:34.977817 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:34.985497 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-526bd81e-1a70-4ad0-b246-3e9a3f60f190 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.155086 Apr 09 21:46:34.986073 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3427/6880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:34 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:36.003881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:36.004302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:36.011146 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:36.011601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:36.012447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:36.012827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:36.223222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-45c5b90d-194c-455d-8dc4-4c0134b0a123 req-397be11a-f842-453f-a3af-4f7698a85153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:36.230746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:36.238010 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-45c5b90d-194c-455d-8dc4-4c0134b0a123 req-397be11a-f842-453f-a3af-4f7698a85153 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:36.238887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-45c5b90d-194c-455d-8dc4-4c0134b0a123 req-397be11a-f842-453f-a3af-4f7698a85153 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:36.240961 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f2f7b2d1-25f4-42d4-98c8-148fddb14a7d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.241513 Apr 09 21:46:36.241846 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3454/6881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:35 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:46:36.264764 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-45c5b90d-194c-455d-8dc4-4c0134b0a123 req-397be11a-f842-453f-a3af-4f7698a85153 service nova] Creating event network-changed:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:46:36.273270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-45c5b90d-194c-455d-8dc4-4c0134b0a123 req-397be11a-f842-453f-a3af-4f7698a85153 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055579 Apr 09 21:46:36.274177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3428/6882] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:46:37.262100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:37.263121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:37.272798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:37.273373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:37.274163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:37.274610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:37.411501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:37.419639 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e77b2b4a-ee2d-4f1c-a427-c157fa0d6f55 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.164220 Apr 09 21:46:37.420232 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3455/6883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:37 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:38.443315 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:38.444428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:38.450823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:38.451313 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:38.452102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:38.452545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:38.585770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:38.593991 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ab711ab8-dbe2-4716-9070-6c5db67310b0 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.157891 Apr 09 21:46:38.594568 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3429/6884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:38 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:39.615166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:39.615820 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:39.624364 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:39.624895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:39.625857 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:39.626375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:39.764617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:39.774979 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-345eb6ec-5742-45d9-ad39-a7af93aaa416 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.165971 Apr 09 21:46:39.775711 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3456/6885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:39 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:40.798416 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:40.799103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:40.810038 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:40.810772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:40.812066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:40.812852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:40.947195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:40.954627 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f6cb9fd6-3fa7-4857-aa02-d077a28020a8 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.163700 Apr 09 21:46:40.955207 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3430/6886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:40 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:40.974299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e0f38c9e-62ef-4cad-83d8-9c5d466ff967 req-94af1ddb-7dd7-4b75-ab08-04f4df8c0a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "name": "network-vif-plugged", "status": "completed", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:40.984229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e0f38c9e-62ef-4cad-83d8-9c5d466ff967 req-94af1ddb-7dd7-4b75-ab08-04f4df8c0a0b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:40.984684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e0f38c9e-62ef-4cad-83d8-9c5d466ff967 req-94af1ddb-7dd7-4b75-ab08-04f4df8c0a0b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:40.996033 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e0f38c9e-62ef-4cad-83d8-9c5d466ff967 req-94af1ddb-7dd7-4b75-ab08-04f4df8c0a0b service nova] Creating event network-vif-plugged:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:46:41.001023 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e0f38c9e-62ef-4cad-83d8-9c5d466ff967 req-94af1ddb-7dd7-4b75-ab08-04f4df8c0a0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030618 Apr 09 21:46:41.001658 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3457/6887] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:46:41.971685 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:41.972347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:41.979748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:41.980212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:41.981020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:41.981517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:42.123646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:42.131842 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1a7e061e-d131-4e9e-b8e5-1da52422e90d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1359 microversion: 2.1 time: 0.164107 Apr 09 21:46:42.132635 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3431/6888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:41 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:43.156033 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:43.158358 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:43.169439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.170214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.171512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.172252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.321911 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:43.333477 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-39b1830a-bbec-4816-92ea-28468eee5115 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1549 microversion: 2.1 time: 0.185936 Apr 09 21:46:43.334085 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3458/6889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:43 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:43.349932 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:43.350586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:43.357877 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.358338 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.359124 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.359572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.489063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:43.496856 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f4851117-7f65-4bb4-a895-0aee94429167 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1549 microversion: 2.1 time: 0.150940 Apr 09 21:46:43.497467 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3432/6890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:43 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:43.512680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:43.515993 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:43.516770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Searching by: {'deleted': False, 'project_id': '4071a76a44224683a79239cce8574953'} {{(pid=141818) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 09 21:46:43.522454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.522952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.523771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.524205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.547776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.multi_cell_list [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 09 21:46:43.573842 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d801ef06-8b53-48f2-b01c-c72de3d59e57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.065027 Apr 09 21:46:43.574423 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3459/6891] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Apr 9 21:46:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:46:43.587692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:43.588358 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:43.595641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.596112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.596912 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:43.597405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:43.736875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:43.748240 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-206ef5bc-6ed0-4aa3-a9c0-111b94ac00d2 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1549 microversion: 2.1 time: 0.164368 Apr 09 21:46:43.749061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3433/6892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:43 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:45.280223 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd5af3d-2661-42d8-95fb-819d1da6c9bc"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:45.281337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:45.288713 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:45.289208 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:45.289982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:45.290422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:45.537503 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-84096929-15c5-4883-8748-4ce17a4cedeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261108 Apr 09 21:46:45.538131 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3460/6893] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Apr 9 21:46:45 2022] POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:46:48.906262 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:48.906956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:48.916943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:48.917731 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:48.918532 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:48.918987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:49.053016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:49.061186 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8d463d4b-a241-472e-be95-ed18120cbf90 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1595 microversion: 2.1 time: 0.160873 Apr 09 21:46:49.061772 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3434/6894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:48 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:46:50.808522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9337195d-93c4-4e72-95f4-3a974100c0c3 req-041688b8-1ee7-49c8-8720-0fb5c3cf42fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:50.816776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9337195d-93c4-4e72-95f4-3a974100c0c3 req-041688b8-1ee7-49c8-8720-0fb5c3cf42fe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:50.817265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9337195d-93c4-4e72-95f4-3a974100c0c3 req-041688b8-1ee7-49c8-8720-0fb5c3cf42fe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:50.829473 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9337195d-93c4-4e72-95f4-3a974100c0c3 req-041688b8-1ee7-49c8-8720-0fb5c3cf42fe service nova] Creating event network-changed:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:46:50.835623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9337195d-93c4-4e72-95f4-3a974100c0c3 req-041688b8-1ee7-49c8-8720-0fb5c3cf42fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Apr 09 21:46:50.836465 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3461/6895] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:46:51.987135 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1001715429"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:51.987698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:51.994913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:51.995409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:51.996340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:51.996792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:52.133395 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.network.security_group_api [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Adding security group 3a8d00a1-00f4-48e3-80d0-d9397787db37 to port a6c903c2-ef44-4500-8808-b2a2a27498f1 Apr 09 21:46:52.502411 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14517019-5884-4d26-91e8-5384549c601c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action" status: 202 len: 0 microversion: 2.1 time: 0.518437 Apr 09 21:46:52.509231 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3435/6896] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:46:51 2022] POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:46:52.512909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:46:52.514935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:46:52.535530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:52.536013 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:52.536852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:52.537323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:52.723880 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:46:52.738763 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bb31c776-0b24-4934-9125-ff169b4f6723 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1761 microversion: 2.1 time: 0.230350 Apr 09 21:46:52.739541 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3462/6897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:46:52 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1761 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:46:52.851293 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c764d6f8-c93d-4338-ab26-c1b7e0b24eb8 req-1ce15b8a-6a95-40ac-8e45-b6b647d3101e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:46:52.860143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c764d6f8-c93d-4338-ab26-c1b7e0b24eb8 req-1ce15b8a-6a95-40ac-8e45-b6b647d3101e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:46:52.860619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c764d6f8-c93d-4338-ab26-c1b7e0b24eb8 req-1ce15b8a-6a95-40ac-8e45-b6b647d3101e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:46:52.872140 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c764d6f8-c93d-4338-ab26-c1b7e0b24eb8 req-1ce15b8a-6a95-40ac-8e45-b6b647d3101e service nova] Creating event network-changed:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:46:52.877455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c764d6f8-c93d-4338-ab26-c1b7e0b24eb8 req-1ce15b8a-6a95-40ac-8e45-b6b647d3101e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029888 Apr 09 21:46:52.878159 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3436/6898] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:47:18.407728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:47:18.409414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:18.419875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:18.420324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:18.421123 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:18.421561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:18.501606 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6ab00aa-66a1-475b-82fb-f94088c8a774 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action" status: 202 len: 0 microversion: 2.1 time: 0.100332 Apr 09 21:47:18.502281 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3463/6899] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:47:18 2022] POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:47:18.512443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:18.513317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:18.519964 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:18.520437 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:18.521261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:18.521725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:18.752188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:18.760595 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6e61054d-5601-43f6-8bd9-a6f3095499f1 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1753 microversion: 2.1 time: 0.253632 Apr 09 21:47:18.761286 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3437/6900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:18 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:47:19.785253 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:19.786417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:19.795772 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:19.796226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:19.797005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:19.797479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:19.953455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:19.964184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-df9eaa90-9d64-42fb-843c-0908996cf509 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.187802 Apr 09 21:47:19.965048 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3464/6901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:19 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:20.988331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:20.988993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:20.996512 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:20.996972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:20.997795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:20.998249 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:21.156085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:21.168717 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6deaee5f-bd40-44b0-a206-26a369a1860c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.184175 Apr 09 21:47:21.169663 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3438/6902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:20 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:22.194483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:22.195501 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:22.207079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:22.207766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:22.209093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:22.209832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:22.357657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:22.365955 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-eab98191-83e9-4362-9a46-348fa36107e7 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.178140 Apr 09 21:47:22.366538 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3465/6903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:22 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:23.387933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:23.388840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:23.400481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:23.401302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:23.402647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:23.403393 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:23.552442 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:23.561025 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-90ed21f0-9e7d-4df7-aa95-5af1da27d0e5 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.180241 Apr 09 21:47:23.561664 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3439/6904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:23 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:24.579149 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:24.579742 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:24.586877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:24.587322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:24.588111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:24.588552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:24.754614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:24.763524 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4078b7a-5cab-4817-8dab-f14052ff5f47 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.188518 Apr 09 21:47:24.764089 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3466/6905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:24 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:25.784503 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:25.785256 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:25.793918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:25.794483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:25.795409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:25.795996 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:25.946885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:25.956629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ceeca3bc-5874-40f5-b865-7e0fb222103f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.177817 Apr 09 21:47:25.957544 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3440/6906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:25 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:26.980237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:26.981259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:26.989929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:26.990385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:26.991158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:26.991589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:27.147191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:27.155490 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a423579a-6889-4468-b795-fd21a613e96d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.181837 Apr 09 21:47:27.156099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3467/6907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:26 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:28.180481 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:28.181552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:28.191232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:28.191693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:28.192474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:28.192948 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:28.335431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:28.349629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0d930d0c-7074-4b4c-a7ea-218c268a1662 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.175647 Apr 09 21:47:28.350522 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3441/6908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:28 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:29.370732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:29.371353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:29.378554 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:29.378999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:29.379778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:29.380217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:29.585601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:29.594710 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-848a2bcd-6689-453f-b1af-1f9cc9c3067f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.228072 Apr 09 21:47:29.595303 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3468/6909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:29 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:30.614757 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:30.615432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:30.624016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:30.624535 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:30.625448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:30.625966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:30.777018 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:30.789219 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd4bb763-3a3a-4084-b5ef-bc7ef89d209c tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.179504 Apr 09 21:47:30.789991 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3442/6910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:30 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:31.807154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:31.807787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:31.815255 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:31.815666 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:31.816486 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:31.816924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:31.960248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:31.968719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3b3b806-d3ca-4ae2-8c5c-92e229f46e41 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.165693 Apr 09 21:47:31.969322 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3469/6911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:31 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:32.989894 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:32.990645 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:32.999076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:33.000356 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:33.000572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:33.001191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:33.162696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:33.171327 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-85d5c6c6-b5bd-454d-8ae0-f2ddaed950c6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.187800 Apr 09 21:47:33.171953 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3443/6912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:32 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:34.193369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:34.194421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:34.205978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:34.206458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:34.207299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:34.207669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:34.358040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:34.368868 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76c2360e-fb85-40b1-9e4e-3c9f0f7c05e6 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1758 microversion: 2.1 time: 0.182277 Apr 09 21:47:34.369495 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3470/6913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:34 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:47:35.391142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:47:35.391774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:47:35.399117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:35.399579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:35.400363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:47:35.400807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:47:35.551417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:47:35.560315 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-89b36b7f-78d7-4db0-9978-8c06f0982bdc tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1761 microversion: 2.1 time: 0.173322 Apr 09 21:47:35.560905 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3444/6914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:47:35 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1761 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:07.641777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1001715429"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:07.642438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:07.649074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:07.649549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:07.650327 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:07.650767 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:07.785588 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.network.security_group_api [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Removing security group 3a8d00a1-00f4-48e3-80d0-d9397787db37 from port a6c903c2-ef44-4500-8808-b2a2a27498f1 Apr 09 21:48:08.146002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dbf014d9-0d45-4ed9-a6fe-1ffc4cabec57 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action" status: 202 len: 0 microversion: 2.1 time: 0.509785 Apr 09 21:48:08.147388 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3471/6915] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:48:07 2022] POST /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:48:08.164029 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-78ab1a06-c783-44bf-8f47-3ea1f89d2158 req-e693d5d1-81f7-4cff-b0ea-0ebf51e06bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:08.195350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-78ab1a06-c783-44bf-8f47-3ea1f89d2158 req-e693d5d1-81f7-4cff-b0ea-0ebf51e06bb5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:08.195816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-78ab1a06-c783-44bf-8f47-3ea1f89d2158 req-e693d5d1-81f7-4cff-b0ea-0ebf51e06bb5 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:08.215372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-78ab1a06-c783-44bf-8f47-3ea1f89d2158 req-e693d5d1-81f7-4cff-b0ea-0ebf51e06bb5 service nova] Creating event network-changed:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:48:08.233279 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-78ab1a06-c783-44bf-8f47-3ea1f89d2158 req-e693d5d1-81f7-4cff-b0ea-0ebf51e06bb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078802 Apr 09 21:48:08.238175 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3445/6916] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:09.562151 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:09.562773 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:09.563648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8cbca0bd-3b5e-4459-b4d4-a0a6a23b5713 req-a0e22a57-16c8-4df0-969e-cf72d2169833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:09.569479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:09.569938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:09.570701 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:09.571363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:09.572844 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8cbca0bd-3b5e-4459-b4d4-a0a6a23b5713 req-a0e22a57-16c8-4df0-969e-cf72d2169833 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:09.573351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8cbca0bd-3b5e-4459-b4d4-a0a6a23b5713 req-a0e22a57-16c8-4df0-969e-cf72d2169833 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:09.585225 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8cbca0bd-3b5e-4459-b4d4-a0a6a23b5713 req-a0e22a57-16c8-4df0-969e-cf72d2169833 service nova] Creating event network-changed:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:48:09.590813 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8cbca0bd-3b5e-4459-b4d4-a0a6a23b5713 req-a0e22a57-16c8-4df0-969e-cf72d2169833 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031208 Apr 09 21:48:09.594682 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3446/6917] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:09.655440 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lazy-loading 'services' on Instance uuid 56498e6d-255b-4230-8c0a-ea29c7e1ed5e {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:48:09.740758 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3a8775d-08aa-403c-b5ae-57d7c991b38f tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments/6cd5af3d-2661-42d8-95fb-819d1da6c9bc" status: 202 len: 0 microversion: 2.1 time: 0.183536 Apr 09 21:48:09.742284 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3472/6918] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:48:09 2022] DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments/6cd5af3d-2661-42d8-95fb-819d1da6c9bc => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:48:09.760314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:09.761582 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:09.769634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:09.770222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:09.771173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:09.771784 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:09.806030 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1f061c70-a854-4b4c-9d12-4fbc682551bf tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050076 Apr 09 21:48:09.810672 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3447/6919] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:48:09 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:10.825252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:10.826875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:10.837793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:10.838548 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:10.839835 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:10.840574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:10.869719 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da0bd549-2ddb-42ec-8398-e1771aeb9e06 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053530 Apr 09 21:48:10.870280 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3473/6920] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Apr 9 21:48:10 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 21:48:10.880656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:10.881222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:10.888443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:10.888921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:10.889770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:10.890229 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:10.971920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] HTTP exception thrown: Instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e is not attached to volume 6cd5af3d-2661-42d8-95fb-819d1da6c9bc Apr 09 21:48:10.972542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Returning 404 to user: Instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e is not attached to volume 6cd5af3d-2661-42d8-95fb-819d1da6c9bc {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:48:10.973455 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4c9ea93c-782a-4826-bdb9-ef7b6c0de04d tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments/6cd5af3d-2661-42d8-95fb-819d1da6c9bc" status: 404 len: 154 microversion: 2.1 time: 0.096947 Apr 09 21:48:10.974023 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3448/6921] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Apr 9 21:48:10 2022] DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e/os-volume_attachments/6cd5af3d-2661-42d8-95fb-819d1da6c9bc => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:48:12.120938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:12.121522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:12.128881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:12.129373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:12.130172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:12.130647 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:12.160676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:48:12.242786 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7fa80b0-6d9d-406c-a289-6ecd8180d804 tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 204 len: 0 microversion: 2.1 time: 0.125608 Apr 09 21:48:12.243318 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3474/6922] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:48:12 2022] DELETE /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:48:12.252092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:12.252843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:12.263112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:12.263676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:12.264480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:12.264943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:12.401062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:12.409195 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-39bfeb05-b40d-4781-9505-1b52b7a1f0ff tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1555 microversion: 2.1 time: 0.161165 Apr 09 21:48:12.409778 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3449/6923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:12 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:13.436796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:13.438054 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:13.449394 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:13.450161 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:13.451435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:13.452162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:13.594437 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:13.602803 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0c491472-6377-45a1-a5f8-a39bd07bb7ae tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1555 microversion: 2.1 time: 0.173290 Apr 09 21:48:13.603468 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3475/6924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:13 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:14.431551 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-403c1c05-9134-4593-b015-c2d96f3f8422 req-35b034f5-4b3c-4e04-ba32-eb25e42c3075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56498e6d-255b-4230-8c0a-ea29c7e1ed5e", "name": "network-vif-deleted", "tag": "a6c903c2-ef44-4500-8808-b2a2a27498f1"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:14.442284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-403c1c05-9134-4593-b015-c2d96f3f8422 req-35b034f5-4b3c-4e04-ba32-eb25e42c3075 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:14.442798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-403c1c05-9134-4593-b015-c2d96f3f8422 req-35b034f5-4b3c-4e04-ba32-eb25e42c3075 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:14.456718 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-403c1c05-9134-4593-b015-c2d96f3f8422 req-35b034f5-4b3c-4e04-ba32-eb25e42c3075 service nova] Creating event network-vif-deleted:a6c903c2-ef44-4500-8808-b2a2a27498f1 for instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e on nch1-master-1 Apr 09 21:48:14.462571 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-403c1c05-9134-4593-b015-c2d96f3f8422 req-35b034f5-4b3c-4e04-ba32-eb25e42c3075 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Apr 09 21:48:14.463255 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3450/6925] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:14.624280 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:14.625210 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:14.632822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:14.633307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:14.634093 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:14.634535 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:14.668599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:14.668969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:14.669458 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lazy-loading 'fault' on Instance uuid 56498e6d-255b-4230-8c0a-ea29c7e1ed5e {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:48:14.711950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a7d4f90ba64dcfaf84d65638e1a652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4071a76a44224683a79239cce8574953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:14.720436 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c5fc9a1a-98f8-4ddc-b807-6b712f2fffeb tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 200 len: 1349 microversion: 2.1 time: 0.102916 Apr 09 21:48:14.721126 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3476/6926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:14 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:15.744491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:15.745727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] [instance: 56498e6d-255b-4230-8c0a-ea29c7e1ed5e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:15.754537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:15.755015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:15.755818 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:15.756274 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:15.770052 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] HTTP exception thrown: Instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e could not be found. Apr 09 21:48:15.770660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Returning 404 to user: Instance 56498e6d-255b-4230-8c0a-ea29c7e1ed5e could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:48:15.771505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4f52a34c-640f-4d6a-b3af-0ff770f7feef tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e" status: 404 len: 111 microversion: 2.1 time: 0.035751 Apr 09 21:48:15.772061 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3451/6927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:15 2022] GET /compute/v2.1/servers/56498e6d-255b-4230-8c0a-ea29c7e1ed5e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:48:15.780695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1cb6451c-ea18-46f4-a4ee-732f4788091a tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] Calling method '.version_select at 0x7fb08ef7f670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:15.803392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1cb6451c-ea18-46f4-a4ee-732f4788091a tempest-TestMinimumBasicScenario-1285877756 tempest-TestMinimumBasicScenario-1285877756-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1962189652" status: 202 len: 0 microversion: 2.1 time: 0.026681 Apr 09 21:48:15.803977 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3477/6928] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Apr 9 21:48:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1962189652 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:48:17.821826 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:48:17.822389 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:48:21.064384 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:48:21.064950 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:48:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:48:25.456098 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: .version_select at 0x7fb08e0e0ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-56837015"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:25.471872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:48:25.477767 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:48:25.637766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:48:25.642919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:48:25.657511 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20ef23d4-62e3-4356-ace0-7db30ff2f860 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.375662 Apr 09 21:48:25.658152 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3452/6929] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:48:25 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:31.903036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-716834737", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "9bd917b1-1e8d-467f-92ce-404254234549"}], "key_name": "tempest-TestNetworkAdvancedServerOps-56837015", "security_groups": [{"name": "tempest-secgroup-smoke-705141833"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:32.021829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] validate_networks() for [('9bd917b1-1e8d-467f-92ce-404254234549', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:48:32.458334 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:48:32.458689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:48:32.459156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:48:32.459543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:48:32.459970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:48:32.468705 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:32.469186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:32.470319 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:32.470749 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:32.487241 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:48:32.492417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:48:32.504761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:48:32.506951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:48:32.556881 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-58a2141d-3097-4f68-98e2-916adf88106c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.658960 Apr 09 21:48:32.557752 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3478/6930] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:48:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:48:32.569705 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c8ed5101-535a-42a7-b6f9-40f850efd7c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:32.571195 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c8ed5101-535a-42a7-b6f9-40f850efd7c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:32.636184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c8ed5101-535a-42a7-b6f9-40f850efd7c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:32.643345 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c8ed5101-535a-42a7-b6f9-40f850efd7c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1264 microversion: 2.1 time: 0.079145 Apr 09 21:48:32.643945 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3453/6931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:32 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1264 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:33.661152 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:33.661778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:33.669078 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:33.669532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:33.670541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:33.671274 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:33.749593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:33.759968 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c9408af0-3458-4bfe-8792-5de1d667dacc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1324 microversion: 2.1 time: 0.103650 Apr 09 21:48:33.761077 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3479/6932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:33 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1324 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:34.777388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:34.778604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:34.786259 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:34.787060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:34.787870 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:34.788492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:34.925892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:34.933470 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d7b2cbac-e3ad-472e-b58c-550073c1c4e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.159989 Apr 09 21:48:34.934072 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3454/6933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:34 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:35.242725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3ab481bd-dab3-4cc3-9e4c-f686d20cdd1f req-9577c870-a9b8-4774-a03a-6d0e38cad225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00b8d01-d71a-4456-a5a9-92d096e8106e", "tag": "f76d6736-6440-4883-a120-8d719eacbfbd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:35.263553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ab481bd-dab3-4cc3-9e4c-f686d20cdd1f req-9577c870-a9b8-4774-a03a-6d0e38cad225 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:35.264034 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3ab481bd-dab3-4cc3-9e4c-f686d20cdd1f req-9577c870-a9b8-4774-a03a-6d0e38cad225 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:35.285573 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3ab481bd-dab3-4cc3-9e4c-f686d20cdd1f req-9577c870-a9b8-4774-a03a-6d0e38cad225 service nova] Creating event network-changed:f76d6736-6440-4883-a120-8d719eacbfbd for instance c00b8d01-d71a-4456-a5a9-92d096e8106e on nch2-master-1 Apr 09 21:48:35.291377 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3ab481bd-dab3-4cc3-9e4c-f686d20cdd1f req-9577c870-a9b8-4774-a03a-6d0e38cad225 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057997 Apr 09 21:48:35.293393 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3480/6934] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:35.955032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:35.956049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:35.967764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:35.968550 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:35.970299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:35.971120 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:36.110296 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:36.117931 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17faa53f-3a35-47b5-9b6f-0dd7cf2a2640 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.169629 Apr 09 21:48:36.118515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3455/6935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:35 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:37.141465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:37.142632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:37.150346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:37.150806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:37.151596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:37.152070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:37.293795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:37.304887 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-726fc615-f4ed-4e21-9fc6-086b4d6ea750 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.171975 Apr 09 21:48:37.305608 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3481/6936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:37 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:38.325961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:38.326572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:38.333795 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:38.334273 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:38.335039 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:38.335486 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:38.480247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:38.488268 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fc0e9761-2210-424b-b04a-5a81c145be8d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.166494 Apr 09 21:48:38.488905 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3456/6937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:38 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:39.505221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:39.505791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:39.512998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:39.513482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:39.514257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:39.514691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:39.656184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:39.664438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4632fa3e-38c2-4218-8c07-e3bdc177ff81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.163220 Apr 09 21:48:39.673723 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3482/6938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:39 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:40.687956 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:40.689134 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:40.699526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:40.700175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:40.701513 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:40.702264 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:40.841698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:40.849558 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7a2a210f-9ae6-4a6e-9bd2-1907e10890e7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.169832 Apr 09 21:48:40.850131 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3457/6939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:40 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:41.235991 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-566d5e12-e457-4a87-a8cd-54c4717818ea req-5c0ecb2c-6e2d-4661-b770-2c778c0ef1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00b8d01-d71a-4456-a5a9-92d096e8106e", "name": "network-vif-plugged", "status": "completed", "tag": "f76d6736-6440-4883-a120-8d719eacbfbd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:41.245055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-566d5e12-e457-4a87-a8cd-54c4717818ea req-5c0ecb2c-6e2d-4661-b770-2c778c0ef1cf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:41.245520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-566d5e12-e457-4a87-a8cd-54c4717818ea req-5c0ecb2c-6e2d-4661-b770-2c778c0ef1cf service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:41.257019 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-566d5e12-e457-4a87-a8cd-54c4717818ea req-5c0ecb2c-6e2d-4661-b770-2c778c0ef1cf service nova] Creating event network-vif-plugged:f76d6736-6440-4883-a120-8d719eacbfbd for instance c00b8d01-d71a-4456-a5a9-92d096e8106e on nch2-master-1 Apr 09 21:48:41.262107 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-566d5e12-e457-4a87-a8cd-54c4717818ea req-5c0ecb2c-6e2d-4661-b770-2c778c0ef1cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029954 Apr 09 21:48:41.262690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3483/6940] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:41.870943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:41.871909 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:41.882521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:41.882984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:41.883764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:41.884210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:42.022970 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:42.030801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3fe172b5-6d7d-4538-be02-d1d38e44c40b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1389 microversion: 2.1 time: 0.166623 Apr 09 21:48:42.031384 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3458/6941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:41 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:43.054111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:43.054852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:43.062438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:43.062942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:43.063845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:43.064333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:43.214289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:43.222644 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7b0b84d7-70df-4c01-a7f0-b782672550e2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1560 microversion: 2.1 time: 0.176718 Apr 09 21:48:43.223230 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3484/6942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:43 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:43.241118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:43.241845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:43.248906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:43.249417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:43.250220 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:43.250680 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:43.393192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:43.404310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4909ccc1-cfa5-4585-bf32-646e62a43b71 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1560 microversion: 2.1 time: 0.166950 Apr 09 21:48:43.405116 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3459/6943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:43 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:48:45.577318 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:48:45.578588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:48:45.580112 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1db9fe6b-7b00-4d96-b69a-c711afd1f238 req-8d4b72b1-d9f8-44b7-a134-bf2f1aaf661c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00b8d01-d71a-4456-a5a9-92d096e8106e", "tag": "f76d6736-6440-4883-a120-8d719eacbfbd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:48:45.585669 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:45.586158 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:45.586950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:45.587392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:45.592062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1db9fe6b-7b00-4d96-b69a-c711afd1f238 req-8d4b72b1-d9f8-44b7-a134-bf2f1aaf661c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:48:45.592646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1db9fe6b-7b00-4d96-b69a-c711afd1f238 req-8d4b72b1-d9f8-44b7-a134-bf2f1aaf661c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:48:45.605989 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1db9fe6b-7b00-4d96-b69a-c711afd1f238 req-8d4b72b1-d9f8-44b7-a134-bf2f1aaf661c service nova] Creating event network-changed:f76d6736-6440-4883-a120-8d719eacbfbd for instance c00b8d01-d71a-4456-a5a9-92d096e8106e on nch2-master-1 Apr 09 21:48:45.611416 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1db9fe6b-7b00-4d96-b69a-c711afd1f238 req-8d4b72b1-d9f8-44b7-a134-bf2f1aaf661c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 Apr 09 21:48:45.612400 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3460/6944] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:48:45.740538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:48:45.748500 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bad09bb-9fa2-4e5b-9812-2a5f2147c68e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1560 microversion: 2.1 time: 0.175185 Apr 09 21:48:45.749212 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3485/6945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:48:45 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:19.102378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:19.103453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:19.110080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:19.110542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:19.111317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:19.111766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:19.161370 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e994a274-e1cf-4d94-b8ed-0e5c4f37df05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action" status: 200 len: 24571 microversion: 2.1 time: 0.064245 Apr 09 21:49:19.163044 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3461/6946] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:49:19 2022] POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:49:49.615977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:49.617010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:49.626129 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:49.626585 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:49.627368 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:49.627774 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:49.700865 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5293e969-b95d-4a28-a5b5-cc49a14114b1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action" status: 202 len: 0 microversion: 2.1 time: 0.093494 Apr 09 21:49:49.701600 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3486/6947] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:49:49 2022] POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:49:49.711907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:49.712630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:49.719990 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:49.720458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:49.721303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:49.722104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:49.859363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:49.868035 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-09268ee5-b910-4c87-bedf-885a6098d819 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1682 microversion: 2.1 time: 0.160345 Apr 09 21:49:49.868646 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3462/6948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:49 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:49:50.893321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:50.894431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:50.905154 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:50.905610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:50.906386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:50.906822 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:51.051751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:51.059729 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85092c35-f2e4-4158-b4fa-282555b084be tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1662 microversion: 2.1 time: 0.175847 Apr 09 21:49:51.060308 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3487/6949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:50 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:52.157728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:52.159386 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:52.172324 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.172783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.173608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.174054 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.223077 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4055455d-0325-46ed-a2ea-704c80f62d9d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action" status: 200 len: 32645 microversion: 2.1 time: 0.072019 Apr 09 21:49:52.223733 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3463/6950] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:49:52 2022] POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action => generated 32645 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:49:52.237213 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:52.237764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:52.244976 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.245435 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.246202 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.246646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.315386 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e2a023d9-515f-404a-b24e-54cd567c5ab2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action" status: 202 len: 0 microversion: 2.1 time: 0.083342 Apr 09 21:49:52.316018 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3488/6951] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:49:52 2022] POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:49:52.325854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:52.326666 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:52.334311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.334816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.335681 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:52.336122 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:52.481185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:52.491273 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-11cd07f0-be16-4cbd-8fe7-cfc669866c05 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1669 microversion: 2.1 time: 0.169736 Apr 09 21:49:52.492475 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3464/6952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:52 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:53.515263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:53.516250 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:53.523145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:53.523598 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:53.524372 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:53.524806 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:53.666804 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:53.675087 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f3a0611-574d-4b25-b5a5-0cafee39cd8c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1677 microversion: 2.1 time: 0.167833 Apr 09 21:49:53.675643 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3489/6953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:53 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:53.779421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:53.780401 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:53.788319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:53.788786 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:53.789642 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:53.790102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:53.838783 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ef0e985-da37-4157-8685-ce66351eb2ab tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action" status: 200 len: 37749 microversion: 2.1 time: 0.063185 Apr 09 21:49:53.839476 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3465/6954] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:49:53 2022] POST /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e/action => generated 37749 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:49:54.922446 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:54.923698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:54.931885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:54.932455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:54.933870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:54.934509 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:54.961895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:49:54.991382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-457c7bdf-5cb0-4d49-880f-177aef00760c req-12042be6-6c8a-4915-a5a2-7dfe9450afab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00b8d01-d71a-4456-a5a9-92d096e8106e", "tag": "f76d6736-6440-4883-a120-8d719eacbfbd"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:55.001426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-457c7bdf-5cb0-4d49-880f-177aef00760c req-12042be6-6c8a-4915-a5a2-7dfe9450afab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:55.002179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-457c7bdf-5cb0-4d49-880f-177aef00760c req-12042be6-6c8a-4915-a5a2-7dfe9450afab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:55.013444 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-457c7bdf-5cb0-4d49-880f-177aef00760c req-12042be6-6c8a-4915-a5a2-7dfe9450afab service nova] Creating event network-changed:f76d6736-6440-4883-a120-8d719eacbfbd for instance c00b8d01-d71a-4456-a5a9-92d096e8106e on nch2-master-1 Apr 09 21:49:55.018964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-457c7bdf-5cb0-4d49-880f-177aef00760c req-12042be6-6c8a-4915-a5a2-7dfe9450afab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098331 Apr 09 21:49:55.020209 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3466/6955] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:49:55.053100 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5cb619d-e3d3-42d3-a33e-d482b7ac6d72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 204 len: 0 microversion: 2.1 time: 0.134600 Apr 09 21:49:55.054512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3490/6956] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:49:54 2022] DELETE /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:49:55.065952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:55.066772 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:55.074940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:55.075484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:55.076528 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:55.077095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:55.218364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:55.226270 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-62c48196-d848-41c9-8261-9403084d5f44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1683 microversion: 2.1 time: 0.166816 Apr 09 21:49:55.226858 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3467/6957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:55 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:56.245550 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:56.246492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:56.254248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:56.254707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:56.255508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:56.255948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:56.401731 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:56.410095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e199dc84-b792-434d-b73b-d96f04cc232c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1683 microversion: 2.1 time: 0.169698 Apr 09 21:49:56.411078 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3491/6958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:56 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:49:57.428183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:57.428766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:57.435796 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:57.436239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:57.437303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:57.437799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:57.504417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:49:57.520608 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-14711b1a-b4ff-4a3e-8918-7b239e65a389 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 200 len: 1499 microversion: 2.1 time: 0.096392 Apr 09 21:49:57.521248 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3468/6959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:57 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 1499 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:49:57.629866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-6f97b119-4d74-439d-aff2-fd70ae971dcb req-adb28976-df24-48e0-87f1-3fd66d913806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00b8d01-d71a-4456-a5a9-92d096e8106e", "name": "network-vif-deleted", "tag": "f76d6736-6440-4883-a120-8d719eacbfbd"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:49:57.638878 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6f97b119-4d74-439d-aff2-fd70ae971dcb req-adb28976-df24-48e0-87f1-3fd66d913806 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:57.639333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-6f97b119-4d74-439d-aff2-fd70ae971dcb req-adb28976-df24-48e0-87f1-3fd66d913806 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:57.651740 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-6f97b119-4d74-439d-aff2-fd70ae971dcb req-adb28976-df24-48e0-87f1-3fd66d913806 service nova] Creating event network-vif-deleted:f76d6736-6440-4883-a120-8d719eacbfbd for instance c00b8d01-d71a-4456-a5a9-92d096e8106e on nch2-master-1 Apr 09 21:49:57.656964 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-6f97b119-4d74-439d-aff2-fd70ae971dcb req-adb28976-df24-48e0-87f1-3fd66d913806 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100666 Apr 09 21:49:57.657595 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3492/6960] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:49:58.542057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:49:58.543099 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: c00b8d01-d71a-4456-a5a9-92d096e8106e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:49:58.554878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:58.555762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:58.557102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:49:58.557961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:49:58.574026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] HTTP exception thrown: Instance c00b8d01-d71a-4456-a5a9-92d096e8106e could not be found. Apr 09 21:49:58.574641 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Returning 404 to user: Instance c00b8d01-d71a-4456-a5a9-92d096e8106e could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:49:58.575481 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd9ed1eb-1ab8-4d1c-9eec-7fbab934bfc0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e" status: 404 len: 111 microversion: 2.1 time: 0.040186 Apr 09 21:49:58.576023 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3469/6961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:49:58 2022] GET /compute/v2.1/servers/c00b8d01-d71a-4456-a5a9-92d096e8106e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:50:01.700838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e194100e-2c4a-4d25-b574-f3215bd8e5c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '.version_select at 0x7fb08ec541f0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:01.723102 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e194100e-2c4a-4d25-b574-f3215bd8e5c5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56837015" status: 202 len: 0 microversion: 2.1 time: 0.027305 Apr 09 21:50:01.723890 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3493/6962] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Apr 9 21:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56837015 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:50:01.745963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: .version_select at 0x7fb08f179040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1211101498"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:01.762065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:50:01.767749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:50:01.950838 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:50:01.956928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:50:01.971287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac549fc4-62e1-4497-a920-51a400656fce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.229402 Apr 09 21:50:01.972237 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3470/6963] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:50:01 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:07.612126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2130887480", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "a22fee1a-0d1e-4848-9536-8b32c4380953"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1211101498", "security_groups": [{"name": "tempest-secgroup-smoke-958104623"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:07.722682 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] validate_networks() for [('a22fee1a-0d1e-4848-9536-8b32c4380953', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:50:08.180758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:50:08.181220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:50:08.181698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:50:08.182108 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:50:08.182524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:50:08.205404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:08.206124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:08.207076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:08.207558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:08.229661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:50:08.235472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:50:08.249212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:50:08.251740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:50:08.307020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-49f36026-4cd5-4adb-969d-ee7568e45191 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699790 Apr 09 21:50:08.307908 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3494/6964] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:50:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:50:08.322624 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-441b3227-82cb-4259-94fe-c9f0e714d0d3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:08.324055 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-441b3227-82cb-4259-94fe-c9f0e714d0d3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:08.419200 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-441b3227-82cb-4259-94fe-c9f0e714d0d3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:08.428148 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-441b3227-82cb-4259-94fe-c9f0e714d0d3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1267 microversion: 2.1 time: 0.113054 Apr 09 21:50:08.433372 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3471/6965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:08 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:09.447413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:09.449147 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:09.464234 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:09.465691 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:09.466524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:09.466972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:09.592536 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:09.601712 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e863d018-bdff-487a-a0eb-04cfe3fd1ca3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1327 microversion: 2.1 time: 0.159903 Apr 09 21:50:09.613241 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3495/6966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:09 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:10.620022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:10.620665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:10.630639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:10.630867 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:10.631690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:10.632217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:10.838285 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:10.846255 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2bc5a21e-25a4-4c56-be59-225bde2cf215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.231257 Apr 09 21:50:10.846902 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3472/6967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:10 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:11.409797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7665eebd-82b6-46b5-9305-1e310d5e4daf req-63c95c9a-79e0-4b4c-beaf-364a69d0f9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f1434-0c71-490b-9663-8e0a472eb8be", "tag": "3caab25f-9db0-403c-94ca-10303bc74c02"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:11.438000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7665eebd-82b6-46b5-9305-1e310d5e4daf req-63c95c9a-79e0-4b4c-beaf-364a69d0f9fe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:11.438562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7665eebd-82b6-46b5-9305-1e310d5e4daf req-63c95c9a-79e0-4b4c-beaf-364a69d0f9fe service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:11.451876 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7665eebd-82b6-46b5-9305-1e310d5e4daf req-63c95c9a-79e0-4b4c-beaf-364a69d0f9fe service nova] Creating event network-changed:3caab25f-9db0-403c-94ca-10303bc74c02 for instance 437f1434-0c71-490b-9663-8e0a472eb8be on nch1-master-1 Apr 09 21:50:11.457627 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7665eebd-82b6-46b5-9305-1e310d5e4daf req-63c95c9a-79e0-4b4c-beaf-364a69d0f9fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051511 Apr 09 21:50:11.458466 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3496/6968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:50:11.865962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:11.866548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:11.873368 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:11.873831 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:11.874646 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:11.875085 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:12.020257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:12.028741 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5aad10da-fd7a-4713-9dba-2e920b777a7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.168767 Apr 09 21:50:12.029370 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3473/6969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:11 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:13.048048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:13.048745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:13.055732 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:13.056184 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:13.057326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:13.058073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:13.211060 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:13.219014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4d8c9e94-d95e-4d56-ad43-d430ba9a19d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.176266 Apr 09 21:50:13.219612 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3497/6970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:13 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:14.236175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:14.236872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:14.244143 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:14.244606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:14.245426 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:14.245875 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:14.387095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:14.395357 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b05c3fa6-5fe4-4696-8cbe-d6bfea70e2ff tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.163145 Apr 09 21:50:14.395948 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3474/6971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:14 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:15.416150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:15.418080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:15.429821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:15.430581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:15.431877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:15.432610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:15.575494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:15.583823 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4a006ca7-4889-4154-8186-e79df3d5b3a6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.174351 Apr 09 21:50:15.584427 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3498/6972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:15 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:16.166157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-e8fe3feb-11ce-4881-bbf2-cb42854da88f req-f3072ca6-fa14-488a-b8e9-cfdd639a8deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f1434-0c71-490b-9663-8e0a472eb8be", "name": "network-vif-plugged", "status": "completed", "tag": "3caab25f-9db0-403c-94ca-10303bc74c02"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:16.174462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8fe3feb-11ce-4881-bbf2-cb42854da88f req-f3072ca6-fa14-488a-b8e9-cfdd639a8deb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:16.174916 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-e8fe3feb-11ce-4881-bbf2-cb42854da88f req-f3072ca6-fa14-488a-b8e9-cfdd639a8deb service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:16.185859 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-e8fe3feb-11ce-4881-bbf2-cb42854da88f req-f3072ca6-fa14-488a-b8e9-cfdd639a8deb service nova] Creating event network-vif-plugged:3caab25f-9db0-403c-94ca-10303bc74c02 for instance 437f1434-0c71-490b-9663-8e0a472eb8be on nch1-master-1 Apr 09 21:50:16.190920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-e8fe3feb-11ce-4881-bbf2-cb42854da88f req-f3072ca6-fa14-488a-b8e9-cfdd639a8deb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097883 Apr 09 21:50:16.191498 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3475/6973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:50:16.605311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:16.606324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:16.616215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:16.616676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:16.617512 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:16.617955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:16.753584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:16.761651 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0cf4bdb5-b4a5-4f99-9e95-5193446d79e8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1392 microversion: 2.1 time: 0.163105 Apr 09 21:50:16.762245 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3499/6974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:16 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:17.785265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:17.786493 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:17.797534 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:17.798291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:17.799625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:17.800543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:17.937309 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:17.945406 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a95e465-f5db-41ca-a3d8-ed02abc52b5c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1564 microversion: 2.1 time: 0.168823 Apr 09 21:50:17.945998 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3476/6975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:17 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:17.961965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:17.962592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:17.969668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:17.970127 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:17.970909 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:17.971354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:18.114262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:18.122159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-becc9c57-ba04-43c9-8271-3454088c9fdb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1564 microversion: 2.1 time: 0.164306 Apr 09 21:50:18.122743 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3500/6976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:17 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:19.845521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9117257d-c257-45b3-a121-f189a1d71325 req-3ab55930-d304-43b4-bff7-94d931925d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f1434-0c71-490b-9663-8e0a472eb8be", "tag": "3caab25f-9db0-403c-94ca-10303bc74c02"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:19.850839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:19.851491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:19.859996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9117257d-c257-45b3-a121-f189a1d71325 req-3ab55930-d304-43b4-bff7-94d931925d31 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:19.860217 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:19.860771 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:19.861111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9117257d-c257-45b3-a121-f189a1d71325 req-3ab55930-d304-43b4-bff7-94d931925d31 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:19.861588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:19.862051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:19.875335 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9117257d-c257-45b3-a121-f189a1d71325 req-3ab55930-d304-43b4-bff7-94d931925d31 service nova] Creating event network-changed:3caab25f-9db0-403c-94ca-10303bc74c02 for instance 437f1434-0c71-490b-9663-8e0a472eb8be on nch1-master-1 Apr 09 21:50:19.881298 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9117257d-c257-45b3-a121-f189a1d71325 req-3ab55930-d304-43b4-bff7-94d931925d31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040084 Apr 09 21:50:19.882724 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3501/6977] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:50:20.101835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:20.109801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dd8fa0ab-f9ac-42d3-b3fa-b5c9375b6a57 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1564 microversion: 2.1 time: 0.272975 Apr 09 21:50:20.110589 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3477/6978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:19 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:43.396373 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:43.398099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:43.406910 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:43.407370 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:43.408156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:43.408599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:43.458832 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4edf2e9-da9c-4445-a502-7a9d4f733a19 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action" status: 200 len: 24569 microversion: 2.1 time: 0.070054 Apr 09 21:50:43.459478 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3502/6979] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:50:43 2022] POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:50:49.856332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:50:49.857348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:49.864011 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:49.864473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:49.865295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:49.865751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:49.941211 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fd831c26-7f7d-4ab9-985c-0f357dd39b3c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action" status: 202 len: 0 microversion: 2.1 time: 0.088938 Apr 09 21:50:49.941950 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3478/6980] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:50:49 2022] POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:50:49.951044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:49.951757 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:49.960059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:49.960508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:49.961357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:49.961928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:50.189230 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:50.197274 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bc026730-4513-430e-b4b7-0ee943320493 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1673 microversion: 2.1 time: 0.250496 Apr 09 21:50:50.197863 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3503/6981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:49 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:51.221770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:51.223289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:51.233652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:51.234127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:51.234933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:51.235392 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:51.434165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:51.442447 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ab4ca62-9dc7-4541-a5a5-1ccba88c8215 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.229407 Apr 09 21:50:51.443030 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3479/6982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:51 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:52.462935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:52.463593 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:52.474380 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:52.474964 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:52.476058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:52.476642 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:52.618539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:52.629469 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-352776e2-fdc7-4da8-ab70-5e7d334da60e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.173067 Apr 09 21:50:52.630264 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3504/6983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:52 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:53.651357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:53.651941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:53.659943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:53.660406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:53.661228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:53.661677 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:53.811196 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:53.819575 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2da28f3b-6222-42b9-99ac-76e53fe7e650 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.174311 Apr 09 21:50:53.820172 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3480/6984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:53 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:54.841385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:54.842322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:54.854606 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:54.855367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:54.856651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:54.857580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:54.998881 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:55.006944 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e83852b5-6043-40ea-9343-127301f77ed8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.172347 Apr 09 21:50:55.007541 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3505/6985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:54 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:56.028477 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:56.029568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:56.037588 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:56.038076 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:56.038901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:56.039375 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:56.175466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:56.186958 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-540ea266-b1db-4fcc-bcb1-9ae755c8bfd2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.164679 Apr 09 21:50:56.187754 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3481/6986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:56 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:57.213252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:57.214314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:57.226339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:57.227059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:57.228340 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:57.229117 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:57.370579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:57.378906 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-faa9e60e-ef78-4ebd-ae11-e9faf8116c6c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.172256 Apr 09 21:50:57.379435 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3506/6987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:57 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:58.400691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:58.401604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:58.413248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:58.414024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:58.415342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:58.416089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:58.556275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:58.564593 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-914ee9b7-d983-40f1-9bb6-46f29082f782 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.170761 Apr 09 21:50:58.565194 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3482/6988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:58 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:50:59.586172 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:50:59.587145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:50:59.596619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:59.597070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:59.597879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:50:59.598662 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:50:59.746355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:50:59.754549 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-5c568a8b-623f-474f-ba17-1129ff66799f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.175003 Apr 09 21:50:59.755145 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3507/6989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:50:59 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:00.780187 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:00.781235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:00.792928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:00.793781 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:00.795103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:00.795947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:00.946051 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:00.954830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca00050e-71f7-4aca-8140-cdf595f0a91d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1678 microversion: 2.1 time: 0.181435 Apr 09 21:51:00.955416 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3483/6990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:00 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:01.975316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:01.975949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:01.986422 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:01.987070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:01.988265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:01.988815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:02.129903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:02.137991 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88861eff-9c2d-4180-9267-b51d8b56d278 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1681 microversion: 2.1 time: 0.169116 Apr 09 21:51:02.138588 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3508/6991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:01 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:26.364971 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:26.365963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:26.373153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:26.373620 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:26.374400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:26.374845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:26.428541 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4a7f65e2-db22-4de7-9785-8627cdd4cfc4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action" status: 200 len: 69104 microversion: 2.1 time: 0.068333 Apr 09 21:51:26.429235 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3484/6992] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:51:26 2022] POST /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be/action => generated 69104 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:51:33.748006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-3a51e080-8b5c-402c-befa-38080e4e1f5b req-c9a66c7a-35f6-4dc0-b0df-ea2bf17b3554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f1434-0c71-490b-9663-8e0a472eb8be", "tag": "3caab25f-9db0-403c-94ca-10303bc74c02"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:33.752447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:33.753609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:33.763221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:33.763676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:33.764488 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:33.764930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:33.772604 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3a51e080-8b5c-402c-befa-38080e4e1f5b req-c9a66c7a-35f6-4dc0-b0df-ea2bf17b3554 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:33.773104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-3a51e080-8b5c-402c-befa-38080e4e1f5b req-c9a66c7a-35f6-4dc0-b0df-ea2bf17b3554 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:33.797339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:51:33.801592 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-3a51e080-8b5c-402c-befa-38080e4e1f5b req-c9a66c7a-35f6-4dc0-b0df-ea2bf17b3554 service nova] Creating event network-changed:3caab25f-9db0-403c-94ca-10303bc74c02 for instance 437f1434-0c71-490b-9663-8e0a472eb8be on nch1-master-1 Apr 09 21:51:33.809911 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-3a51e080-8b5c-402c-befa-38080e4e1f5b req-c9a66c7a-35f6-4dc0-b0df-ea2bf17b3554 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066218 Apr 09 21:51:33.811727 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3485/6993] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:51:33.885623 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ecdee5e-c80c-48c1-b63d-b9e14b6e8ee5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 204 len: 0 microversion: 2.1 time: 0.146821 Apr 09 21:51:33.890227 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3509/6994] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:51:33 2022] DELETE /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:51:33.897190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:33.897941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:33.904821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:33.905335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:33.906127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:33.906573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:34.041106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:34.048743 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-005dcaa9-01a8-45fa-8349-07694b607e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1687 microversion: 2.1 time: 0.157385 Apr 09 21:51:34.049375 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3486/6995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:33 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:35.067823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:35.068533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:35.076426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:35.076863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:35.077769 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:35.078215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:35.375005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:35.382945 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-95b68c73-f41c-4bf2-88c6-d5f890b1b40a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1570 microversion: 2.1 time: 0.319991 Apr 09 21:51:35.397334 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3510/6996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:35 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1570 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:36.048574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-348c667a-b527-4552-b816-34e4cf3149c7 req-d41ea457-d22f-425d-a20f-6947e118404f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f1434-0c71-490b-9663-8e0a472eb8be", "name": "network-vif-deleted", "tag": "3caab25f-9db0-403c-94ca-10303bc74c02"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:36.057981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-348c667a-b527-4552-b816-34e4cf3149c7 req-d41ea457-d22f-425d-a20f-6947e118404f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:36.058435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-348c667a-b527-4552-b816-34e4cf3149c7 req-d41ea457-d22f-425d-a20f-6947e118404f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:36.071145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-348c667a-b527-4552-b816-34e4cf3149c7 req-d41ea457-d22f-425d-a20f-6947e118404f service nova] Creating event network-vif-deleted:3caab25f-9db0-403c-94ca-10303bc74c02 for instance 437f1434-0c71-490b-9663-8e0a472eb8be on nch1-master-1 Apr 09 21:51:36.076327 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-348c667a-b527-4552-b816-34e4cf3149c7 req-d41ea457-d22f-425d-a20f-6947e118404f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Apr 09 21:51:36.076937 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3487/6997] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:51:36.399923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:36.400752 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:36.408863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:36.409348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:36.410441 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:36.410887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:36.451932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:36.452384 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:36.452895 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lazy-loading 'fault' on Instance uuid 437f1434-0c71-490b-9663-8e0a472eb8be {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:51:36.815514 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:36.824089 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c57b2002-ed79-418b-bcf6-192dcb7fc177 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 200 len: 1357 microversion: 2.1 time: 0.428158 Apr 09 21:51:36.824676 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3511/6998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:36 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 1357 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:37.850128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:37.851327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 437f1434-0c71-490b-9663-8e0a472eb8be] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:37.858845 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:37.859317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:37.860113 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:37.860570 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:37.863592 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:51:37.863772 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be (ip 10.222.0.30) !!! Apr 09 21:51:37.876265 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] HTTP exception thrown: Instance 437f1434-0c71-490b-9663-8e0a472eb8be could not be found. Apr 09 21:51:37.876904 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Returning 404 to user: Instance 437f1434-0c71-490b-9663-8e0a472eb8be could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:51:37.877810 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-339599b8-ae5b-4b06-a861-b2b5380deb44 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be" status: 404 len: 111 microversion: 2.1 time: 0.036581 Apr 09 21:51:37.878392 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3488/6999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:37 2022] GET /compute/v2.1/servers/437f1434-0c71-490b-9663-8e0a472eb8be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:51:41.309505 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1da32cce-aa0a-4cfe-b3d4-be3ebf5cb150 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '.version_select at 0x7fb08ebcd550>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:41.333211 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1da32cce-aa0a-4cfe-b3d4-be3ebf5cb150 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1211101498" status: 202 len: 0 microversion: 2.1 time: 0.035053 Apr 09 21:51:41.333817 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3512/7000] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1211101498 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:51:41.360790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: .version_select at 0x7fb08ee49af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1234508430"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:41.377458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:51:41.382780 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:51:41.538303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:51:41.544230 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:51:41.560349 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-17fb7866-a392-4c2c-869c-cfd549e97d63 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.203540 Apr 09 21:51:41.560926 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3489/7001] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:51:41 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:47.215667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1974048209", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "155d0fd0-715f-4ae6-abe3-36676fa33dfa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1234508430", "security_groups": [{"name": "tempest-secgroup-smoke-790605370"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:47.342700 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] validate_networks() for [('155d0fd0-715f-4ae6-abe3-36676fa33dfa', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:51:47.745823 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:51:47.746251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:51:47.746695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:51:47.747106 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:51:47.747539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:51:47.756801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:47.757289 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:47.758095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:47.758533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:47.775877 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:51:47.781262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:51:47.794615 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:51:47.796932 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:51:47.844392 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0ac89f82-1c6f-41d8-be6e-a6febf5e65cb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.634168 Apr 09 21:51:47.845673 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3513/7002] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:51:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:51:47.856910 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-be6490e2-fe44-4e91-9fb6-faf45ce2b7a1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:47.857575 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-be6490e2-fe44-4e91-9fb6-faf45ce2b7a1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:47.921185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-be6490e2-fe44-4e91-9fb6-faf45ce2b7a1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:47.933941 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-be6490e2-fe44-4e91-9fb6-faf45ce2b7a1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1267 microversion: 2.1 time: 0.081969 Apr 09 21:51:47.944308 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3490/7003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:47 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:48.952076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-6bd950c3-09bd-4144-804e-cd327752a1dd tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:48.952819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-6bd950c3-09bd-4144-804e-cd327752a1dd tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:49.043038 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-6bd950c3-09bd-4144-804e-cd327752a1dd tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:49.050894 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-6bd950c3-09bd-4144-804e-cd327752a1dd tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1267 microversion: 2.1 time: 0.102909 Apr 09 21:51:49.052122 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3514/7004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:48 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:50.075517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:50.076170 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:50.085231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:50.085707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:50.086603 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:50.087111 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:50.164840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:50.173204 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-724d51e8-9922-4655-9079-5f19cdde76f7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1271 microversion: 2.1 time: 0.101921 Apr 09 21:51:50.173845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3491/7005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:50 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:51.190348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:51.190966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:51.198312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:51.198751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:51.199551 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:51.199990 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:51.262357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:51.270030 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-60e426ea-fad6-4a4b-9fdc-ae68393d7f67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1325 microversion: 2.1 time: 0.083707 Apr 09 21:51:51.270687 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3515/7006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:51 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1325 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:51:52.252034 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-32018a6f-7b55-4dbe-a7dc-e9db7f743766 req-f554a8d9-9cea-4786-b785-5a3617afad91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:52.261381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-32018a6f-7b55-4dbe-a7dc-e9db7f743766 req-f554a8d9-9cea-4786-b785-5a3617afad91 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:52.262042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-32018a6f-7b55-4dbe-a7dc-e9db7f743766 req-f554a8d9-9cea-4786-b785-5a3617afad91 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:52.275460 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-32018a6f-7b55-4dbe-a7dc-e9db7f743766 req-f554a8d9-9cea-4786-b785-5a3617afad91 service nova] Creating event network-changed:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch2-master-1 Apr 09 21:51:52.281568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-32018a6f-7b55-4dbe-a7dc-e9db7f743766 req-f554a8d9-9cea-4786-b785-5a3617afad91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035938 Apr 09 21:51:52.282901 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3492/7007] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:51:52.288873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:52.289754 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:52.298284 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:52.301375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:52.302863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:52.303507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:52.463176 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:52.470859 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7f4b8c03-1dd1-4fcf-8d54-79446d82d0b5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.186953 Apr 09 21:51:52.471448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3516/7008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:52 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:53.491954 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:53.493164 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:53.501898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:53.502508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:53.503591 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:53.504182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:53.645491 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:53.653456 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ad92eee-885d-47e8-8973-f7dec8f60b4b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.168306 Apr 09 21:51:53.654047 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3493/7009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:53 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:54.671837 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:54.672453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:54.679785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:54.680238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:54.681017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:54.681497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:54.818203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:54.826635 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7806b4e4-3080-4c5b-977f-48e0c2f4774e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.159557 Apr 09 21:51:54.827218 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3517/7010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:54 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:55.848295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:55.849748 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:55.861410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:55.862222 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:55.863552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:55.864314 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:56.014169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:56.025082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53caff88-3fbb-4591-a152-56ec10f02c55 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.183115 Apr 09 21:51:56.025703 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3494/7011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:55 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:57.046948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:57.047901 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:57.059941 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:57.060699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:57.062111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:57.062848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:57.207746 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:57.215597 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ba72babc-25f7-45cf-a19f-cc7fb2d4ac3b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.175342 Apr 09 21:51:57.216184 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3518/7012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:57 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:58.175901 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-1a99d9e9-cd56-4bea-8659-0a3679c75988 req-a20ffa37-4390-4292-868b-7199d9aafcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "name": "network-vif-plugged", "status": "completed", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:51:58.185843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1a99d9e9-cd56-4bea-8659-0a3679c75988 req-a20ffa37-4390-4292-868b-7199d9aafcca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:58.186317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-1a99d9e9-cd56-4bea-8659-0a3679c75988 req-a20ffa37-4390-4292-868b-7199d9aafcca service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:58.197706 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-1a99d9e9-cd56-4bea-8659-0a3679c75988 req-a20ffa37-4390-4292-868b-7199d9aafcca service nova] Creating event network-vif-plugged:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch2-master-1 Apr 09 21:51:58.202759 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-1a99d9e9-cd56-4bea-8659-0a3679c75988 req-a20ffa37-4390-4292-868b-7199d9aafcca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030717 Apr 09 21:51:58.203422 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3495/7013] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:51:58.232873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:58.233521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:58.241138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:58.241858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:58.242777 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:58.243302 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:58.393273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:58.400934 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d986ebf2-5267-4e9f-b51a-479cf50568c4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.172163 Apr 09 21:51:58.401563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3519/7014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:58 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:51:59.424632 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:51:59.425825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:51:59.436613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:59.437434 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:59.438723 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:51:59.439468 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:51:59.585096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:51:59.594418 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6cfd9993-0afa-4565-987a-39f0e4d280ee tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1392 microversion: 2.1 time: 0.178703 Apr 09 21:51:59.594965 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3496/7015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:51:59 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:52:00.616300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:52:00.617239 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:52:00.626999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:00.627457 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:00.628232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:00.628674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:00.772238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:52:00.782844 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-556c6503-33d3-4d98-8b8c-ca30a12a49ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1563 microversion: 2.1 time: 0.173362 Apr 09 21:52:00.783429 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3520/7016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:52:00 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:52:00.803695 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:52:00.804327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:52:00.811579 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:00.812047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:00.812843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:00.813332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:00.953064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:52:00.961165 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-637677df-e028-4c68-9910-d027dcbde1a3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1563 microversion: 2.1 time: 0.161518 Apr 09 21:52:00.961789 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3497/7017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:52:00 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:52:02.653645 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:52:02.654845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:52:02.655654 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-6cc103d1-186f-4bae-8d39-d8da6508ee9d req-d7264432-2437-4f4a-b63c-8d626c223c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:52:02.662022 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:02.662482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:02.663263 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:02.663699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:02.665720 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6cc103d1-186f-4bae-8d39-d8da6508ee9d req-d7264432-2437-4f4a-b63c-8d626c223c6c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:02.666639 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-6cc103d1-186f-4bae-8d39-d8da6508ee9d req-d7264432-2437-4f4a-b63c-8d626c223c6c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:02.678903 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-6cc103d1-186f-4bae-8d39-d8da6508ee9d req-d7264432-2437-4f4a-b63c-8d626c223c6c service nova] Creating event network-changed:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch2-master-1 Apr 09 21:52:02.684146 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-6cc103d1-186f-4bae-8d39-d8da6508ee9d req-d7264432-2437-4f4a-b63c-8d626c223c6c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Apr 09 21:52:02.685302 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3498/7018] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:52:02.805921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:52:02.814027 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-50f5bb8d-ea9a-42d6-9d5d-ffbf012be4cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1563 microversion: 2.1 time: 0.164659 Apr 09 21:52:02.814832 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3521/7019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:52:02 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:52:34.150612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:52:34.151690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:52:34.158834 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:34.159289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:34.160064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:52:34.160509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:52:34.211183 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-554b42e6-6ab1-4a6c-9aef-818538ba5b5f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action" status: 200 len: 24566 microversion: 2.1 time: 0.065080 Apr 09 21:52:34.211842 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3499/7020] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:52:34 2022] POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action => generated 24566 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:53:04.665803 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:04.666875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:04.673966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:04.674420 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:04.675201 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:04.675641 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:04.717984 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:04.724644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Old instance type m1.heat2, new instance type m1.heat {{(pid=141818) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 09 21:53:04.731949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:53:04.732375 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:53:04.732851 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:53:04.733285 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:53:04.733706 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:53:04.802425 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-abe88025-97a5-4f71-8da9-554c21fd090e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.142039 Apr 09 21:53:04.803056 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3522/7021] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:53:04 2022] POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:53:04.812239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:04.812965 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:04.820226 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:04.820698 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:04.821530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:04.821989 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:05.106858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:05.114858 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dca89c55-97c3-4a44-afa2-e2f0a2ea8c5d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1691 microversion: 2.1 time: 0.307252 Apr 09 21:53:05.115462 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3500/7022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:04 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1691 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:06.133430 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:06.134073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:06.140581 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:06.141073 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:06.141875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:06.142315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:06.406298 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:06.413788 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96059b91-8db9-4fb7-8b82-1e255c9fd4fb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1691 microversion: 2.1 time: 0.285720 Apr 09 21:53:06.414374 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3523/7023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:06 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1691 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:07.431032 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:07.431663 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:07.439801 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:07.440263 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:07.441519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:07.441519 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:07.572825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:07.581139 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-57f91fab-3b63-4eb7-9fba-b4595190e7e3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.154101 Apr 09 21:53:07.581719 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3501/7024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:07 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:08.603564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:08.604546 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:08.615954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:08.616839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:08.617649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:08.618087 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:08.753545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:08.763400 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f859f051-68d0-4976-b650-6b6b9f7e3ba2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.166903 Apr 09 21:53:08.763989 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3524/7025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:08 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:09.788590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:09.789571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:09.799846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:09.800543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:09.801789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:09.802471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:09.937753 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:09.946065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-6bda205d-544d-43a4-99e4-eecabb9c885e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.163492 Apr 09 21:53:09.946667 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3502/7026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:09 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:10.967860 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:10.968848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:10.979539 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:10.979996 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:10.980800 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:10.981275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:11.132762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:11.140872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6ad09c0-6c4c-4ebf-850b-5b6b1ffdcf67 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.179839 Apr 09 21:53:11.141504 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3525/7027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:10 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:12.162537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:12.163634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:12.171998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:12.172458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:12.173300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:12.173750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:12.306969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:12.314987 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b88492dd-c6f8-4d4f-94f1-5a4fe3a8d63a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.159334 Apr 09 21:53:12.315576 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3503/7028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:12 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:13.336036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:13.336992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:13.344557 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:13.345017 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:13.345819 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:13.346262 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:13.481580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:13.489741 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7ff6fb73-787c-4f2e-9f97-ed35458c9dfb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.160344 Apr 09 21:53:13.490458 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3526/7029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:13 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:14.507378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:14.507987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:14.515291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:14.515752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:14.516537 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:14.516985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:14.666678 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:14.678233 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-443cb6eb-96fa-426a-afa4-f80e7d415f61 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.174546 Apr 09 21:53:14.679093 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3504/7030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:14 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:15.696238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:15.696829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:15.703770 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:15.704191 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:15.705012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:15.705500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:15.838712 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:15.846382 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-07ce62f7-f436-40a1-b6da-b1456df13179 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.154310 Apr 09 21:53:15.846993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3527/7031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:15 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:16.864118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:16.864766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:16.872083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:16.872539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:16.873369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:16.873825 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:17.009573 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:17.017949 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-93894ca1-1577-4808-b2d3-2c5750c678f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.157894 Apr 09 21:53:17.018538 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3505/7032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:16 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:18.042849 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:18.043607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:18.052459 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:18.053027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:18.054047 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:18.054599 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:18.193198 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:18.201167 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b7673de2-b484-49c3-b182-a9e3a11be77e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1696 microversion: 2.1 time: 0.165098 Apr 09 21:53:18.201754 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3528/7033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:18 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:19.204586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "name": "network-vif-unplugged", "status": "completed", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:19.218091 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:19.218780 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:19.219040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:19.219571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:19.226001 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:19.226841 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:19.227758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:19.228207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:19.233593 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] Creating event network-vif-unplugged:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch1-master-1 Apr 09 21:53:19.239977 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] Instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:53:19.252789 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-92c48d95-0a8e-4d0e-9828-aba7e3e79871 req-0e6ca3bf-c042-4c57-bead-9cda3dd97eb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052808 Apr 09 21:53:19.253456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3506/7034] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:53:19.507948 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:19.516048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4f9d8d94-1ed0-489b-b097-05eb3267ec2d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1695 microversion: 2.1 time: 0.302019 Apr 09 21:53:19.516686 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3529/7035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:19 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:20.539013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:20.539840 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:20.547438 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:20.547906 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:20.548694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:20.549185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:20.690640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:20.698253 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-465bc602-9b3d-4845-9e8b-14491468f6e5 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1693 microversion: 2.1 time: 0.166979 Apr 09 21:53:20.698842 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3507/7036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:20 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:21.279385 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:21.293805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:21.294238 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:21.306381 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] Creating event network-changed:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch1-master-1 Apr 09 21:53:21.312045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] Instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 09 21:53:21.323204 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-f0956c72-9894-4c88-a003-4807f4f2b3f3 req-245e7c91-6a14-47b5-b328-384b84db3648 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050207 Apr 09 21:53:21.323886 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3530/7037] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:53:21.720367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:21.721159 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:21.728898 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:21.729387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:21.730311 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:21.730774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:21.972981 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:21.982449 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ed3e1765-2671-4748-a0de-8e608d7b50e4 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1693 microversion: 2.1 time: 0.265964 Apr 09 21:53:21.992118 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3508/7038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:21 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1693 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:23.001687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:23.002413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:23.008815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.009431 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.010215 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.010684 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.161710 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:23.169856 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4e33218b-f3ff-4b90-9fa3-37e518bb64a7 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1690 microversion: 2.1 time: 0.173649 Apr 09 21:53:23.170453 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3531/7039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:22 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:23.186616 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:23.187188 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:23.194474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.194938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.195728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.196176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.259534 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac3a9a69-b568-4a1a-83a9-a74378dfe408 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action" status: 204 len: 0 microversion: 2.1 time: 0.076813 Apr 09 21:53:23.260193 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3509/7040] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:53:23 2022] POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:53:23.268747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:23.269762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:23.276487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.276866 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.277933 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.278412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.425122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:23.436929 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e6f14687-928a-4fdc-a02d-96754e0e2285 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1690 microversion: 2.1 time: 0.172136 Apr 09 21:53:23.437624 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3532/7041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:23 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:23.455343 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:23.456081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:23.462978 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.463445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.464244 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:23.464799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:23.600804 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:23.608635 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4dc30d54-87b1-45f6-a9c3-192cba051def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1690 microversion: 2.1 time: 0.158445 Apr 09 21:53:23.609483 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3510/7042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:23 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:24.676793 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:24.677425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:24.683751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:24.684211 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:24.684989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:24.685476 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:24.823894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:24.833480 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e3f33fe4-3a9c-47d9-83ef-f95d4c3603f6 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1682 microversion: 2.1 time: 0.210791 Apr 09 21:53:24.834075 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3533/7043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:24 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:24.937926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4c9d64b8-f6cd-470e-9898-e5b041066abd req-5f7dcb56-505b-4bd0-84f1-9dae9c6827b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "name": "network-vif-plugged", "status": "completed", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:24.946712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c9d64b8-f6cd-470e-9898-e5b041066abd req-5f7dcb56-505b-4bd0-84f1-9dae9c6827b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:24.947163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4c9d64b8-f6cd-470e-9898-e5b041066abd req-5f7dcb56-505b-4bd0-84f1-9dae9c6827b8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:24.958949 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4c9d64b8-f6cd-470e-9898-e5b041066abd req-5f7dcb56-505b-4bd0-84f1-9dae9c6827b8 service nova] Creating event network-vif-plugged:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch1-master-1 Apr 09 21:53:24.964109 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4c9d64b8-f6cd-470e-9898-e5b041066abd req-5f7dcb56-505b-4bd0-84f1-9dae9c6827b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030078 Apr 09 21:53:24.964704 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3511/7044] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:53:47.039683 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:47.040676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:47.047796 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:47.048244 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:47.049014 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:47.049547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:47.102920 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0568e574-d0f0-4fcd-b9aa-15d47efd0d53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action" status: 200 len: 24537 microversion: 2.1 time: 0.067086 Apr 09 21:53:47.103573 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3534/7045] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:53:47 2022] POST /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1/action => generated 24537 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:53:54.225982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:54.226587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:54.234925 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:54.235400 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:54.236751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:54.237372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:54.273995 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:53:54.326574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c34ec000-05c8-4d4e-9cac-525923e9062a req-92d6d02b-a32c-4013-9c56-42545f5f59ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:54.346343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c34ec000-05c8-4d4e-9cac-525923e9062a req-92d6d02b-a32c-4013-9c56-42545f5f59ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:54.346814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c34ec000-05c8-4d4e-9cac-525923e9062a req-92d6d02b-a32c-4013-9c56-42545f5f59ac service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:54.367681 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c34ec000-05c8-4d4e-9cac-525923e9062a req-92d6d02b-a32c-4013-9c56-42545f5f59ac service nova] Creating event network-changed:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch1-master-1 Apr 09 21:53:54.372548 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f9eec47d-24e7-4371-b662-225ec5fadba1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 204 len: 0 microversion: 2.1 time: 0.152364 Apr 09 21:53:54.376723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c34ec000-05c8-4d4e-9cac-525923e9062a req-92d6d02b-a32c-4013-9c56-42545f5f59ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108474 Apr 09 21:53:54.376723 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3535/7047] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:53:54.378712 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3512/7047] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:53:54 2022] DELETE /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:53:54.383450 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:54.384257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:54.392049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:54.392626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:54.393541 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:54.394098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:54.544489 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:54.552950 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d4da4f97-d22d-4788-85ee-a56cde227ecc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1688 microversion: 2.1 time: 0.174318 Apr 09 21:53:54.553773 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3536/7048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:54 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:53:55.572766 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:55.573545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:55.580839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:55.581389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:55.582194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:55.582656 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:55.908736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:53:55.917535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-33f19eaf-bb41-4613-8ffa-0a4a03cb88d2 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 200 len: 1688 microversion: 2.1 time: 0.349155 Apr 09 21:53:55.918311 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3513/7049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:55 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 1688 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:53:56.389778 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-efcdafe1-2ec5-4da5-a246-76911b641b92 req-869bccc7-becf-4b50-b1ef-da087b5d4ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a015644-b1cc-4915-9b07-a4ebb1a8b9a1", "name": "network-vif-deleted", "tag": "fd19947a-0181-432a-ace2-9853fd3b76f8"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:53:56.398646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-efcdafe1-2ec5-4da5-a246-76911b641b92 req-869bccc7-becf-4b50-b1ef-da087b5d4ddd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:56.399133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-efcdafe1-2ec5-4da5-a246-76911b641b92 req-869bccc7-becf-4b50-b1ef-da087b5d4ddd service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:56.411723 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-efcdafe1-2ec5-4da5-a246-76911b641b92 req-869bccc7-becf-4b50-b1ef-da087b5d4ddd service nova] Creating event network-vif-deleted:fd19947a-0181-432a-ace2-9853fd3b76f8 for instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 on nch1-master-1 Apr 09 21:53:56.418018 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-efcdafe1-2ec5-4da5-a246-76911b641b92 req-869bccc7-becf-4b50-b1ef-da087b5d4ddd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Apr 09 21:53:56.418637 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3537/7050] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:53:56.938933 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:53:56.939571 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:53:56.947885 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:56.948353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:56.949186 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:53:56.949633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:53:56.963213 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] HTTP exception thrown: Instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 could not be found. Apr 09 21:53:56.963816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Returning 404 to user: Instance 9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:53:56.964659 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8ad7c362-4a67-4596-ab25-7f2285f7b5d1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1" status: 404 len: 111 microversion: 2.1 time: 0.032315 Apr 09 21:53:56.965230 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3514/7051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:53:56 2022] GET /compute/v2.1/servers/9a015644-b1cc-4915-9b07-a4ebb1a8b9a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:54:00.404009 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9160a975-07b6-4eab-870f-87e414cb9fca tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '.version_select at 0x7fb08ec54af0>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:00.425180 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9160a975-07b6-4eab-870f-87e414cb9fca tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1234508430" status: 202 len: 0 microversion: 2.1 time: 0.025481 Apr 09 21:54:00.426112 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3538/7052] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:54:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1234508430 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 21:54:00.455993 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: .version_select at 0x7fb08edebca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1117169219"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:00.483334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:54:00.490040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:54:00.737004 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:54:00.742109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:54:00.756784 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c2173bc6-6416-49d9-a004-e31bb7ecdf2e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.311897 Apr 09 21:54:00.757370 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3515/7053] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:54:00 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:06.353393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1519315307", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "e92f4914-5f97-435b-934d-ad526843b5ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1117169219", "security_groups": [{"name": "tempest-secgroup-smoke-798987818"}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:06.478761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] validate_networks() for [('e92f4914-5f97-435b-934d-ad526843b5ed', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:54:07.026507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:54:07.026938 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:54:07.030084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:54:07.030552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:54:07.031059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:54:07.044946 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:07.045445 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:07.046275 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:07.046726 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:07.071109 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:54:07.077828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:54:07.095961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:54:07.099817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:54:07.154109 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78613abf-cbda-424b-b700-5507b7a67755 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.806054 Apr 09 21:54:07.155583 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3539/7054] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:54:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:54:07.167092 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1fac91d-284c-41c1-bd46-b10990852b36 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:07.168336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1fac91d-284c-41c1-bd46-b10990852b36 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:07.241279 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1fac91d-284c-41c1-bd46-b10990852b36 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:07.254096 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1fac91d-284c-41c1-bd46-b10990852b36 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1267 microversion: 2.1 time: 0.092029 Apr 09 21:54:07.263774 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3516/7055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:07 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:08.271265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:08.271873 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:08.288157 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:08.293926 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:08.294961 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:08.296214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:08.461376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:08.470545 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-941ba07c-bd61-43fb-8902-3cb5bac1f96a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1327 microversion: 2.1 time: 0.203206 Apr 09 21:54:08.471551 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3540/7056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:08 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1327 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:09.488224 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:09.489003 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:09.499363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:09.499832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:09.500631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:09.501136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:09.636778 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:09.644374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-48fdef35-8032-4c8d-9f0b-c0a7fbafd3ce tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.160361 Apr 09 21:54:09.645209 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3517/7057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:09 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:10.152812 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c031f07e-b2a8-4a4d-bb3f-1855d27a872a req-a41c6701-b248-4b11-9723-47201e460930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b12720-50c2-4e3b-9067-1d3e28082a31", "tag": "af646b84-7752-4e4c-b8f5-11c2a3b3ba9c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:10.163547 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c031f07e-b2a8-4a4d-bb3f-1855d27a872a req-a41c6701-b248-4b11-9723-47201e460930 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:10.164000 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c031f07e-b2a8-4a4d-bb3f-1855d27a872a req-a41c6701-b248-4b11-9723-47201e460930 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:10.175620 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c031f07e-b2a8-4a4d-bb3f-1855d27a872a req-a41c6701-b248-4b11-9723-47201e460930 service nova] Creating event network-changed:af646b84-7752-4e4c-b8f5-11c2a3b3ba9c for instance 50b12720-50c2-4e3b-9067-1d3e28082a31 on nch2-master-1 Apr 09 21:54:10.180956 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c031f07e-b2a8-4a4d-bb3f-1855d27a872a req-a41c6701-b248-4b11-9723-47201e460930 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087410 Apr 09 21:54:10.182009 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3541/7058] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 21:54:10.666414 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:10.667275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:10.679208 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:10.679987 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:10.681381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:10.681836 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:10.817424 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:10.829452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-77258d07-c43e-4e5c-bd02-62a7a33ffc2b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.169560 Apr 09 21:54:10.830333 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3518/7059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:10 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:11.848243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:11.849351 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:11.857652 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:11.858080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:11.858855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:11.859292 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:11.992663 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:12.000326 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ee1032fd-5405-4355-82b7-1cf69c62d190 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.156762 Apr 09 21:54:12.000907 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3542/7060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:11 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:13.017799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:13.018378 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:13.025617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:13.026084 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:13.027175 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:13.027631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:13.162562 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:13.170920 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1209f5a4-d0f3-440d-ae6a-b0182fc7aaeb tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.157263 Apr 09 21:54:13.171518 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3519/7061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:13 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:14.189324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:14.189978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:14.197193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:14.197735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:14.198561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:14.199217 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:14.341521 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:14.349896 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d5cbb52e-dfb4-4b79-a100-ccef43da377d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.165511 Apr 09 21:54:14.350862 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3543/7062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:14 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:15.368539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:15.369253 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:15.376079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:15.376541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:15.377350 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:15.377835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:15.523572 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:15.531898 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-36e41f2b-efd7-497e-b202-0c6e44ac4521 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.167892 Apr 09 21:54:15.534844 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3520/7063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:15 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:16.554797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:16.555432 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:16.562566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:16.563015 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:16.563790 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:16.564225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:16.703979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:16.711540 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aca95924-0cf1-4227-9314-f90ad2605e17 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.162922 Apr 09 21:54:16.712099 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3544/7064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:16 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:16.949241 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8a1bb623-9f38-4b23-a447-06bb7b72fdd5 req-74f2da4a-de64-4b33-b6e3-1a5e8662a6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b12720-50c2-4e3b-9067-1d3e28082a31", "name": "network-vif-plugged", "status": "completed", "tag": "af646b84-7752-4e4c-b8f5-11c2a3b3ba9c"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:16.957754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8a1bb623-9f38-4b23-a447-06bb7b72fdd5 req-74f2da4a-de64-4b33-b6e3-1a5e8662a6ab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:16.958145 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8a1bb623-9f38-4b23-a447-06bb7b72fdd5 req-74f2da4a-de64-4b33-b6e3-1a5e8662a6ab service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:16.969082 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8a1bb623-9f38-4b23-a447-06bb7b72fdd5 req-74f2da4a-de64-4b33-b6e3-1a5e8662a6ab service nova] Creating event network-vif-plugged:af646b84-7752-4e4c-b8f5-11c2a3b3ba9c for instance 50b12720-50c2-4e3b-9067-1d3e28082a31 on nch2-master-1 Apr 09 21:54:16.974387 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8a1bb623-9f38-4b23-a447-06bb7b72fdd5 req-74f2da4a-de64-4b33-b6e3-1a5e8662a6ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081838 Apr 09 21:54:16.975271 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3521/7065] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:54:17.733471 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:17.734113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:17.741500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:17.741950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:17.742751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:17.743195 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:17.875542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:17.883095 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-41a1c5a6-1658-42a6-8521-18958fb12b2a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1392 microversion: 2.1 time: 0.156169 Apr 09 21:54:17.883685 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3545/7066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:17 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:18.907697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:18.908586 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:18.915713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:18.916182 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:18.916966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:18.917452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:19.052101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:19.060065 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1c28ea1b-018d-4044-afc7-24ee3d62f005 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1565 microversion: 2.1 time: 0.159838 Apr 09 21:54:19.060735 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3522/7067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:18 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:19.078353 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:19.078983 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:19.086363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:19.086827 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:19.087614 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:19.088064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:19.227921 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:19.235682 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-930bcef7-069a-425d-8f94-0acc349cb95f tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1565 microversion: 2.1 time: 0.162926 Apr 09 21:54:19.236263 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3546/7068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:19 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:20.964480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:54:20.965734 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:20.966333 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-dd250473-c51b-409c-8562-bcf3918edb9f req-b83c80d9-5057-4d78-b6b8-1c3e0867fdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b12720-50c2-4e3b-9067-1d3e28082a31", "tag": "af646b84-7752-4e4c-b8f5-11c2a3b3ba9c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:20.973691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:20.974517 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:20.975854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:20.976407 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:20.976905 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd250473-c51b-409c-8562-bcf3918edb9f req-b83c80d9-5057-4d78-b6b8-1c3e0867fdc3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:20.977560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-dd250473-c51b-409c-8562-bcf3918edb9f req-b83c80d9-5057-4d78-b6b8-1c3e0867fdc3 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:20.993589 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-dd250473-c51b-409c-8562-bcf3918edb9f req-b83c80d9-5057-4d78-b6b8-1c3e0867fdc3 service nova] Creating event network-changed:af646b84-7752-4e4c-b8f5-11c2a3b3ba9c for instance 50b12720-50c2-4e3b-9067-1d3e28082a31 on nch2-master-1 Apr 09 21:54:20.999647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-dd250473-c51b-409c-8562-bcf3918edb9f req-b83c80d9-5057-4d78-b6b8-1c3e0867fdc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038366 Apr 09 21:54:21.004912 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3547/7069] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:54:21.124876 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:54:21.133292 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e770f446-5206-482e-bb41-06a7a094eb53 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1565 microversion: 2.1 time: 0.174556 Apr 09 21:54:21.134033 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3523/7070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:54:20 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:54:52.465194 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:54:52.466248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:54:52.473122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:52.473515 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:52.474294 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:54:52.474756 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:54:52.527834 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a145c76f-197d-4ae9-9856-94d91ce285aa tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action" status: 200 len: 24571 microversion: 2.1 time: 0.069468 Apr 09 21:54:52.528483 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3548/7071] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:54:52 2022] POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:54:57.890585 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:54:57.891539 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:55:22.875197 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0b9f940-0254-4689-8c65-56e126a91d52 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:55:22.881976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b9f940-0254-4689-8c65-56e126a91d52 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:22.882474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0b9f940-0254-4689-8c65-56e126a91d52 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:22.907103 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0b9f940-0254-4689-8c65-56e126a91d52 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Going to try to stop instance {{(pid=141819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 09 21:55:22.962045 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0b9f940-0254-4689-8c65-56e126a91d52 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action" status: 202 len: 0 microversion: 2.1 time: 0.092216 Apr 09 21:55:22.963062 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3524/7072] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:55:22 2022] POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:55:22.977481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:22.978912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:23.015493 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:23.016596 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:23.018962 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:23.026036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:23.185672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:23.200781 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-835a004e-dc4c-4b00-81bf-650ad3842e80 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.230262 Apr 09 21:55:23.201568 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3549/7073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:22 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:24.227469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:24.228643 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:24.238994 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:24.239464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:24.240329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:24.240776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:24.377553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:24.385947 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-de008f0b-c4b3-440b-b808-16e765b4f42b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.168552 Apr 09 21:55:24.386528 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3525/7074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:24 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:25.404207 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:25.404832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:25.412332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:25.412791 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:25.413613 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:25.414058 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:25.556205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:25.564626 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-03fda338-c0c0-4751-933f-4a235cd79e7a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.164840 Apr 09 21:55:25.565249 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3550/7075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:25 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:26.585900 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:26.586524 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:26.593738 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:26.594210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:26.594998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:26.595451 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:26.744775 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:26.753064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8e67d032-3f28-4584-8d4d-0ddfcacf08b3 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.174814 Apr 09 21:55:26.753692 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3526/7076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:26 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:27.774653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:27.775722 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:27.787295 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:27.788072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:27.789429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:27.790173 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:27.923854 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:27.931708 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4edd51d2-eea2-4812-baa3-bc4dbf7a6d1c tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.163753 Apr 09 21:55:27.932300 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3551/7077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:27 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:28.952699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:28.953674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:28.965210 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:28.965690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:28.966492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:28.966950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:29.111348 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:29.119367 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-5ba1d2e9-30e0-4e4c-aa45-8eef631fee40 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.173346 Apr 09 21:55:29.119960 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3527/7078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:28 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:30.140553 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:30.141646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:30.153139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:30.153930 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:30.155216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:30.155949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:30.294082 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:30.301918 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7c218f1-8868-4314-b4ce-6944ea09579d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.168048 Apr 09 21:55:30.302539 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3552/7079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:30 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:31.319808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:31.320397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:31.327997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:31.328483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:31.329347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:31.329816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:31.469593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:31.477501 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7039ca6c-6bca-41b4-9351-a1df941e8def tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.161976 Apr 09 21:55:31.478056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3528/7080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:31 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:32.494383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:32.494954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:32.501988 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:32.502453 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:32.503228 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:32.503671 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:32.638923 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:32.646966 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f792d3e4-4c03-41e5-8187-d165ada6c19b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1694 microversion: 2.1 time: 0.156673 Apr 09 21:55:32.647564 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3553/7081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:32 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:33.668228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:33.669509 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:33.680520 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:33.681367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:33.682691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:33.683521 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:33.820474 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:33.828520 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7bef790b-fcb1-41ea-8fe1-de8ebcc6e12a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1671 microversion: 2.1 time: 0.167230 Apr 09 21:55:33.829113 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3529/7082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:33 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:34.929972 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:55:34.931043 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:34.939494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:34.939951 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:34.940735 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:34.941226 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:34.997159 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d82f011c-2766-492a-bae3-b13c228a0a09 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action" status: 200 len: 35613 microversion: 2.1 time: 0.071053 Apr 09 21:55:34.998382 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3554/7083] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:55:34 2022] POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action => generated 35613 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:55:35.010040 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e0f06d16-3582-4807-a2a6-176fc1cc7fad tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:55:35.017577 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0f06d16-3582-4807-a2a6-176fc1cc7fad tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:35.018035 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e0f06d16-3582-4807-a2a6-176fc1cc7fad tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:35.040707 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e0f06d16-3582-4807-a2a6-176fc1cc7fad tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Going to try to start instance {{(pid=141819) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 09 21:55:35.093228 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e0f06d16-3582-4807-a2a6-176fc1cc7fad tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action" status: 202 len: 0 microversion: 2.1 time: 0.086951 Apr 09 21:55:35.093872 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3530/7084] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:55:35 2022] POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:55:35.104439 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:35.105216 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:35.113527 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:35.113977 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:35.114883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:35.115391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:35.252805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:35.260536 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4163f4f0-0f73-4519-b368-b0333d94a705 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1680 microversion: 2.1 time: 0.160785 Apr 09 21:55:35.261199 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3555/7085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:35 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:55:36.279821 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:55:36.280431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:55:36.288191 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:36.288693 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:36.289630 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:55:36.290725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:55:36.744497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:55:36.752351 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-965a0243-e43c-4f05-80e1-2d21b5fdd899 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1684 microversion: 2.1 time: 0.477233 Apr 09 21:55:36.752945 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3531/7086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:55:36 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1684 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:09.026145 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:09.027089 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:09.034361 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:09.034818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:09.035607 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:09.036048 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:09.087186 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c3330930-7551-4e80-af7b-dfc1d8e51d04 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action" status: 200 len: 60164 microversion: 2.1 time: 0.065002 Apr 09 21:56:09.087860 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3556/7087] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:56:09 2022] POST /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31/action => generated 60164 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:56:33.027212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:33.027962 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:33.029781 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-1e9c3388-8789-45e9-a65e-e5424c7c17fb req-8f3576e9-8972-42da-83e2-d5241edfa149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b12720-50c2-4e3b-9067-1d3e28082a31", "tag": "af646b84-7752-4e4c-b8f5-11c2a3b3ba9c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:33.034749 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:33.035299 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:33.036176 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:33.036702 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:33.039665 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1e9c3388-8789-45e9-a65e-e5424c7c17fb req-8f3576e9-8972-42da-83e2-d5241edfa149 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:33.040121 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-1e9c3388-8789-45e9-a65e-e5424c7c17fb req-8f3576e9-8972-42da-83e2-d5241edfa149 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:33.051628 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-1e9c3388-8789-45e9-a65e-e5424c7c17fb req-8f3576e9-8972-42da-83e2-d5241edfa149 service nova] Creating event network-changed:af646b84-7752-4e4c-b8f5-11c2a3b3ba9c for instance 50b12720-50c2-4e3b-9067-1d3e28082a31 on nch2-master-1 Apr 09 21:56:33.057213 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-1e9c3388-8789-45e9-a65e-e5424c7c17fb req-8f3576e9-8972-42da-83e2-d5241edfa149 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031822 Apr 09 21:56:33.058325 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3557/7088] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:56:33.062799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:56:33.157622 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ca220de7-0386-4e71-a458-e957266bab9a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 204 len: 0 microversion: 2.1 time: 0.134364 Apr 09 21:56:33.158333 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3532/7089] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:56:33 2022] DELETE /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:56:33.169618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:33.170595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:33.178181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:33.178894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:33.180031 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:33.180649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:33.318097 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:33.325770 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-22e8f33f-ce03-404b-b91a-0afc9e1a6f81 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1690 microversion: 2.1 time: 0.162219 Apr 09 21:56:33.326354 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3558/7090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:33 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:34.344787 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:34.345506 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:34.352991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:34.353516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:34.354302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:34.354756 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:34.500100 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:34.507944 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7d58bce2-a6d0-43c5-8e47-91e5253bc4f1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1690 microversion: 2.1 time: 0.168093 Apr 09 21:56:34.508541 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3533/7091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:34 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:35.454625 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-cdb865b0-a1d1-4a97-8ac1-be273d2b93ed req-03f22cd6-084c-4841-baff-84b42e236f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b12720-50c2-4e3b-9067-1d3e28082a31", "name": "network-vif-deleted", "tag": "af646b84-7752-4e4c-b8f5-11c2a3b3ba9c"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:35.465246 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cdb865b0-a1d1-4a97-8ac1-be273d2b93ed req-03f22cd6-084c-4841-baff-84b42e236f66 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:35.465692 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-cdb865b0-a1d1-4a97-8ac1-be273d2b93ed req-03f22cd6-084c-4841-baff-84b42e236f66 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:35.477671 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-cdb865b0-a1d1-4a97-8ac1-be273d2b93ed req-03f22cd6-084c-4841-baff-84b42e236f66 service nova] Creating event network-vif-deleted:af646b84-7752-4e4c-b8f5-11c2a3b3ba9c for instance 50b12720-50c2-4e3b-9067-1d3e28082a31 on nch2-master-1 Apr 09 21:56:35.482645 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-cdb865b0-a1d1-4a97-8ac1-be273d2b93ed req-03f22cd6-084c-4841-baff-84b42e236f66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033712 Apr 09 21:56:35.483254 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3559/7092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:56:35.524725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:35.525432 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:35.533484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:35.533953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:35.535495 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:35.535963 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:35.570166 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:35.570634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:35.571089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lazy-loading 'fault' on Instance uuid 50b12720-50c2-4e3b-9067-1d3e28082a31 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:56:35.613418 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:35.620954 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-191a661e-c0cd-4a2e-bb45-3e70a7128bfc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 200 len: 1357 microversion: 2.1 time: 0.100409 Apr 09 21:56:35.621572 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3534/7093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:35 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:36.644626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:36.645833 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 50b12720-50c2-4e3b-9067-1d3e28082a31] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:36.653390 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:36.653850 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:36.654640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:36.655088 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:36.668869 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] HTTP exception thrown: Instance 50b12720-50c2-4e3b-9067-1d3e28082a31 could not be found. Apr 09 21:56:36.669508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Returning 404 to user: Instance 50b12720-50c2-4e3b-9067-1d3e28082a31 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:56:36.670354 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-34c6be88-72df-4cc2-8a2d-2e098d6c3aed tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31" status: 404 len: 111 microversion: 2.1 time: 0.034391 Apr 09 21:56:36.670905 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3560/7094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:36 2022] GET /compute/v2.1/servers/50b12720-50c2-4e3b-9067-1d3e28082a31 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:56:37.838681 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:56:37.839377 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 21:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 21:56:40.466664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-590e5a89-a41d-41a3-a8c8-972be1550287 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '.version_select at 0x7fb08ef03dc0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:40.493641 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-590e5a89-a41d-41a3-a8c8-972be1550287 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117169219" status: 202 len: 0 microversion: 2.1 time: 0.030852 Apr 09 21:56:40.498606 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3535/7095] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117169219 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:56:40.519183 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: .version_select at 0x7fb08ec36700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1988389035"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:40.542818 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:56:40.551443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:56:40.565837 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 21:56:41.080707 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 21:56:41.081095 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 21:56:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Apr 09 21:56:41.576677 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49456. Apr 09 21:56:41.766508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:56:41.771367 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:56:41.786480 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aa2f7c5e-ae73-4897-b988-3d47f466e880 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 1.271394 Apr 09 21:56:41.787079 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3561/7096] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:56:40 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:56:47.484676 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-122058701", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "networks": [{"uuid": "51fb269c-9780-4d40-b61f-09a83c420f09"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1988389035", "security_groups": [{"name": "tempest-secgroup-smoke-1900005883"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:47.596590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] validate_networks() for [('51fb269c-9780-4d40-b61f-09a83c420f09', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:56:48.087305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:56:48.087760 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:56:48.088276 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:56:48.088665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:56:48.089104 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:56:48.098606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:48.099066 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:48.099907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:48.100364 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:48.123931 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:56:48.129420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Getting quotas for user 825f74ae6ae748e2a963ec24f8498b3a and project 91139f4484934b158e5ee647130aa2cd. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:56:48.142136 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:56:48.144529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:56:48.191883 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2efdc795-cdbb-4865-9ba8-b1c563113bd0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711361 Apr 09 21:56:48.193139 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3536/7097] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:56:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:56:48.204261 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1bd06c50-df65-46a0-b9bf-9814db06c51e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:48.205181 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1bd06c50-df65-46a0-b9bf-9814db06c51e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:48.275668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1bd06c50-df65-46a0-b9bf-9814db06c51e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:48.284243 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1bd06c50-df65-46a0-b9bf-9814db06c51e tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1266 microversion: 2.1 time: 0.084931 Apr 09 21:56:48.287957 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3562/7098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:48 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:49.301629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:49.302248 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:49.309005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:49.309504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:49.310969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:49.311619 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:49.393117 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:49.410450 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-69968621-4b2b-4fd6-a834-2cb2195857cc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1326 microversion: 2.1 time: 0.113832 Apr 09 21:56:49.422981 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3537/7099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:49 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:50.443549 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:50.444797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:50.464460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:50.465214 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:50.466265 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:50.468338 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:50.697628 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:50.705879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3bc4dcdd-3675-4cea-bb55-e30d0bcc61d8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.274440 Apr 09 21:56:50.706857 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3563/7100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:50 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:50.965556 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-fd09d162-7899-47fb-8bcc-55408ad4a7c5 req-dfff03ec-8fcb-485f-ba85-820b7562b32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530ab872-fb87-4cf4-8256-77c8edc4a2d8", "tag": "fb5334e5-4247-41da-84e2-df711ff62742"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:50.978920 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fd09d162-7899-47fb-8bcc-55408ad4a7c5 req-dfff03ec-8fcb-485f-ba85-820b7562b32c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:50.979428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-fd09d162-7899-47fb-8bcc-55408ad4a7c5 req-dfff03ec-8fcb-485f-ba85-820b7562b32c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:50.997478 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-fd09d162-7899-47fb-8bcc-55408ad4a7c5 req-dfff03ec-8fcb-485f-ba85-820b7562b32c service nova] Creating event network-changed:fb5334e5-4247-41da-84e2-df711ff62742 for instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 on nch1-master-1 Apr 09 21:56:51.006657 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-fd09d162-7899-47fb-8bcc-55408ad4a7c5 req-dfff03ec-8fcb-485f-ba85-820b7562b32c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044589 Apr 09 21:56:51.007671 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3538/7101] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:56:51.727704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:51.728698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:51.740626 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:51.741465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:51.742391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:51.742839 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:51.882343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:51.890438 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-152f9c75-cf77-48e2-af2e-36397d842835 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.169745 Apr 09 21:56:51.891030 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3564/7102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:51 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:52.915940 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:52.916600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:52.924979 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:52.925542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:52.926427 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:52.926930 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:53.068360 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:53.083105 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-db2b86ac-3491-482b-aac7-5d2dd585104a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.173396 Apr 09 21:56:53.083962 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3539/7103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:52 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:54.106103 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:54.107080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:54.118063 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:54.118867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:54.120126 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:54.120867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:54.255887 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:54.263498 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9368ef12-45a2-465f-baed-e385e0437523 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.165047 Apr 09 21:56:54.264053 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3565/7104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:54 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:55.284234 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:55.285153 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:55.296318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:55.297090 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:55.298455 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:55.299206 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:55.436462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:55.444190 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-726e8d53-3ca3-417e-8bab-67c460894cd9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.166928 Apr 09 21:56:55.444818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3540/7105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:55 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:56.460755 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:56.461400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:56.468617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:56.469100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:56.469912 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:56.470345 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:56.611759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:56.619789 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d29ad9c1-1a74-4593-bee2-805b5da5a20b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.163043 Apr 09 21:56:56.620402 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3566/7106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:56 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:57.645452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:57.646471 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:57.655384 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:57.655853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:57.656647 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:57.657138 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:57.795832 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:57.803535 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-4ea7a9b1-3a44-4066-960c-a760c8af9b5b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.164800 Apr 09 21:56:57.804361 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3541/7107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:57 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:56:57.964403 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bb38c47e-3fa5-4e65-90c1-f4f8dcba4128 req-8888f87f-6ca4-4731-8dc8-cd138aa32777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530ab872-fb87-4cf4-8256-77c8edc4a2d8", "name": "network-vif-plugged", "status": "completed", "tag": "fb5334e5-4247-41da-84e2-df711ff62742"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:56:57.974003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bb38c47e-3fa5-4e65-90c1-f4f8dcba4128 req-8888f87f-6ca4-4731-8dc8-cd138aa32777 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:57.974456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bb38c47e-3fa5-4e65-90c1-f4f8dcba4128 req-8888f87f-6ca4-4731-8dc8-cd138aa32777 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:57.986581 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bb38c47e-3fa5-4e65-90c1-f4f8dcba4128 req-8888f87f-6ca4-4731-8dc8-cd138aa32777 service nova] Creating event network-vif-plugged:fb5334e5-4247-41da-84e2-df711ff62742 for instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 on nch1-master-1 Apr 09 21:56:57.991730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bb38c47e-3fa5-4e65-90c1-f4f8dcba4128 req-8888f87f-6ca4-4731-8dc8-cd138aa32777 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031173 Apr 09 21:56:57.992793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3567/7108] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:56:58.824048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:56:58.824860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:56:58.833790 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:58.834381 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:58.835382 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:56:58.835951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:56:58.972568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:56:58.984780 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-dae5de7d-f619-4e16-b259-319dd6d79fcf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1392 microversion: 2.1 time: 0.166819 Apr 09 21:56:58.985582 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3542/7109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:56:58 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:00.011750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:00.012404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:00.019315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:00.019775 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:00.020560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:00.021004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:00.155002 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:00.163193 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-38f23370-6697-483d-8a94-878815122a4a tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1563 microversion: 2.1 time: 0.160242 Apr 09 21:57:00.163787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3568/7110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:00 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:00.179911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:00.180536 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:00.187715 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:00.188172 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:00.188951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:00.189431 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:00.331265 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:00.339110 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee7ffc80-fbf2-4ba1-a395-9b82ab9cf361 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1563 microversion: 2.1 time: 0.163128 Apr 09 21:57:00.339798 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3543/7111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:00 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:57:02.033959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:02.034590 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:02.035947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-5c64c336-9ffb-4153-b969-91a7c22921f2 req-96a3ebf0-f657-47ba-b5bb-562409f4176b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530ab872-fb87-4cf4-8256-77c8edc4a2d8", "tag": "fb5334e5-4247-41da-84e2-df711ff62742"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:02.041678 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:02.042136 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:02.042935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:02.044523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:02.045871 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c64c336-9ffb-4153-b969-91a7c22921f2 req-96a3ebf0-f657-47ba-b5bb-562409f4176b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:02.046449 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-5c64c336-9ffb-4153-b969-91a7c22921f2 req-96a3ebf0-f657-47ba-b5bb-562409f4176b service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:02.058693 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-5c64c336-9ffb-4153-b969-91a7c22921f2 req-96a3ebf0-f657-47ba-b5bb-562409f4176b service nova] Creating event network-changed:fb5334e5-4247-41da-84e2-df711ff62742 for instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 on nch1-master-1 Apr 09 21:57:02.064145 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-5c64c336-9ffb-4153-b969-91a7c22921f2 req-96a3ebf0-f657-47ba-b5bb-562409f4176b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032110 Apr 09 21:57:02.065532 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3544/7112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:57:02.269357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:02.277525 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c26d80b-0637-4a95-a386-44934ce7c531 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1563 microversion: 2.1 time: 0.248033 Apr 09 21:57:02.278412 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3569/7113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:02 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:23.864353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:23.865408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:23.872354 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:23.872822 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:23.873725 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:23.874183 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:23.931402 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a137b7da-06ed-450f-9a23-1196bb4f9bba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action" status: 200 len: 24562 microversion: 2.1 time: 0.072340 Apr 09 21:57:23.932191 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3545/7114] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:57:23 2022] POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action => generated 24562 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:57:34.874542 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:34.875528 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:34.884029 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:34.884483 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:34.885301 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:34.885740 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:34.908655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.objects.instance [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lazy-loading 'flavor' on Instance uuid 530ab872-fb87-4cf4-8256-77c8edc4a2d8 {{(pid=141818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:57:34.988647 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-18a85cd6-d5a7-4c74-a6dc-0e9ed458233d tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action" status: 202 len: 0 microversion: 2.1 time: 0.121084 Apr 09 21:57:34.989386 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3570/7115] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:57:34 2022] POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:57:34.999927 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:35.000651 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:35.008660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:35.009366 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:35.010268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:35.010727 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:35.145496 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:35.153213 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0fcd85ed-376d-4ad1-88b7-c2db5a738cba tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1689 microversion: 2.1 time: 0.158314 Apr 09 21:57:35.153814 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3546/7116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:34 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:36.172212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:36.172949 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:36.179761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:36.180219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:36.181008 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:36.181561 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:36.317502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:36.326233 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-59aa1d3a-1d24-4e8f-b74e-777f73a90529 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1672 microversion: 2.1 time: 0.159489 Apr 09 21:57:36.326820 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3571/7117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:36 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:37.426777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:37.427982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:37.436896 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.437428 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.438242 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.438699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.495749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f013968e-1b07-4dcf-b562-786270a6245b tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action" status: 200 len: 38333 microversion: 2.1 time: 0.074720 Apr 09 21:57:37.496522 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3547/7118] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:57:37 2022] POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action => generated 38333 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:57:37.508836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:37.509507 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:37.517673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.518130 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.518920 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.519363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.600440 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-475f61d8-fd7d-4357-99cc-2a8f0e32e9f8 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action" status: 202 len: 0 microversion: 2.1 time: 0.095937 Apr 09 21:57:37.601422 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3572/7119] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:57:37 2022] POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:57:37.610644 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:37.611443 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:37.618852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.619308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.620102 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:37.620598 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:37.815600 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:37.823234 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f3ea5fc6-0b59-4f16-93f8-3baaca4a2d79 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1678 microversion: 2.1 time: 0.217091 Apr 09 21:57:37.823848 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3548/7120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:37 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:57:38.842391 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:38.843116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:38.851579 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:38.852037 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:38.852845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:38.853310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:39.142597 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:39.150577 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ad24911-e3e1-4b94-959b-440e73be55a9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1678 microversion: 2.1 time: 0.312845 Apr 09 21:57:39.151162 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3573/7121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:38 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1678 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:40.172306 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:40.173380 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:40.183365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:40.183827 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:40.184612 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:40.185083 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:40.327945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:40.335592 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-544eb05d-1233-4c9d-a734-0d656a28cb72 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1681 microversion: 2.1 time: 0.169892 Apr 09 21:57:40.336154 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3549/7122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:40 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:40.430179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:40.431055 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:40.438592 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:40.439052 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:40.439874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:40.440314 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:40.480794 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd6839c0-cf13-4e47-8e0a-ae154ecc7ac1 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action" status: 200 len: 38333 microversion: 2.1 time: 0.056262 Apr 09 21:57:40.481512 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3574/7123] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 21:57:40 2022] POST /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8/action => generated 38333 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 21:57:41.548337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-d52f43c0-5f04-4cae-9eb0-d7c8ba06a5f9 req-071f9f45-e7a6-49e1-9e89-7c00564e25e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530ab872-fb87-4cf4-8256-77c8edc4a2d8", "tag": "fb5334e5-4247-41da-84e2-df711ff62742"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:41.551430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:41.552173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:41.559655 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:41.560126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:41.561247 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:41.561946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:41.565516 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d52f43c0-5f04-4cae-9eb0-d7c8ba06a5f9 req-071f9f45-e7a6-49e1-9e89-7c00564e25e6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:41.567036 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-d52f43c0-5f04-4cae-9eb0-d7c8ba06a5f9 req-071f9f45-e7a6-49e1-9e89-7c00564e25e6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:41.577596 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-d52f43c0-5f04-4cae-9eb0-d7c8ba06a5f9 req-071f9f45-e7a6-49e1-9e89-7c00564e25e6 service nova] Creating event network-changed:fb5334e5-4247-41da-84e2-df711ff62742 for instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 on nch1-master-1 Apr 09 21:57:41.583235 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-d52f43c0-5f04-4cae-9eb0-d7c8ba06a5f9 req-071f9f45-e7a6-49e1-9e89-7c00564e25e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039287 Apr 09 21:57:41.584189 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3575/7124] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:57:41.588854 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 21:57:41.678749 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d3172f6c-ecba-4eab-b868-9439294a1df0 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 204 len: 0 microversion: 2.1 time: 0.137919 Apr 09 21:57:41.682790 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3550/7125] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 21:57:41 2022] DELETE /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 21:57:41.690102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:41.690817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:41.697182 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:41.697635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:41.698629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:41.699076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:41.848616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:41.856989 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb32a8cc-40c7-4e80-a637-e3438ba82873 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1687 microversion: 2.1 time: 0.172795 Apr 09 21:57:41.857614 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3576/7126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:41 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 21:57:42.876785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:42.877410 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:42.885072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:42.885583 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:42.886365 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:42.886811 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:43.087530 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:43.095653 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a5e930c6-4c18-4a51-8832-ee5c718db0d9 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1687 microversion: 2.1 time: 0.223670 Apr 09 21:57:43.096368 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3551/7127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:42 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:43.779346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-e971e65d-2fdf-4947-ae03-5350f1d4f0b4 req-644bcedf-1f3b-4e77-933f-c7fd0188b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530ab872-fb87-4cf4-8256-77c8edc4a2d8", "name": "network-vif-deleted", "tag": "fb5334e5-4247-41da-84e2-df711ff62742"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:57:43.790166 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e971e65d-2fdf-4947-ae03-5350f1d4f0b4 req-644bcedf-1f3b-4e77-933f-c7fd0188b2a4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:43.790874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-e971e65d-2fdf-4947-ae03-5350f1d4f0b4 req-644bcedf-1f3b-4e77-933f-c7fd0188b2a4 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:43.802731 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-e971e65d-2fdf-4947-ae03-5350f1d4f0b4 req-644bcedf-1f3b-4e77-933f-c7fd0188b2a4 service nova] Creating event network-vif-deleted:fb5334e5-4247-41da-84e2-df711ff62742 for instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 on nch1-master-1 Apr 09 21:57:43.807716 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-e971e65d-2fdf-4947-ae03-5350f1d4f0b4 req-644bcedf-1f3b-4e77-933f-c7fd0188b2a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Apr 09 21:57:43.808342 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3577/7128] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:57:44.114601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:44.115225 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:44.122340 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:44.122807 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:44.123607 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:44.124030 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:44.161469 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:44.162548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:44.163021 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lazy-loading 'fault' on Instance uuid 530ab872-fb87-4cf4-8256-77c8edc4a2d8 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 21:57:44.215079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825f74ae6ae748e2a963ec24f8498b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91139f4484934b158e5ee647130aa2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:57:44.223590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-20d54f46-e1b8-4646-b8f5-04b86e63d333 tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 200 len: 1356 microversion: 2.1 time: 0.112853 Apr 09 21:57:44.234781 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3552/7129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:44 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 1356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:57:45.248092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:45.249299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] [instance: 530ab872-fb87-4cf4-8256-77c8edc4a2d8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:57:45.260125 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:45.260582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:45.261426 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:57:45.261875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:57:45.276084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] HTTP exception thrown: Instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 could not be found. Apr 09 21:57:45.276674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Returning 404 to user: Instance 530ab872-fb87-4cf4-8256-77c8edc4a2d8 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 21:57:45.277550 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ab052a41-3b16-4773-92b0-c11ecdda4ecf tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8" status: 404 len: 111 microversion: 2.1 time: 0.038266 Apr 09 21:57:45.278096 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3578/7130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:57:45 2022] GET /compute/v2.1/servers/530ab872-fb87-4cf4-8256-77c8edc4a2d8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 21:57:48.712440 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2d41820-5dd8-4e2c-8f5b-612a1b8315fc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] Calling method '.version_select at 0x7fb08e1f31f0>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:57:48.734590 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2d41820-5dd8-4e2c-8f5b-612a1b8315fc tempest-TestNetworkAdvancedServerOps-1131741307 tempest-TestNetworkAdvancedServerOps-1131741307-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1988389035" status: 202 len: 0 microversion: 2.1 time: 0.025906 Apr 09 21:57:48.738688 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3553/7131] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Apr 9 21:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1988389035 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 21:58:00.195858 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'create', calling method: .version_select at 0x7fb08ef7f310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1679869350"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:58:00.212312 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:58:00.217462 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:58:00.365836 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:58:00.370928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:58:00.387474 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f056c1f8-90e1-47f5-8104-c3388fa1dc45 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.376447 Apr 09 21:58:00.388570 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3579/7132] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 21:58:00 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:01.469116 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1140479890", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1679869350", "security_groups": [{"name": "tempest-secgroup-smoke-1859755784"}], "networks": [{"uuid": "b2d82b12-1202-41ee-a05a-aad7a687d585"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:58:01.577129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] validate_networks() for [('b2d82b12-1202-41ee-a05a-aad7a687d585', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 21:58:01.962543 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 21:58:01.962983 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 21:58:01.963529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 21:58:01.963951 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 21:58:01.964374 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 21:58:01.974421 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:01.974929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:01.975713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:01.976508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:01.993966 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 21:58:01.999694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 21:58:02.012714 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 21:58:02.015089 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 21:58:02.062702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cda2dcac-a727-402c-ab52-1879c9b922d9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.598502 Apr 09 21:58:02.063347 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3554/7133] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 21:58:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 21:58:02.074389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c6b3c329-2977-4d51-aa39-630d389313a4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:02.075019 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c6b3c329-2977-4d51-aa39-630d389313a4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:02.134357 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c6b3c329-2977-4d51-aa39-630d389313a4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:02.141237 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c6b3c329-2977-4d51-aa39-630d389313a4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1247 microversion: 2.1 time: 0.071735 Apr 09 21:58:02.141782 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3580/7134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:02 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:03.159606 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:03.160240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:03.168709 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:03.169192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:03.170458 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:03.170913 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:03.238433 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:03.246965 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-99b1e4dd-fdf4-4ed7-a971-85042d90a823 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1305 microversion: 2.1 time: 0.092255 Apr 09 21:58:03.248155 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3555/7135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:03 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:04.264582 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:04.265258 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:04.278674 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:04.279111 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:04.279900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:04.280332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:04.470074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:04.478942 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-200f4580-a050-4828-a6dc-3c5ed665be87 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.218505 Apr 09 21:58:04.480889 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3581/7136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:04 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:04.639674 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-43917030-74a7-496c-8c66-8fdfebae9775 req-28046878-aa4e-4d44-9dc7-5ca01b63c5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:58:04.651323 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-43917030-74a7-496c-8c66-8fdfebae9775 req-28046878-aa4e-4d44-9dc7-5ca01b63c5ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:04.654544 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-43917030-74a7-496c-8c66-8fdfebae9775 req-28046878-aa4e-4d44-9dc7-5ca01b63c5ba service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:04.685903 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-43917030-74a7-496c-8c66-8fdfebae9775 req-28046878-aa4e-4d44-9dc7-5ca01b63c5ba service nova] Creating event network-changed:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch2-master-1 Apr 09 21:58:04.693839 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-43917030-74a7-496c-8c66-8fdfebae9775 req-28046878-aa4e-4d44-9dc7-5ca01b63c5ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057791 Apr 09 21:58:04.703435 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3556/7137] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:58:05.496053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:05.496810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:05.504113 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:05.504574 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:05.505414 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:05.505865 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:05.657492 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:05.668084 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-edbef243-b57b-4aa8-bcd9-a6b4f97b6062 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.175738 Apr 09 21:58:05.668824 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3582/7138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:05 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:06.690545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:06.691648 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:06.701466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:06.701922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:06.702712 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:06.703163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:06.933858 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:06.942266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75f05d51-07c1-4572-96cc-6c0f06a3270e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.259023 Apr 09 21:58:06.942812 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3557/7139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:06 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:07.960855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:07.962135 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:07.969188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:07.969635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:07.970413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:07.970848 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:08.159421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:08.167480 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cb715b40-4f59-4218-ac97-15790859b616 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.210685 Apr 09 21:58:08.168059 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3583/7140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:07 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:09.188593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:09.189634 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:09.199891 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:09.200351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:09.201169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:09.201618 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:09.357947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:09.365912 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b0daa708-97bb-4cab-890a-13b7eacc8d0a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.183973 Apr 09 21:58:09.366531 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3558/7141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:09 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:10.387012 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:10.388021 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:10.399925 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:10.400571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:10.401605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:10.402049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:10.536404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:10.544014 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-71ce2024-9242-4bbb-a44e-94ab710cb751 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.163625 Apr 09 21:58:10.544596 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3584/7142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:10 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:11.565258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:11.566339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:11.576023 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:11.576497 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:11.577335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:11.577798 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:11.717633 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:11.725237 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e29be67f-2e8e-4415-a8d1-16cda0fadb1a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.166682 Apr 09 21:58:11.725826 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3559/7143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:11 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:12.086362 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bd58c663-0aeb-4376-bfd1-529c2f609421 req-fdbb54c4-1dff-41b3-9449-02e61841e50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "name": "network-vif-plugged", "status": "completed", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:58:12.095540 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd58c663-0aeb-4376-bfd1-529c2f609421 req-fdbb54c4-1dff-41b3-9449-02e61841e50d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:12.095998 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bd58c663-0aeb-4376-bfd1-529c2f609421 req-fdbb54c4-1dff-41b3-9449-02e61841e50d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:12.110291 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bd58c663-0aeb-4376-bfd1-529c2f609421 req-fdbb54c4-1dff-41b3-9449-02e61841e50d service nova] Creating event network-vif-plugged:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch2-master-1 Apr 09 21:58:12.115499 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bd58c663-0aeb-4376-bfd1-529c2f609421 req-fdbb54c4-1dff-41b3-9449-02e61841e50d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Apr 09 21:58:12.116144 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3585/7144] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 21:58:12.747762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:12.748999 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:12.760941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:12.761445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:12.762239 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:12.762691 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:12.909664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:12.917679 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-2240b206-f5fe-48b3-a074-f04a908858b4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1373 microversion: 2.1 time: 0.177210 Apr 09 21:58:12.918246 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3560/7145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:12 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:13.939618 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:13.940558 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:13.948942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:13.949555 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:13.950520 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:13.951066 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:14.088815 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:14.096665 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-744d72c1-6ee9-47f5-be87-649d84b7910a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1556 microversion: 2.1 time: 0.164175 Apr 09 21:58:14.097292 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3586/7146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:13 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:14.113484 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 21:58:14.114108 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 21:58:14.121024 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:14.121504 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:14.122370 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:14.122816 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:14.264919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 21:58:14.272561 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0d4f4c2e-8eb9-46d2-b90c-4d657ce42829 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1556 microversion: 2.1 time: 0.163079 Apr 09 21:58:14.273177 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3561/7147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 21:58:14 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 21:58:16.357704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-0b764fba-e262-48ff-b73e-f1819d593def req-e1eed9d2-2c5f-4c2e-b299-d508c0e5e80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 21:58:16.366594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0b764fba-e262-48ff-b73e-f1819d593def req-e1eed9d2-2c5f-4c2e-b299-d508c0e5e80f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 21:58:16.367044 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-0b764fba-e262-48ff-b73e-f1819d593def req-e1eed9d2-2c5f-4c2e-b299-d508c0e5e80f service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 21:58:16.378466 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-0b764fba-e262-48ff-b73e-f1819d593def req-e1eed9d2-2c5f-4c2e-b299-d508c0e5e80f service nova] Creating event network-changed:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch2-master-1 Apr 09 21:58:16.383569 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-0b764fba-e262-48ff-b73e-f1819d593def req-e1eed9d2-2c5f-4c2e-b299-d508c0e5e80f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029680 Apr 09 21:58:16.384205 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3587/7148] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 21:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:00:01.095375 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:00:01.096165 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:00:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:00:31.244395 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:00:31.245388 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:00:42.682912 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:00:42.683832 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:00:42.688180 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:00:42.688735 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:42.696047 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:42.696422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:42.697268 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:42.697726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:42.724696 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lazy-loading 'flavor' on Instance uuid 884bb4a2-0201-4144-af24-94320a8c1513 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 22:00:43.001452 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fbb8f479-1f08-4309-9aa0-a78d15c3b39c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513/action" status: 202 len: 0 microversion: 2.1 time: 0.320113 Apr 09 22:00:43.002410 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3562/7149] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:00:42 2022] POST /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:00:43.010074 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:00:43.011323 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:00:43.015277 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:43.015971 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:43.023787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:43.024322 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:43.025160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:43.025610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:43.170007 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:43.177683 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-64014bf2-f646-4e61-8e2a-8f02d017203a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.169897 Apr 09 22:00:43.178265 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3588/7150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:43 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:00:44.202625 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:44.203819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:44.214897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:44.215349 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:44.216190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:44.216649 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:44.223377 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49948. Apr 09 22:00:44.224278 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49950. Apr 09 22:00:44.362319 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:44.370287 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-651ce63e-f813-461d-84de-6f342cfe1f6e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.177022 Apr 09 22:00:44.370841 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3563/7151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:44 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:45.392424 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:45.393452 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:45.404497 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:45.404955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:45.405787 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:45.406232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:45.410112 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49954. Apr 09 22:00:45.426927 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49958. Apr 09 22:00:45.554566 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:45.562866 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-638938a2-d848-43b2-bb82-c25d42763ce1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.177293 Apr 09 22:00:45.563453 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3589/7152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:45 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:46.580178 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:46.580843 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:46.588020 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:46.588490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:46.589318 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:46.589789 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:46.724783 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:46.733415 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-786dcf83-56e2-4a75-9d00-22b9ce6de58b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.157383 Apr 09 22:00:46.733995 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3564/7153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:46 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:47.759438 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:47.760411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:47.772478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:47.773405 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:47.774811 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:47.775251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:47.910867 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:47.918936 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e4a4cc04-1036-4ef0-a2db-4db127b0a945 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.166251 Apr 09 22:00:47.919515 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3590/7154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:47 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:48.936081 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:48.936675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:48.943861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:48.944327 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:48.945144 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:48.945596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:49.082505 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:49.092697 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7ad3b440-a881-46e1-9ca1-c006db0222e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.160698 Apr 09 22:00:49.093373 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3565/7155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:48 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:50.109989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:50.110629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:50.117704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:50.118162 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:50.118937 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:50.119378 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:50.253832 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:50.261791 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-f905a487-4d40-412b-9b24-63ab1501b8d4 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.155818 Apr 09 22:00:50.262375 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3591/7156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:50 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:51.283341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:51.284307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:51.296110 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:51.296884 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:51.298231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:51.298976 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:51.441328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:51.449340 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1050d79e-2b2f-4b0e-87f5-366887de91db tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.172634 Apr 09 22:00:51.450213 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3566/7157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:51 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:52.466936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:52.467589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:52.475817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:52.476290 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:52.477138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:52.477601 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:52.626885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:52.634837 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a4e1f57a-9c52-4ca9-8eb3-62f5f06f3b74 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.172128 Apr 09 22:00:52.635448 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3592/7158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:52 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:53.656494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:53.657541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:53.669286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:53.670064 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:53.671367 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:53.672127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:53.813699 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:53.821963 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-53179788-ccc2-4873-906e-922aac36e5e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.172257 Apr 09 22:00:53.822519 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3567/7159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:53 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:54.842099 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:54.842795 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:54.853689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:54.854311 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:54.855523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:54.855982 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:54.987326 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:54.995428 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ce294fc6-7f5f-4615-9b66-9aa90f561a1c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1700 microversion: 2.1 time: 0.159566 Apr 09 22:00:54.996093 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3593/7160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:54 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:56.018105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:56.018761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:56.026033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:56.026594 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:56.027511 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:56.027972 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:56.166946 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:56.176644 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f253413-779f-4c2e-bc05-98d47f6e8826 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1700 microversion: 2.1 time: 0.162407 Apr 09 22:00:56.177222 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3568/7161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:56 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:57.193843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:57.194468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:57.201330 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:57.201782 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:57.202573 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:57.202970 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:57.335084 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:57.342730 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bff54c79-085f-4673-9a7f-624234070017 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1700 microversion: 2.1 time: 0.152891 Apr 09 22:00:57.343308 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3594/7162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:57 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:58.361763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:58.362406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:58.369545 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:58.370049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:58.370849 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:58.371336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:58.508448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:58.516825 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f04b545e-1810-498f-a3c8-f722e17101f1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1700 microversion: 2.1 time: 0.159944 Apr 09 22:00:58.517456 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3569/7163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:58 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:00:59.098004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-7265bffa-0a36-4232-b380-57a86daada86 req-71dcd127-5b76-47cb-af07-38e09bac15c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "name": "network-vif-plugged", "status": "completed", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:00:59.106882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7265bffa-0a36-4232-b380-57a86daada86 req-71dcd127-5b76-47cb-af07-38e09bac15c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:59.107342 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-7265bffa-0a36-4232-b380-57a86daada86 req-71dcd127-5b76-47cb-af07-38e09bac15c6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:59.118583 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-7265bffa-0a36-4232-b380-57a86daada86 req-71dcd127-5b76-47cb-af07-38e09bac15c6 service nova] Creating event network-vif-plugged:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch2-master-1 Apr 09 22:00:59.123726 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-7265bffa-0a36-4232-b380-57a86daada86 req-71dcd127-5b76-47cb-af07-38e09bac15c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097925 Apr 09 22:00:59.124312 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3595/7164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:00:59.534074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:00:59.534679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:00:59.541755 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:59.542257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:59.543080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:00:59.543529 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:00:59.678922 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:00:59.686671 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e1663f9a-7eb4-43ab-9114-7ff92504f91c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.156528 Apr 09 22:00:59.687242 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3570/7165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:00:59 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:00.705852 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:00.707315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:00.714695 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:00.715163 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:00.715954 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:00.716578 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:00.863564 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:00.871635 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-88eaeb98-b484-4ba7-a6d2-4b4f664c2a82 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.171289 Apr 09 22:01:00.872236 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3596/7166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:00 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:01.891429 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:01.894997 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:01.898679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:01.899547 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:01.900842 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:01.901552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:02.050728 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:02.059458 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3f5f83ef-c71c-4bc6-9849-a5099c6758f9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.173246 Apr 09 22:01:02.060049 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3571/7167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:01 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:03.079891 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:03.081609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:03.090929 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:03.091687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:03.092533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:03.093079 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:03.238339 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:03.249020 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bece12fa-17d5-415f-9644-1240b488101b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.173791 Apr 09 22:01:03.249860 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3597/7168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:03 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:01:04.265837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:04.267621 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:04.275184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:04.275736 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:04.276546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:04.277305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:04.427189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:04.443778 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3a4b6ed1-90f3-4ac9-9eae-827f556d2c69 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.181865 Apr 09 22:01:04.444387 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3572/7169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:04 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:05.461271 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:05.462133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:05.476524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:05.478377 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:05.480365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:05.482454 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:05.651817 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:05.660308 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d09886d3-19ce-4b65-b928-9556d5c0a27c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.203733 Apr 09 22:01:05.670315 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3598/7170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:05 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:06.677792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:06.678675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:06.685759 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:06.686305 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:06.687231 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:06.687751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:06.849129 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:06.859234 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c4cfd20c-73d8-49b4-948e-5a7911a31e21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.185000 Apr 09 22:01:06.860129 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3573/7171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:06 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:07.876186 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:07.876810 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:07.884472 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:07.884927 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:07.885745 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:07.886197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:08.026863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:08.034925 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-782df55d-d08f-449d-b3ce-70211459ee4d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1695 microversion: 2.1 time: 0.162802 Apr 09 22:01:08.035508 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3599/7172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:07 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:09.052072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:09.052754 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:09.059943 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:09.060405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:09.061240 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:09.061692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:09.196389 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:09.204505 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ac518005-fea3-4356-a6ae-1782b6b9cb5c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1677 microversion: 2.1 time: 0.156439 Apr 09 22:01:09.205342 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3574/7173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:09 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:10.226730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:10.227708 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:10.239376 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:10.240122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:10.241456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:10.242220 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:10.385766 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:10.394009 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-83ccf663-487b-4ed2-ac5b-4ed468d42958 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1677 microversion: 2.1 time: 0.174445 Apr 09 22:01:10.394588 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3600/7174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:10 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:11.414009 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:11.414763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:11.421613 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.422082 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.422883 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.423334 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.573275 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:11.584642 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-75cd3571-f3b7-4fba-80f5-157566d2ee77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1680 microversion: 2.1 time: 0.176653 Apr 09 22:01:11.585448 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3575/7175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:11 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:11.602989 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:01:11.603552 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:11.611051 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.611506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.612279 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.612715 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.757440 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8249e1b2-2d89-4e3d-954d-f3fef7113d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513/action" status: 202 len: 0 microversion: 2.1 time: 0.158715 Apr 09 22:01:11.758178 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3601/7176] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:01:11 2022] POST /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:01:11.766490 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:11.767304 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:11.773454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.773973 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.774791 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:11.775235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:11.918173 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:11.925630 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3dc97a1b-da63-4ed2-b537-9e0a55c56248 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1628 microversion: 2.1 time: 0.163121 Apr 09 22:01:11.926389 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3576/7177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:11 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1628 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:01:12.943703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:12.944331 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:12.951232 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:12.951687 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:12.952758 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:12.952871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:13.068553 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-c5a91f2a-7e2e-4cf3-8084-14637df5d524 req-a09c7130-5dfa-45dc-b5a9-f25db370c3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:01:13.078320 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c5a91f2a-7e2e-4cf3-8084-14637df5d524 req-a09c7130-5dfa-45dc-b5a9-f25db370c3e0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:13.078881 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-c5a91f2a-7e2e-4cf3-8084-14637df5d524 req-a09c7130-5dfa-45dc-b5a9-f25db370c3e0 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:13.091868 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-c5a91f2a-7e2e-4cf3-8084-14637df5d524 req-a09c7130-5dfa-45dc-b5a9-f25db370c3e0 service nova] Creating event network-vif-unplugged:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch1-master-1 Apr 09 22:01:13.093616 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:13.098259 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-c5a91f2a-7e2e-4cf3-8084-14637df5d524 req-a09c7130-5dfa-45dc-b5a9-f25db370c3e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033961 Apr 09 22:01:13.099449 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3577/7178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:01:13.102842 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e08395ad-ab9c-4731-8eb1-998225bf3d2f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.164098 Apr 09 22:01:13.103720 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3602/7179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:12 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:14.087782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-728f81b4-029a-4e91-9a1b-008016fdeff6 req-d42982ba-ce82-4ead-8d98-b004ca7f92f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:01:14.100953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-728f81b4-029a-4e91-9a1b-008016fdeff6 req-d42982ba-ce82-4ead-8d98-b004ca7f92f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:14.101446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-728f81b4-029a-4e91-9a1b-008016fdeff6 req-d42982ba-ce82-4ead-8d98-b004ca7f92f6 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:14.115161 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-728f81b4-029a-4e91-9a1b-008016fdeff6 req-d42982ba-ce82-4ead-8d98-b004ca7f92f6 service nova] Creating event network-changed:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch1-master-1 Apr 09 22:01:14.120629 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-728f81b4-029a-4e91-9a1b-008016fdeff6 req-d42982ba-ce82-4ead-8d98-b004ca7f92f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111565 Apr 09 22:01:14.121768 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:14.122285 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3578/7180] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:01:14.123115 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:14.132456 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:14.133229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:14.134212 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:14.134916 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:14.386689 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:14.394774 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7c27f4d9-d079-468f-8d04-80b029a16ab9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.278867 Apr 09 22:01:14.395370 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3603/7181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:14 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:15.414294 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:15.414952 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:15.422342 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:15.422813 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:15.423617 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:15.424071 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:15.586769 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:15.595668 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3ea63d9c-46cb-4330-b11f-38873e446d6d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.187253 Apr 09 22:01:15.607263 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3579/7182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:15 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:16.614522 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:16.615235 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:16.624479 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:16.625188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:16.626415 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:16.627081 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:16.795065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:16.802772 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-3fc77e91-c45d-44af-b227-69b248d96081 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.192288 Apr 09 22:01:16.803362 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3604/7183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:16 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:17.820025 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:17.820764 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:17.828127 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:17.828918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:17.829762 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:17.830216 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:17.979745 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:17.987861 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-281e4dd5-9ee2-4969-93ff-bf12a2b08618 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.171827 Apr 09 22:01:17.989081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3580/7184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:17 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:19.004924 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:19.005621 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:19.013498 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:19.013957 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:19.014748 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:19.015189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:19.161485 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:19.171872 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7484b88b-e5b2-4836-8b90-afd73caf3d21 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.170884 Apr 09 22:01:19.181996 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3605/7185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:18 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:01:20.188765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:20.189464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:20.197337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:20.197805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:20.198692 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:20.199137 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:20.345163 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:20.354047 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-03e078c1-4dcb-4c13-927e-cace20e649f6 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.169336 Apr 09 22:01:20.364056 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3581/7186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:20 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:21.372273 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:21.373725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:21.381010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:21.381506 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:21.382434 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:21.382928 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:21.551411 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:21.559812 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b804add4-99cf-40b2-bf6e-ccab65b8c55a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.191918 Apr 09 22:01:21.560793 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3606/7187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:21 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:22.578752 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:22.579454 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:22.586412 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:22.586890 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:22.587679 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:22.588152 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:22.805408 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:22.813439 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-8187629a-5331-495e-a34c-3509d5bdcea2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.238683 Apr 09 22:01:22.814046 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3582/7188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:22 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:23.830640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:23.831310 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:23.839335 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:23.839792 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:23.840639 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:23.841092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:24.011474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:24.019131 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-608c01fc-1730-47a4-b199-8a00d2974b13 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.192612 Apr 09 22:01:24.019690 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3607/7189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:23 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:25.039198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:25.040121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:25.051128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:25.051853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:25.053095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:25.053823 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:25.193574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:25.201537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a9d9d962-a21f-4150-9068-4d69e3ff6d85 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.168576 Apr 09 22:01:25.202136 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3583/7190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:25 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:26.218958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:26.219602 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:26.227291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:26.227750 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:26.228530 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:26.228969 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:26.369698 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:26.381058 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9f90eca9-0b37-4650-84e5-6675d2fbae58 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.165948 Apr 09 22:01:26.381912 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3608/7191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:26 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:26.929179 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-2aa4febb-cade-43db-bdf8-1cd070611bf9 req-1cbe5744-a2cb-4030-9ac9-d44236e06770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "name": "network-vif-plugged", "status": "completed", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:01:26.939062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2aa4febb-cade-43db-bdf8-1cd070611bf9 req-1cbe5744-a2cb-4030-9ac9-d44236e06770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:26.939866 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-2aa4febb-cade-43db-bdf8-1cd070611bf9 req-1cbe5744-a2cb-4030-9ac9-d44236e06770 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:26.953561 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-2aa4febb-cade-43db-bdf8-1cd070611bf9 req-1cbe5744-a2cb-4030-9ac9-d44236e06770 service nova] Creating event network-vif-plugged:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch1-master-1 Apr 09 22:01:26.959687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-2aa4febb-cade-43db-bdf8-1cd070611bf9 req-1cbe5744-a2cb-4030-9ac9-d44236e06770 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034431 Apr 09 22:01:26.960313 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3584/7192] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:01:27.403845 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:27.404470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:27.412474 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:27.412978 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:27.413888 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:27.414409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:27.553016 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:27.560891 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c363a6c6-8a64-49bd-8983-e9d878f4507e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.163621 Apr 09 22:01:27.561520 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3609/7193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:27 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:28.583911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:28.584652 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:28.592548 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:28.593016 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:28.593880 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:28.594330 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:28.731284 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:28.738836 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-96c494c7-0592-4ae9-8a00-4dd4ed402e04 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1686 microversion: 2.1 time: 0.160175 Apr 09 22:01:28.739450 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3585/7194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:28 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:01:29.760100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:01:29.761137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:01:29.770221 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:29.770679 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:29.771464 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:01:29.771902 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:01:29.909429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:01:29.917760 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-10dd2654-4b6e-4e25-9d5a-c4f8c668dbb9 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1673 microversion: 2.1 time: 0.164396 Apr 09 22:01:29.918371 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3610/7195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:01:29 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:39.792488 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:39.793184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:39.795633 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9054e57e-fe66-4825-9760-1604d59d0c24 req-a1ce47e7-da6b-48d9-932b-fc89181b6553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:02:39.799777 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:39.800526 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:39.801351 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:39.801808 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:39.806717 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9054e57e-fe66-4825-9760-1604d59d0c24 req-a1ce47e7-da6b-48d9-932b-fc89181b6553 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:39.807577 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9054e57e-fe66-4825-9760-1604d59d0c24 req-a1ce47e7-da6b-48d9-932b-fc89181b6553 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:39.825254 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9054e57e-fe66-4825-9760-1604d59d0c24 req-a1ce47e7-da6b-48d9-932b-fc89181b6553 service nova] Creating event network-changed:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch1-master-1 Apr 09 22:02:39.828202 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 22:02:39.831820 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9054e57e-fe66-4825-9760-1604d59d0c24 req-a1ce47e7-da6b-48d9-932b-fc89181b6553 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042459 Apr 09 22:02:39.832473 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3611/7196] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:02:39.930642 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e45c46af-8149-4e8b-8909-9519fef8f0c7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "DELETE /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 204 len: 0 microversion: 2.1 time: 0.143665 Apr 09 22:02:39.931570 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3586/7197] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 22:02:39 2022] DELETE /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 22:02:39.941788 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:39.942045 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:39.949098 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:39.949685 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:39.950466 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:39.951737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:40.103950 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:40.111859 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd395092-e048-4867-b62b-1f61a498a85e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.175614 Apr 09 22:02:40.112706 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3612/7198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:39 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:41.130165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:41.130982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:41.138722 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:41.139190 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:41.139985 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:41.140557 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:41.450026 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:41.458539 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d2d4f357-ea46-4905-81f7-dd9920b9ae77 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 200 len: 1679 microversion: 2.1 time: 0.332628 Apr 09 22:02:41.459450 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3587/7199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:41 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:41.848478 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-432b7170-0532-4737-ad76-5b0435e338cd req-023074dc-c1c3-479f-a5a1-b1cff881a037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884bb4a2-0201-4144-af24-94320a8c1513", "name": "network-vif-deleted", "tag": "5f6a56dc-3fa3-47ce-ae9b-541cc811715b"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:02:41.858413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-432b7170-0532-4737-ad76-5b0435e338cd req-023074dc-c1c3-479f-a5a1-b1cff881a037 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:41.858869 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-432b7170-0532-4737-ad76-5b0435e338cd req-023074dc-c1c3-479f-a5a1-b1cff881a037 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:41.869964 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-432b7170-0532-4737-ad76-5b0435e338cd req-023074dc-c1c3-479f-a5a1-b1cff881a037 service nova] Creating event network-vif-deleted:5f6a56dc-3fa3-47ce-ae9b-541cc811715b for instance 884bb4a2-0201-4144-af24-94320a8c1513 on nch1-master-1 Apr 09 22:02:41.875690 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-432b7170-0532-4737-ad76-5b0435e338cd req-023074dc-c1c3-479f-a5a1-b1cff881a037 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Apr 09 22:02:41.876452 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3613/7200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:02:42.476561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:42.477238 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: 884bb4a2-0201-4144-af24-94320a8c1513] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:42.484462 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:42.484928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:42.485740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:42.486189 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:42.499830 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] HTTP exception thrown: Instance 884bb4a2-0201-4144-af24-94320a8c1513 could not be found. Apr 09 22:02:42.500435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Returning 404 to user: Instance 884bb4a2-0201-4144-af24-94320a8c1513 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 22:02:42.501310 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92fba492-9627-4d70-bb54-6fb41e8ec539 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513" status: 404 len: 111 microversion: 2.1 time: 0.029159 Apr 09 22:02:42.501845 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3588/7201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:42 2022] GET /compute/v2.1/servers/884bb4a2-0201-4144-af24-94320a8c1513 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 22:02:42.669959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b12c92b1-f548-4a72-822c-f7bf434a60ff tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '.version_select at 0x7fb08db45670>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:42.674121 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b12c92b1-f548-4a72-822c-f7bf434a60ff tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 22:02:43.687133 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [None req-b12c92b1-f548-4a72-822c-f7bf434a60ff tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [511518d2-8b75-4a08-870e-9ca02ed826dd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50264. Apr 09 22:02:43.708882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b12c92b1-f548-4a72-822c-f7bf434a60ff tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1679869350" status: 202 len: 0 microversion: 2.1 time: 1.044277 Apr 09 22:02:43.709545 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3614/7202] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 22:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1679869350 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:02:43.730941 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'create', calling method: .version_select at 0x7fb08ef81ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1765799546"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:02:43.746953 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:02:43.753167 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:02:43.767477 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [61f359b9-f7f3-4ccc-b42c-9e028a0a56b1] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 22:02:44.780800 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [61f359b9-f7f3-4ccc-b42c-9e028a0a56b1] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50268. Apr 09 22:02:45.021095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:02:45.028045 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'key_pairs'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:02:45.046913 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68fc65b0-8b33-4b67-966d-2f5259550535 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.319763 Apr 09 22:02:45.047473 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3589/7203] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 22:02:43 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:47.586605 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2134240874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1765799546", "security_groups": [{"name": "tempest-secgroup-smoke-1364872671"}], "networks": [{"uuid": "b2d82b12-1202-41ee-a05a-aad7a687d585"}], "block_device_mapping_v2": [{"uuid": "eec72ecd-21f3-4e41-9d0f-7686e6238eeb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:02:47.710882 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.network.neutron [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] validate_networks() for [('b2d82b12-1202-41ee-a05a-aad7a687d585', None, None, None, None, None)] {{(pid=141818) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 22:02:48.424429 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Flavor limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 22:02:48.424838 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Image limits 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 22:02:48.425359 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Flavor pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 22:02:48.425801 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Image pref 0:0:0 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 22:02:48.426218 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.virt.hardware [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 22:02:48.435725 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:48.436187 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:48.437010 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:48.437481 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:48.456076 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:02:48.461874 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Getting quotas for user 9c33fcbaf68845b686f70eb205fa1e5b and project b5b6456b64b3420cb9fd86fb1cb15247. Resources: {'instances', 'cores', 'ram'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:02:48.521747 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Going to run 1 instances... {{(pid=141818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 22:02:48.524003 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eec72ecd-21f3-4e41-9d0f-7686e6238eeb',volume_size=None,volume_type=None)] {{(pid=141818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 22:02:48.661458 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-42edaf25-3d69-4a72-b48c-8422e2700478 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087869 Apr 09 22:02:48.662232 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3615/7204] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 22:02:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 22:02:48.673006 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9e8ba855-03ce-4b3b-949a-74a856b78b7e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:48.673950 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9e8ba855-03ce-4b3b-949a-74a856b78b7e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:48.727893 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9e8ba855-03ce-4b3b-949a-74a856b78b7e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:48.735099 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9e8ba855-03ce-4b3b-949a-74a856b78b7e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1089 microversion: 2.1 time: 0.066460 Apr 09 22:02:48.735711 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3590/7205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:48 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:49.752892 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-76f2fb12-3681-448b-9721-fd1b73a75200 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:49.753640 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-76f2fb12-3681-448b-9721-fd1b73a75200 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:49.807291 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-76f2fb12-3681-448b-9721-fd1b73a75200 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:49.814886 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-76f2fb12-3681-448b-9721-fd1b73a75200 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1089 microversion: 2.1 time: 0.066936 Apr 09 22:02:49.815472 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3616/7206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:49 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:50.832391 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-02f18363-4e75-46ca-a54c-7d209eb3bfe5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:50.833077 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-02f18363-4e75-46ca-a54c-7d209eb3bfe5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:50.891232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-02f18363-4e75-46ca-a54c-7d209eb3bfe5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:50.898288 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-02f18363-4e75-46ca-a54c-7d209eb3bfe5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1089 microversion: 2.1 time: 0.070219 Apr 09 22:02:50.899107 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3591/7207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:50 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:51.918776 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0cd73bf2-83fa-4b13-9c87-059aa58b5055 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:51.920011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0cd73bf2-83fa-4b13-9c87-059aa58b5055 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:51.982942 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0cd73bf2-83fa-4b13-9c87-059aa58b5055 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:51.990969 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0cd73bf2-83fa-4b13-9c87-059aa58b5055 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1089 microversion: 2.1 time: 0.078932 Apr 09 22:02:51.991562 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3617/7208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:51 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:53.012300 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:53.013420 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:53.021694 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:53.022168 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:53.023013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:53.023453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:53.084289 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:53.091964 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-eacd5162-3afe-4f1a-a1d9-42b18ee4fb95 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1139 microversion: 2.1 time: 0.086276 Apr 09 22:02:53.092599 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3592/7209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:53 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:54.112189 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:54.113999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:54.123150 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:54.123987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:54.124999 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:54.125588 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:54.192829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:54.201977 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-85ed6649-f125-43ba-a403-e6b29b06e60d tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1205 microversion: 2.1 time: 0.095740 Apr 09 22:02:54.202775 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3618/7210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:54 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1205 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:55.199269 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-50159284-22c4-4e7b-8a6e-98a4e04c52f9 req-68b4498e-2d2e-478f-8240-763f0386cc74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:02:55.208033 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-50159284-22c4-4e7b-8a6e-98a4e04c52f9 req-68b4498e-2d2e-478f-8240-763f0386cc74 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:55.208308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-50159284-22c4-4e7b-8a6e-98a4e04c52f9 req-68b4498e-2d2e-478f-8240-763f0386cc74 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:55.219193 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:55.219816 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:55.222291 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-50159284-22c4-4e7b-8a6e-98a4e04c52f9 req-68b4498e-2d2e-478f-8240-763f0386cc74 service nova] Creating event network-changed:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch2-master-1 Apr 09 22:02:55.228376 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-50159284-22c4-4e7b-8a6e-98a4e04c52f9 req-68b4498e-2d2e-478f-8240-763f0386cc74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107498 Apr 09 22:02:55.229574 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3593/7211] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:02:55.231595 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:55.232057 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:55.232875 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:55.233350 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:55.372872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:55.380567 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0cbab299-aabf-4b00-a7c5-796dff300d8c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.165203 Apr 09 22:02:55.381194 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3619/7212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:55 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:02:56.402918 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:56.404095 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:56.413013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:56.413483 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:56.414286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:56.414733 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:56.549022 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:56.557425 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9d2830e5-10c7-4ad4-a875-db4d20b4abc7 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.161366 Apr 09 22:02:56.560054 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3594/7213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:56 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:57.575814 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:57.576425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:57.583783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:57.584237 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:57.585068 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:57.585510 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:57.731784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:57.740068 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4efbbfe8-46d8-42d6-adec-070375c44333 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.168639 Apr 09 22:02:57.740665 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3620/7214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:57 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:58.761109 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:58.762177 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:02:58.773785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:58.774574 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:58.775945 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:02:58.776740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:02:58.918139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:02:58.926197 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-40a9aebf-0b8f-4d53-ab9e-172c701d0482 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.171639 Apr 09 22:02:58.926797 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3595/7215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:58 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:02:59.996248 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:02:59.996959 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:03:00.003667 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:00.004134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:00.004913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:00.005393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:00.139468 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:03:00.147617 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cc541a78-9508-4a56-9878-346ba48816a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.207451 Apr 09 22:03:00.148267 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3621/7216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:02:59 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:03:01.169074 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:03:01.170169 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:03:01.179369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:01.179835 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:01.180631 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:01.181063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:01.318379 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:03:01.326692 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f01af4f8-26f7-4127-bfd0-da2e06b78c0e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.164101 Apr 09 22:03:01.327300 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3596/7217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:03:01 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:03:01.708320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-aeab5f94-11f2-452c-b084-b236dcd0933e req-fde51b06-e757-4e6d-95d4-2033d38293f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "name": "network-vif-plugged", "status": "completed", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:03:01.717526 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-aeab5f94-11f2-452c-b084-b236dcd0933e req-fde51b06-e757-4e6d-95d4-2033d38293f9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:01.717975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-aeab5f94-11f2-452c-b084-b236dcd0933e req-fde51b06-e757-4e6d-95d4-2033d38293f9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:01.729787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-aeab5f94-11f2-452c-b084-b236dcd0933e req-fde51b06-e757-4e6d-95d4-2033d38293f9 service nova] Creating event network-vif-plugged:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch2-master-1 Apr 09 22:03:01.734879 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-aeab5f94-11f2-452c-b084-b236dcd0933e req-fde51b06-e757-4e6d-95d4-2033d38293f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Apr 09 22:03:01.735660 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3622/7218] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:03:02.348086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:03:02.348819 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:03:02.358539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:02.359140 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:02.360205 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:02.360837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:02.495968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:03:02.503686 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-802e96fc-33af-49e3-962d-2841431960ce tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1261 microversion: 2.1 time: 0.162404 Apr 09 22:03:02.504265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3597/7219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:03:02 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:03:03.527072 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:03:03.528243 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:03:03.539159 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:03.539952 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:03.541398 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:03.542137 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:03.688417 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:03:03.696220 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-da78bf48-0406-4e66-8151-6268d4997907 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1445 microversion: 2.1 time: 0.177950 Apr 09 22:03:03.696872 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3623/7220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:03:03 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:03:03.712405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:03:03.713005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:03:03.720101 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:03.720566 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:03.721399 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:03.721846 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:03.861326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:03:03.872804 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-15ca912f-f01c-49b1-902e-14b9382b3fbd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1445 microversion: 2.1 time: 0.164109 Apr 09 22:03:03.873693 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3598/7221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:03:03 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:03:05.588844 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c87f6591-2df7-4d4d-8650-f566a664effd req-447b5b10-4a13-4c60-922b-63d92a016cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:03:05.597646 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c87f6591-2df7-4d4d-8650-f566a664effd req-447b5b10-4a13-4c60-922b-63d92a016cff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:03:05.598065 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c87f6591-2df7-4d4d-8650-f566a664effd req-447b5b10-4a13-4c60-922b-63d92a016cff service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:03:05.609898 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c87f6591-2df7-4d4d-8650-f566a664effd req-447b5b10-4a13-4c60-922b-63d92a016cff service nova] Creating event network-changed:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch2-master-1 Apr 09 22:03:05.615163 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c87f6591-2df7-4d4d-8650-f566a664effd req-447b5b10-4a13-4c60-922b-63d92a016cff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030256 Apr 09 22:03:05.615787 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3624/7222] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:03:17.910226 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:03:17.910997 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:05:01.107492 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:05:01.108195 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:05:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:05:19.341250 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:05:19.342413 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:05:19.346221 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:05:19.346770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:19.353489 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:19.353955 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:19.354742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:19.355185 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:19.378192 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lazy-loading 'flavor' on Instance uuid c9e5f38c-1429-4598-ab03-7d9c8517042e {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 22:05:19.459374 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-3115e668-0412-4308-a425-366a01a2c80a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e/action" status: 202 len: 0 microversion: 2.1 time: 0.119623 Apr 09 22:05:19.459975 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3599/7223] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:05:19 2022] POST /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:05:19.467737 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 22:05:19.468550 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 09 22:05:19.472703 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:19.473797 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:19.481657 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:19.482156 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:19.483040 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:19.483495 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:19.671487 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:19.679378 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8d4e58ee-73b6-46ff-8f29-cc4e6559ac10 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.214662 Apr 09 22:05:19.679961 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3625/7224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:19 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:20.706897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:20.707640 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:20.717291 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:20.717750 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:20.718601 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:20.719086 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:20.724716 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50546. Apr 09 22:05:20.726747 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50548. Apr 09 22:05:20.916516 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:20.927984 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e53ea8a7-c6a9-407d-8498-5e58f9b9c719 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.228569 Apr 09 22:05:20.928784 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3600/7225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:20 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:21.949771 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:21.950532 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:21.964974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:21.965719 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:21.966794 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:21.967404 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:21.976612 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50556. Apr 09 22:05:21.977506 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50554. Apr 09 22:05:22.105455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:22.113576 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-30beb9f2-6143-4b34-9792-c7e6a4e57f7b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.170450 Apr 09 22:05:22.114161 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3626/7226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:21 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:23.133453 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:23.134088 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:23.141295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:23.141765 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:23.142552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:23.143005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:23.273706 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:23.285334 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2dc6d96-1a22-4283-b8ac-20b77d7db8c8 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.155660 Apr 09 22:05:23.286099 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3601/7227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:23 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:24.304188 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:24.304785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:24.311979 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:24.312433 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:24.313257 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:24.313716 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:24.455160 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:24.463222 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a5162dbe-b87b-4517-a9ab-c4c5b2616103 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.163253 Apr 09 22:05:24.463806 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3627/7228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:24 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:25.485355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:25.485938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:25.493409 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:25.493861 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:25.494661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:25.495121 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:25.650472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:25.658863 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9451959f-e138-440d-ad5a-45c60be09c35 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.177448 Apr 09 22:05:25.659601 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3602/7229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:25 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:26.681673 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:26.682785 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:26.693092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:26.693572 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:26.694348 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:26.694783 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:26.835943 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:26.843757 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7fd7518-459e-45bc-8e89-e47b4c856f3e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.168688 Apr 09 22:05:26.844681 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3628/7230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:26 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:27.862799 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:27.863629 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:27.871063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:27.871523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:27.872303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:27.872732 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:28.009106 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:28.017828 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-babe7f98-f19d-4901-adaf-790042f56416 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.159255 Apr 09 22:05:28.018409 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3603/7231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:27 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:29.038709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:29.039354 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:29.047321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:29.047828 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:29.048694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:29.049231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:29.194134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:29.203862 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-9e7d869d-d475-4cd4-b632-82db1e0a45e5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.170666 Apr 09 22:05:29.204730 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3629/7232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:29 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:30.226053 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:30.227059 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:30.238605 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:30.239141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:30.239878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:30.240405 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:30.372181 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:30.380393 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d84cfc4d-4074-4b60-a056-998e77a17d93 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.161425 Apr 09 22:05:30.380982 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3604/7233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:30 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:31.400798 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:31.401843 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:31.412231 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:31.412688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:31.413500 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:31.413939 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:31.545904 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:31.553662 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a52053e4-dc06-47fd-be35-d8b8f99efe92 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.159512 Apr 09 22:05:31.554253 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3630/7234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:31 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:32.571590 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:32.572219 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:32.579658 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.580228 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:32.581027 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.581515 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:32.727094 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:32.735196 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1e523b06-f64c-403e-aaca-97958d102b1e tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1510 microversion: 2.1 time: 0.167621 Apr 09 22:05:32.735890 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3605/7235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:32 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:32.752092 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:05:32.752653 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:32.760139 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.760600 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:32.761421 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.761870 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:32.840010 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "POST /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e/action" status: 202 len: 0 microversion: 2.1 time: 0.091875 Apr 09 22:05:32.840966 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3631/7236] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:05:32 2022] POST /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:05:32.849935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:32.850561 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:32.856560 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.857028 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:32.857872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:32.858295 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:33.049774 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:33.058152 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-68a1a6b3-3750-4b41-99b8-0cbb87f0bcd2 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1518 microversion: 2.1 time: 0.212705 Apr 09 22:05:33.058742 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3606/7237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:32 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:34.077070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:34.077649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:34.084308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:34.084764 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:34.085584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:34.086023 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:34.221355 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:34.229635 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-ff65c6a6-94b6-446b-94a3-1d1c30c7b6ec tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1520 microversion: 2.1 time: 0.157909 Apr 09 22:05:34.230207 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3632/7238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:34 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:34.444091 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-96ca3a15-dc60-45cc-a2ea-d177168c7ba2 req-eac98cc0-80d7-492d-b120-6f2aa2a7e779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "name": "network-vif-unplugged", "status": "completed", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:05:34.453015 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-96ca3a15-dc60-45cc-a2ea-d177168c7ba2 req-eac98cc0-80d7-492d-b120-6f2aa2a7e779 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:34.453539 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-96ca3a15-dc60-45cc-a2ea-d177168c7ba2 req-eac98cc0-80d7-492d-b120-6f2aa2a7e779 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:34.466007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.compute.server_external_events [req-96ca3a15-dc60-45cc-a2ea-d177168c7ba2 req-eac98cc0-80d7-492d-b120-6f2aa2a7e779 service nova] Unable to find a host for instance c9e5f38c-1429-4598-ab03-7d9c8517042e. Dropping event network-vif-unplugged {{(pid=141819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 09 22:05:34.466926 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-96ca3a15-dc60-45cc-a2ea-d177168c7ba2 req-eac98cc0-80d7-492d-b120-6f2aa2a7e779 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027113 Apr 09 22:05:34.468195 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3607/7239] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 22:05:35.256545 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:35.257664 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:35.264737 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:35.265219 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:35.266011 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:35.266449 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:35.514619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:35.522773 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8e6b2f4b-62ca-4946-bc53-244d71b3720c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.278526 Apr 09 22:05:35.523667 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3633/7240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:35 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:35.704599 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-9ec5df2d-7997-4f44-a3ec-d73ad9f6ebc1 req-9771bde2-a355-4f53-89ed-7a1087d67289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:05:35.717201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ec5df2d-7997-4f44-a3ec-d73ad9f6ebc1 req-9771bde2-a355-4f53-89ed-7a1087d67289 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:35.718080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-9ec5df2d-7997-4f44-a3ec-d73ad9f6ebc1 req-9771bde2-a355-4f53-89ed-7a1087d67289 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:35.731537 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-9ec5df2d-7997-4f44-a3ec-d73ad9f6ebc1 req-9771bde2-a355-4f53-89ed-7a1087d67289 service nova] Creating event network-changed:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch1-master-1 Apr 09 22:05:35.737193 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-9ec5df2d-7997-4f44-a3ec-d73ad9f6ebc1 req-9771bde2-a355-4f53-89ed-7a1087d67289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039996 Apr 09 22:05:35.738169 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3608/7241] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:05:36.540829 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:36.541591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:36.550381 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:36.550900 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:36.551779 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:36.553197 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:36.690729 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:36.698505 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96b6f06a-b790-413d-a903-89ee7e3b152f tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.161714 Apr 09 22:05:36.699094 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3634/7242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:36 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:37.716567 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:37.717359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:37.725184 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:37.725675 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:37.726473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:37.726929 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:37.869447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:37.877893 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-772f20c2-9c87-45d4-940b-f794fe9397f5 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.165722 Apr 09 22:05:37.878487 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3609/7243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:37 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:38.898396 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:38.899332 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:38.910863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:38.911407 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:38.912124 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:38.912709 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:39.061610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:39.070584 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-96aaa814-1df0-41a9-8a77-3a6339e7afcb tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.178194 Apr 09 22:05:39.071244 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3635/7244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:38 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:40.091388 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:40.092369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:40.102193 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:40.102668 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:40.103480 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:40.103939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:40.248048 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:40.256652 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-9bb9bccf-50f5-4eb1-8a2d-582f55cff15a tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.171896 Apr 09 22:05:40.257293 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3610/7245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:40 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:41.277225 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:41.277975 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:41.287080 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:41.287655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:41.288635 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:41.289252 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:41.431571 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:41.443491 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-04fc4ec1-0ad9-4a7d-85be-6eddd431904c tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.171890 Apr 09 22:05:41.444903 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3636/7246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:41 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:42.439514 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-b0933638-3040-45d5-ab96-27baf177731d req-01accf17-59f9-4e27-bdb0-99fb3d35294e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "name": "network-vif-plugged", "status": "completed", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:05:42.449139 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b0933638-3040-45d5-ab96-27baf177731d req-01accf17-59f9-4e27-bdb0-99fb3d35294e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:42.449638 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-b0933638-3040-45d5-ab96-27baf177731d req-01accf17-59f9-4e27-bdb0-99fb3d35294e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:42.462467 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-b0933638-3040-45d5-ab96-27baf177731d req-01accf17-59f9-4e27-bdb0-99fb3d35294e service nova] Creating event network-vif-plugged:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch1-master-1 Apr 09 22:05:42.463591 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:42.464894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:42.467654 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-b0933638-3040-45d5-ab96-27baf177731d req-01accf17-59f9-4e27-bdb0-99fb3d35294e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Apr 09 22:05:42.468265 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3611/7247] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:05:42.473409 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:42.473863 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:42.474644 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:42.475074 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:42.644617 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:42.653002 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-c34f15fe-3aea-4c45-89af-fabc397723cf tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.193986 Apr 09 22:05:42.653658 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3637/7248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:42 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:43.672079 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:43.672947 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:43.680359 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:43.680892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:43.681902 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:43.683331 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:43.824852 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:43.832688 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-7eac2e52-a911-4628-bd0c-a5c5c24edfcd tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1576 microversion: 2.1 time: 0.165921 Apr 09 22:05:43.833321 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3612/7249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:43 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:05:44.857482 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:05:44.858299 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:05:44.867575 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:44.868039 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:44.868821 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:05:44.869306 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:05:45.016436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:05:45.024576 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dd54088f-d9f9-49bf-8ef8-7d814bf24eb3 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1563 microversion: 2.1 time: 0.172580 Apr 09 22:05:45.025199 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3638/7250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:05:44 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:06:37.921302 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:06:37.922299 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:07:11.712452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:11.713156 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:11.713672 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-71873232-b75d-43d4-bf92-28a22a6d1688 req-dc114341-09d1-461b-bb6b-f2fdda6166a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:11.720336 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:11.721417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:11.721707 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-71873232-b75d-43d4-bf92-28a22a6d1688 req-dc114341-09d1-461b-bb6b-f2fdda6166a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:11.722534 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-71873232-b75d-43d4-bf92-28a22a6d1688 req-dc114341-09d1-461b-bb6b-f2fdda6166a9 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:11.722665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:11.723194 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:11.736650 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-71873232-b75d-43d4-bf92-28a22a6d1688 req-dc114341-09d1-461b-bb6b-f2fdda6166a9 service nova] Creating event network-changed:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch1-master-1 Apr 09 22:07:11.742279 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-71873232-b75d-43d4-bf92-28a22a6d1688 req-dc114341-09d1-461b-bb6b-f2fdda6166a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033459 Apr 09 22:07:11.743110 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3639/7251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:07:11.750049 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 22:07:11.838080 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 204 len: 0 microversion: 2.1 time: 0.130191 Apr 09 22:07:11.839131 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3613/7252] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 22:07:11 2022] DELETE /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 22:07:11.853584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:11.854090 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:11.863619 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:11.864083 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:11.864879 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:11.865352 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:12.015061 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:12.023022 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-1b7bbb48-f2c8-4a3d-a6e3-428899c1a982 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.176293 Apr 09 22:07:12.023639 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3640/7253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:11 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:13.041062 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:13.041820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:13.049441 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:13.049911 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:13.050713 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:13.051171 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:13.256907 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:13.265064 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-203b1260-46d1-4652-92a5-70cb42d28496 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1569 microversion: 2.1 time: 0.228329 Apr 09 22:07:13.265628 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3614/7254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:13 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:13.899556 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-907231c5-0469-4846-ae71-54764cefe451 req-2d94b329-01b0-4bde-8e07-62ec34378dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5f38c-1429-4598-ab03-7d9c8517042e", "name": "network-vif-deleted", "tag": "5ff925f7-8d83-4306-9b04-66b23ecea373"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:13.907654 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-907231c5-0469-4846-ae71-54764cefe451 req-2d94b329-01b0-4bde-8e07-62ec34378dd8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:13.909307 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-907231c5-0469-4846-ae71-54764cefe451 req-2d94b329-01b0-4bde-8e07-62ec34378dd8 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:13.921248 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-907231c5-0469-4846-ae71-54764cefe451 req-2d94b329-01b0-4bde-8e07-62ec34378dd8 service nova] Creating event network-vif-deleted:5ff925f7-8d83-4306-9b04-66b23ecea373 for instance c9e5f38c-1429-4598-ab03-7d9c8517042e on nch1-master-1 Apr 09 22:07:13.926048 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-907231c5-0469-4846-ae71-54764cefe451 req-2d94b329-01b0-4bde-8e07-62ec34378dd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083366 Apr 09 22:07:13.926634 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3641/7255] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:07:14.282487 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:14.283290 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:14.290396 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:14.290860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:14.291664 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:14.292119 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:14.327128 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:14.327565 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:14.328096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lazy-loading 'fault' on Instance uuid c9e5f38c-1429-4598-ab03-7d9c8517042e {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 22:07:14.373357 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c33fcbaf68845b686f70eb205fa1e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b6456b64b3420cb9fd86fb1cb15247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:14.382440 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1d629d1e-d412-4a9b-9a10-4832b53abc48 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 200 len: 1225 microversion: 2.1 time: 0.104381 Apr 09 22:07:14.392861 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3615/7256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:14 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:15.403064 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:15.403889 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] [instance: c9e5f38c-1429-4598-ab03-7d9c8517042e] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:15.411594 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:15.412133 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:15.413102 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:15.413632 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:15.428817 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] HTTP exception thrown: Instance c9e5f38c-1429-4598-ab03-7d9c8517042e could not be found. Apr 09 22:07:15.429451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Returning 404 to user: Instance c9e5f38c-1429-4598-ab03-7d9c8517042e could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 22:07:15.430287 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-27c3e215-91b8-4db6-a86d-1eff533e6460 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e" status: 404 len: 111 microversion: 2.1 time: 0.033422 Apr 09 22:07:15.430828 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3642/7257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:15 2022] GET /compute/v2.1/servers/c9e5f38c-1429-4598-ab03-7d9c8517042e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 22:07:15.604742 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e8f1698a-e416-408a-804b-01c2fd0a18a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] Calling method '.version_select at 0x7fb08ec68d30>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:15.630576 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e8f1698a-e416-408a-804b-01c2fd0a18a1 tempest-TestShelveInstance-1992476203 tempest-TestShelveInstance-1992476203-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765799546" status: 202 len: 0 microversion: 2.1 time: 0.029660 Apr 09 22:07:15.631088 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3616/7258] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Apr 9 22:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765799546 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:07:33.752138 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Action: 'create', calling method: .version_select at 0x7fb08e255550>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1252904068"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:33.768042 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:07:33.773293 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for user 0f3bac3d534c4762920afdb1215c22b7 and project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:07:34.005610 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:07:34.010958 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.quota [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for user 0f3bac3d534c4762920afdb1215c22b7 and project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'key_pairs'} {{(pid=141818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:07:34.025668 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-216d1fff-3717-413a-9e28-7f10f899ddbb tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.453216 Apr 09 22:07:34.026363 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3643/7259] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Apr 9 22:07:33 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 22:07:35.019585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2065420430", "imageRef": "b539c48b-3400-4aa4-9226-8be5a3d07b36", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1252904068", "security_groups": [{"name": "tempest-secgroup-smoke-559008475"}], "networks": [{"uuid": "5859b887-5776-4e11-aac2-7225205843fd"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:35.139096 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] validate_networks() for [('5859b887-5776-4e11-aac2-7225205843fd', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 22:07:35.955341 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 22:07:35.955938 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 22:07:35.956435 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 22:07:35.956887 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 22:07:35.957394 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 22:07:35.967855 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:35.968328 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:35.969198 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:35.969661 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:35.988157 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:07:35.994347 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for user 0f3bac3d534c4762920afdb1215c22b7 and project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:07:36.007472 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 22:07:36.009921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b539c48b-3400-4aa4-9226-8be5a3d07b36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 22:07:36.060549 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-38d45ab2-d34f-4e83-9682-f039b9a652db tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.046081 Apr 09 22:07:36.061643 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3617/7260] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 22:07:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 22:07:36.072655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-7dc7bcc5-baaf-4b74-b6ec-4f8ab19156ca tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:36.073393 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-7dc7bcc5-baaf-4b74-b6ec-4f8ab19156ca tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:36.135661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-7dc7bcc5-baaf-4b74-b6ec-4f8ab19156ca tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:36.143787 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-7dc7bcc5-baaf-4b74-b6ec-4f8ab19156ca tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1249 microversion: 2.1 time: 0.075922 Apr 09 22:07:36.144380 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3644/7261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:36 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:37.168627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:37.169316 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:37.187321 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:37.192740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:37.198430 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:37.198939 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:37.307258 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:37.317490 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a4ae9d59-d80e-4717-b96c-02eaf5b186ea tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1309 microversion: 2.1 time: 0.158439 Apr 09 22:07:37.318968 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3618/7262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:37 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:38.335730 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:38.337004 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:38.344303 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:38.345094 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:38.347179 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:38.347624 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:38.484095 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:38.492011 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fb7c2f83-7943-46b5-855b-68fc77896ada tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.160519 Apr 09 22:07:38.492668 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3645/7263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:38 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:38.832581 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-47fc3042-d976-433a-a949-073ebbb5e87a req-bc823923-901c-48d2-ba3e-721e1339fa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:38.842998 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-47fc3042-d976-433a-a949-073ebbb5e87a req-bc823923-901c-48d2-ba3e-721e1339fa32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:38.843986 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-47fc3042-d976-433a-a949-073ebbb5e87a req-bc823923-901c-48d2-ba3e-721e1339fa32 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:38.858026 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-47fc3042-d976-433a-a949-073ebbb5e87a req-bc823923-901c-48d2-ba3e-721e1339fa32 service nova] Creating event network-changed:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:07:38.864538 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-47fc3042-d976-433a-a949-073ebbb5e87a req-bc823923-901c-48d2-ba3e-721e1339fa32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 Apr 09 22:07:38.865723 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3619/7264] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:07:39.512985 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:39.514049 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:39.522789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:39.523251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:39.524027 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:39.524465 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:39.661400 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:39.669121 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-cd7738d2-1431-4b56-a940-1394c928d8ec tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.162774 Apr 09 22:07:39.669696 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3646/7265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:39 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:40.687805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:40.688508 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:40.695585 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:40.696078 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:40.696860 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:40.697344 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:40.837257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:40.845341 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-f6a2525e-aa3c-4aeb-b03e-eab41ef82baa tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.162730 Apr 09 22:07:40.846050 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3620/7266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:40 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:41.862965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:41.863589 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:41.871203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:41.871677 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:41.872455 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:41.872903 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:42.014936 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:42.022948 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d7a279d3-7157-4ee8-ab0d-474ef265aa57 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.164049 Apr 09 22:07:42.023563 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3647/7267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:41 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:43.043326 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:43.043961 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:43.054558 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:43.055132 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:43.056385 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:43.056982 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:43.197251 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:43.204801 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-92704250-7bfc-44de-9ed0-9dafcba03712 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.167906 Apr 09 22:07:43.205422 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3621/7268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:43 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:43.374935 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-95686fb9-4885-4167-b8ea-532b3db9fce5 req-5283b4d7-75b8-404c-97bc-8bb15b4e843e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "name": "network-vif-plugged", "status": "completed", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:43.384256 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-95686fb9-4885-4167-b8ea-532b3db9fce5 req-5283b4d7-75b8-404c-97bc-8bb15b4e843e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:43.384699 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-95686fb9-4885-4167-b8ea-532b3db9fce5 req-5283b4d7-75b8-404c-97bc-8bb15b4e843e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:43.395864 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-95686fb9-4885-4167-b8ea-532b3db9fce5 req-5283b4d7-75b8-404c-97bc-8bb15b4e843e service nova] Creating event network-vif-plugged:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:07:43.401335 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-95686fb9-4885-4167-b8ea-532b3db9fce5 req-5283b4d7-75b8-404c-97bc-8bb15b4e843e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088864 Apr 09 22:07:43.401905 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3648/7269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:07:44.225622 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:44.226317 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:44.234310 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:44.234820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:44.235690 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:44.236212 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:44.377286 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:44.385202 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0cc3fc0c-4316-47f4-bac1-3950a00a4fe6 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1374 microversion: 2.1 time: 0.165675 Apr 09 22:07:44.385703 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3622/7270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:44 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:45.410451 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:45.411659 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:45.424668 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:45.425473 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:45.426883 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:45.427680 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:45.564169 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:45.576266 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-bdfa151f-bbff-4308-9b04-674839696668 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1558 microversion: 2.1 time: 0.173173 Apr 09 22:07:45.577109 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3649/7271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:45 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:45.592763 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:07:45.593417 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:07:45.601056 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:45.601542 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:45.602335 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:45.602785 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:45.739466 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:07:45.748564 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-47f0ccdd-1200-4442-9328-e5747f0966fd tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1558 microversion: 2.1 time: 0.159492 Apr 09 22:07:45.749397 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3623/7272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:07:45 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:07:47.520490 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-86659a52-2e90-4394-9069-e85b732f36f1 req-97f0e075-0b48-42ab-9306-270ab5fe1b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:07:47.529676 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-86659a52-2e90-4394-9069-e85b732f36f1 req-97f0e075-0b48-42ab-9306-270ab5fe1b0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:07:47.530413 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-86659a52-2e90-4394-9069-e85b732f36f1 req-97f0e075-0b48-42ab-9306-270ab5fe1b0d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:07:47.542616 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-86659a52-2e90-4394-9069-e85b732f36f1 req-97f0e075-0b48-42ab-9306-270ab5fe1b0d service nova] Creating event network-changed:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:07:47.548247 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-86659a52-2e90-4394-9069-e85b732f36f1 req-97f0e075-0b48-42ab-9306-270ab5fe1b0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031485 Apr 09 22:07:47.549072 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3650/7273] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:08:21.117367 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:08:21.118386 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:09:57.863125 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:09:57.864053 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:09:57.936420 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:09:57.936654 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:10:01.601207 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:10:01.601758 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:10:13.499302 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:10:13.501256 ncdv-master-1 devstack@n-api.service[141819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:10:13.507308 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1398046078"}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:13.508975 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:13.518596 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:13.519060 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:13.519853 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:13.520303 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:13.797175 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-d63cda1f-a7fb-478b-9ff0-f6a7b3e4ed23 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "POST /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8/action" status: 202 len: 0 microversion: 2.1 time: 0.301013 Apr 09 22:10:13.797818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3624/7274] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:10:13 2022] POST /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 22:10:20.178268 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:10:20.179310 ncdv-master-1 devstack@n-api.service[141818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 22:10:20.183443 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-2f27c579-3936-4dfb-9451-4ae45c4acca8 req-e2dde363-ef28-45b1-b529-bef390ba9516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "name": "network-vif-plugged", "status": "completed", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:20.194894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2f27c579-3936-4dfb-9451-4ae45c4acca8 req-e2dde363-ef28-45b1-b529-bef390ba9516 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:20.195363 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-2f27c579-3936-4dfb-9451-4ae45c4acca8 req-e2dde363-ef28-45b1-b529-bef390ba9516 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:20.206485 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-2f27c579-3936-4dfb-9451-4ae45c4acca8 req-e2dde363-ef28-45b1-b529-bef390ba9516 service nova] Creating event network-vif-plugged:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:10:20.211701 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-2f27c579-3936-4dfb-9451-4ae45c4acca8 req-e2dde363-ef28-45b1-b529-bef390ba9516 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Apr 09 22:10:20.212305 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3651/7275] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:10:32.486782 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-650217917", "imageRef": "450f2421-8f2d-4793-bf60-70f7a744c75e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1252904068", "security_groups": [{"name": "tempest-secgroup-smoke-559008475"}], "networks": [{"uuid": "5859b887-5776-4e11-aac2-7225205843fd"}]}} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:32.507891 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2bc9d4a-5128-4899-9ecb-3272878a7fc8] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51182. Apr 09 22:10:32.508612 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] [162a8e35-662e-41dc-9ca8-77afad728067] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51180. Apr 09 22:10:32.727921 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.network.neutron [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] validate_networks() for [('5859b887-5776-4e11-aac2-7225205843fd', None, None, None, None, None)] {{(pid=141819) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 09 22:10:33.132968 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Flavor limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 09 22:10:33.133452 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Image limits 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 22:10:33.134005 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Flavor pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 09 22:10:33.134464 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Image pref 0:0:0 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 22:10:33.135142 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.virt.hardware [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 09 22:10:33.146355 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:33.146820 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:33.147683 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:33.148131 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:33.164397 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 09 22:10:33.169568 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.quota [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Getting quotas for user 0f3bac3d534c4762920afdb1215c22b7 and project 52dbb1e4cff34771b0db6a1505243d94. Resources: {'instances', 'cores', 'ram'} {{(pid=141819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 09 22:10:33.181928 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Going to run 1 instances... {{(pid=141819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 09 22:10:33.184406 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='450f2421-8f2d-4793-bf60-70f7a744c75e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 09 22:10:33.231163 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1669ad0e-e45d-4295-ace5-fe312418b20d tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.750384 Apr 09 22:10:33.231818 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3625/7276] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Apr 9 22:10:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 22:10:33.242761 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-965d6b6f-f625-4bab-9d60-366bf1563b93 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:33.243470 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-965d6b6f-f625-4bab-9d60-366bf1563b93 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:33.261925 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d74ebef-16cd-4f7a-92e9-1df1f0b41cc3] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51200. Apr 09 22:10:33.278505 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] [5408d0cc-e10b-44a1-84c8-0c69257a7e00] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51202. Apr 09 22:10:33.367543 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-965d6b6f-f625-4bab-9d60-366bf1563b93 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:33.375216 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-965d6b6f-f625-4bab-9d60-366bf1563b93 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1248 microversion: 2.1 time: 0.136878 Apr 09 22:10:33.375951 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3652/7277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:33 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1248 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:34.166445 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-4706f55f-c7ef-46b3-b002-234dfc259c9d req-539a5739-6093-4285-bdf7-0aeaa6a72a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "name": "network-vif-unplugged", "status": "completed", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:34.176105 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4706f55f-c7ef-46b3-b002-234dfc259c9d req-539a5739-6093-4285-bdf7-0aeaa6a72a5c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:34.176611 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-4706f55f-c7ef-46b3-b002-234dfc259c9d req-539a5739-6093-4285-bdf7-0aeaa6a72a5c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:34.189002 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-4706f55f-c7ef-46b3-b002-234dfc259c9d req-539a5739-6093-4285-bdf7-0aeaa6a72a5c service nova] Creating event network-vif-unplugged:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:10:34.194285 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-4706f55f-c7ef-46b3-b002-234dfc259c9d req-539a5739-6093-4285-bdf7-0aeaa6a72a5c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032608 Apr 09 22:10:34.195081 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3626/7278] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:10:34.392143 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:34.393436 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:34.401412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:34.401412 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:34.402205 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:34.402955 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:34.486192 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:34.494424 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b8ef77a6-efe1-4084-a298-bd3e0e31da52 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1318 microversion: 2.1 time: 0.106263 Apr 09 22:10:34.498993 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3653/7279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:34 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:35.512552 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:35.513302 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:35.520541 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:35.521007 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:35.521824 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:35.522278 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:35.678235 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:35.687750 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ef931457-8407-43d9-a125-f2bffccce71b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.179674 Apr 09 22:10:35.688330 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3627/7280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:35 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:36.706608 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:36.707502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:36.714864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:36.715320 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:36.716116 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:36.716560 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:36.863609 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:36.871188 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-d6162b41-1e8d-42f2-87be-64795560d7c2 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.169673 Apr 09 22:10:36.871770 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3654/7281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:36 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:37.888281 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:37.888919 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:37.896578 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:37.897080 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:37.897873 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:37.898329 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:38.041475 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:38.049833 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-cf7fb6dd-8b07-48e2-a52e-395d9eb849ef tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.165479 Apr 09 22:10:38.050557 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3628/7282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:37 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:39.066728 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:39.067386 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:39.074523 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:39.074992 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:39.075805 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:39.076259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:39.230268 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:39.238320 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-af5f3c37-3564-49c7-b1a7-b2bafff41a1b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.175514 Apr 09 22:10:39.238931 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3655/7283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:39 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:40.257761 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:40.259280 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:40.266476 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:40.267246 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:40.268201 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:40.268726 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:40.414805 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:40.423372 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-970d45b2-489c-4578-a739-2eec65e2c6e9 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.172674 Apr 09 22:10:40.424575 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3629/7284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:40 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:41.442629 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:41.443259 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:41.451134 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:41.451661 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:41.452533 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:41.452974 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:41.597360 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:41.607862 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-8aff4230-dfd4-40e0-b4f2-6e96e6b323f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.169393 Apr 09 22:10:41.608789 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3656/7285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:41 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:42.691337 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:42.691991 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:42.698879 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:42.699339 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:42.700147 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:42.700659 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:42.844863 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:42.852342 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-c54edec2-6f1c-470d-ae9a-aeda334aca84 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.179803 Apr 09 22:10:42.852933 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3630/7286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:42 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:43.870475 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:43.871164 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:43.878316 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:43.878855 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:43.879694 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:43.880209 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:44.016035 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:44.024279 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-b1a0f854-c03b-4afb-b536-b9ba01ede79e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.158563 Apr 09 22:10:44.024836 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3657/7287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:43 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:45.044559 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:45.045292 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:45.053446 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:45.054770 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:45.055587 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:45.056063 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:45.273837 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:45.282725 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-a68788ab-248c-44f7-84f5-005d0f845da0 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.244568 Apr 09 22:10:45.292739 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-3037d473-39fe-4a09-a4b3-42929da90b77 req-892d6db7-3d68-4f35-bd00-62edf9ed840c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:45.293334 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3631/7288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:45 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:45.313508 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3037d473-39fe-4a09-a4b3-42929da90b77 req-892d6db7-3d68-4f35-bd00-62edf9ed840c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:45.313965 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-3037d473-39fe-4a09-a4b3-42929da90b77 req-892d6db7-3d68-4f35-bd00-62edf9ed840c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:45.325873 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-3037d473-39fe-4a09-a4b3-42929da90b77 req-892d6db7-3d68-4f35-bd00-62edf9ed840c service nova] Creating event network-changed:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:10:45.331304 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-3037d473-39fe-4a09-a4b3-42929da90b77 req-892d6db7-3d68-4f35-bd00-62edf9ed840c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046069 Apr 09 22:10:45.332191 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3658/7289] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 22:10:46.303872 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:46.304447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:46.311792 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:46.312257 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:46.313057 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:46.313523 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:46.446377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:46.454702 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b2a72c37-d361-4210-8112-ae3558e2a490 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.157227 Apr 09 22:10:46.455275 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3632/7290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:46 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:47.475371 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:47.476005 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:47.482864 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:47.483323 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:47.484100 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:47.484538 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:47.620337 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:47.628097 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-fc861e86-8540-4d8c-960d-befe6af473d1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.159347 Apr 09 22:10:47.628648 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3659/7291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:47 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:48.648708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:48.650001 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:48.663546 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:48.664372 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:48.665740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:48.666525 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:48.813307 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:48.821758 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-1705d36f-132a-4483-94f5-1ef070363c39 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.179724 Apr 09 22:10:48.822340 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3633/7292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:48 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:49.839704 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:49.840346 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:49.848118 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:49.848584 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:49.849399 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:49.849908 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:49.986392 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:49.994612 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-e1c3b62a-3524-4a62-a56c-da9a9fb6be5b tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.159403 Apr 09 22:10:49.995222 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3660/7293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:49 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:50.088527 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-bc5c9271-92f7-41dd-9eed-cd6901390119 req-8a41aaf1-1897-40f5-8220-aa886982238d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "name": "network-vif-plugged", "status": "completed", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:50.098473 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bc5c9271-92f7-41dd-9eed-cd6901390119 req-8a41aaf1-1897-40f5-8220-aa886982238d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:50.098926 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-bc5c9271-92f7-41dd-9eed-cd6901390119 req-8a41aaf1-1897-40f5-8220-aa886982238d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:50.113266 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-bc5c9271-92f7-41dd-9eed-cd6901390119 req-8a41aaf1-1897-40f5-8220-aa886982238d service nova] Creating event network-vif-plugged:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:10:50.118568 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-bc5c9271-92f7-41dd-9eed-cd6901390119 req-8a41aaf1-1897-40f5-8220-aa886982238d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Apr 09 22:10:50.119181 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3634/7294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:10:51.012203 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:51.012872 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:51.020300 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:51.020759 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:51.021762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:51.022204 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:51.156762 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:51.164704 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-719394d5-f6be-4eba-8a8b-0302cd152318 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1373 microversion: 2.1 time: 0.156585 Apr 09 22:10:51.165438 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3661/7295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:51 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:52.186935 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:52.188118 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:52.198346 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:52.198812 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:52.199593 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:52.200042 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:52.346377 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:52.354793 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-41971c21-e98f-49be-9070-94c289b7f973 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1558 microversion: 2.1 time: 0.175192 Apr 09 22:10:52.355383 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3635/7296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:52 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:52.371416 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:10:52.372053 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:10:52.379324 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:52.379789 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:52.380580 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:52.381059 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:52.894915 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:10:52.903037 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-4b6256ec-dc5d-4111-a2a0-b124be3c2b81 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1558 microversion: 2.1 time: 0.535783 Apr 09 22:10:52.903617 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3662/7297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:10:52 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1558 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:10:54.977776 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-be7f6c30-9874-4ef0-ac8b-73459a91f69e req-0be2cb4a-ed5a-428d-812c-146c32a119d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:10:54.986422 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be7f6c30-9874-4ef0-ac8b-73459a91f69e req-0be2cb4a-ed5a-428d-812c-146c32a119d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:10:54.986803 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-be7f6c30-9874-4ef0-ac8b-73459a91f69e req-0be2cb4a-ed5a-428d-812c-146c32a119d2 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:10:55.000183 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-be7f6c30-9874-4ef0-ac8b-73459a91f69e req-0be2cb4a-ed5a-428d-812c-146c32a119d2 service nova] Creating event network-changed:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:10:55.005807 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-be7f6c30-9874-4ef0-ac8b-73459a91f69e req-0be2cb4a-ed5a-428d-812c-146c32a119d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098428 Apr 09 22:10:55.006800 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3636/7298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:11:41.130762 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:11:41.131455 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:12:35.621308 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1407762651"}} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:35.622365 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:35.628966 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:35.629460 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:35.630240 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:35.630688 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:35.913882 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-dc75ec64-7784-404f-bae6-9db792fc06f4 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "POST /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170/action" status: 202 len: 0 microversion: 2.1 time: 0.365762 Apr 09 22:12:35.914623 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3663/7299] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Apr 9 22:12:35 2022] POST /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 09 22:12:40.501013 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-8c76ca8d-3c22-426d-9845-a4030f818747 req-9404439b-88ae-4be0-aa97-4f808b208c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "name": "network-vif-plugged", "status": "completed", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:40.511740 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8c76ca8d-3c22-426d-9845-a4030f818747 req-9404439b-88ae-4be0-aa97-4f808b208c59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:40.512494 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-8c76ca8d-3c22-426d-9845-a4030f818747 req-9404439b-88ae-4be0-aa97-4f808b208c59 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:40.525687 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-8c76ca8d-3c22-426d-9845-a4030f818747 req-9404439b-88ae-4be0-aa97-4f808b208c59 service nova] Creating event network-vif-plugged:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:12:40.535236 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-8c76ca8d-3c22-426d-9845-a4030f818747 req-9404439b-88ae-4be0-aa97-4f808b208c59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039163 Apr 09 22:12:40.536515 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3637/7300] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:12:49.651251 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:49.651878 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [req-df9d4a78-d15e-461d-a38b-2a4b489a7f1f req-50ea9c82-790d-44c8-a4b8-f407cf36615d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:49.652281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:49.659655 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:49.660122 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:49.660751 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df9d4a78-d15e-461d-a38b-2a4b489a7f1f req-50ea9c82-790d-44c8-a4b8-f407cf36615d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:49.660913 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:49.661389 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:49.661492 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [req-df9d4a78-d15e-461d-a38b-2a4b489a7f1f req-50ea9c82-790d-44c8-a4b8-f407cf36615d service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:49.674313 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.compute.server_external_events [req-df9d4a78-d15e-461d-a38b-2a4b489a7f1f req-50ea9c82-790d-44c8-a4b8-f407cf36615d service nova] Creating event network-changed:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:12:49.679913 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [req-df9d4a78-d15e-461d-a38b-2a4b489a7f1f req-50ea9c82-790d-44c8-a4b8-f407cf36615d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033587 Apr 09 22:12:49.680550 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3638/7301] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:12:49.693070 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Going to try to terminate instance {{(pid=141818) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 22:12:49.788844 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-aad715df-d26f-4a81-a0b8-fe069e7543cc tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 204 len: 0 microversion: 2.1 time: 0.144499 Apr 09 22:12:49.793182 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3664/7302] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 22:12:49 2022] DELETE /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 22:12:49.799660 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:49.801608 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:49.808332 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:49.808892 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:49.809815 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:49.810369 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:49.955839 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:12:49.963644 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-fa37c32f-93f5-499f-957d-e50e98699404 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1682 microversion: 2.1 time: 0.168583 Apr 09 22:12:49.964274 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3639/7303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:49 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:12:50.648496 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-bdffff73-59de-450e-b41d-d67cbd61fb48 req-92212521-7201-433b-bf9f-381d5d8aa88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "name": "network-vif-unplugged", "status": "completed", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:50.657649 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bdffff73-59de-450e-b41d-d67cbd61fb48 req-92212521-7201-433b-bf9f-381d5d8aa88e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:50.658245 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-bdffff73-59de-450e-b41d-d67cbd61fb48 req-92212521-7201-433b-bf9f-381d5d8aa88e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:50.677311 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-bdffff73-59de-450e-b41d-d67cbd61fb48 req-92212521-7201-433b-bf9f-381d5d8aa88e service nova] Creating event network-vif-unplugged:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:12:50.684184 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-bdffff73-59de-450e-b41d-d67cbd61fb48 req-92212521-7201-433b-bf9f-381d5d8aa88e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099028 Apr 09 22:12:50.685234 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3665/7304] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:12:50.982058 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:50.982697 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:50.990141 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:50.990615 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:50.991436 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:50.991895 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:51.223353 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:12:51.231083 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ce5453ef-de83-4b83-b624-71a26e86cfe1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1682 microversion: 2.1 time: 0.253132 Apr 09 22:12:51.231647 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3640/7305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:50 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:12:51.921281 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-c31d5f5d-f055-4e74-bd6b-71a08445ad20 req-6192a5fe-8566-4b35-badd-fe472c97da41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef4478f-b82f-45ab-8544-2d88c5f3b170", "name": "network-vif-deleted", "tag": "a9818533-3ba4-4149-af62-a9ea620d7c59"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:51.930494 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c31d5f5d-f055-4e74-bd6b-71a08445ad20 req-6192a5fe-8566-4b35-badd-fe472c97da41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:51.930987 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-c31d5f5d-f055-4e74-bd6b-71a08445ad20 req-6192a5fe-8566-4b35-badd-fe472c97da41 service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:51.945878 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-c31d5f5d-f055-4e74-bd6b-71a08445ad20 req-6192a5fe-8566-4b35-badd-fe472c97da41 service nova] Creating event network-vif-deleted:a9818533-3ba4-4149-af62-a9ea620d7c59 for instance eef4478f-b82f-45ab-8544-2d88c5f3b170 on nch1-master-1 Apr 09 22:12:51.950796 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-c31d5f5d-f055-4e74-bd6b-71a08445ad20 req-6192a5fe-8566-4b35-badd-fe472c97da41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095923 Apr 09 22:12:51.951590 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3666/7306] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:12:52.248501 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:52.249411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:52.256826 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:52.257467 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:52.258554 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:52.259447 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:52.293627 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:52.294165 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:52.294708 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.objects.instance [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lazy-loading 'fault' on Instance uuid eef4478f-b82f-45ab-8544-2d88c5f3b170 {{(pid=141819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 09 22:12:52.338665 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:12:52.346107 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-e774bf29-feaa-4953-bdac-269ea512e0b7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 200 len: 1338 microversion: 2.1 time: 0.101603 Apr 09 22:12:52.346699 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3641/7307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:52 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:12:53.369651 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:53.370693 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: eef4478f-b82f-45ab-8544-2d88c5f3b170] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:53.381562 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:53.382321 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:53.383650 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:53.384343 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:53.399129 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.wsgi [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] HTTP exception thrown: Instance eef4478f-b82f-45ab-8544-2d88c5f3b170 could not be found. Apr 09 22:12:53.399727 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Returning 404 to user: Instance eef4478f-b82f-45ab-8544-2d88c5f3b170 could not be found. {{(pid=141818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 22:12:53.400562 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-2ff5fd00-c4d2-40ac-a363-a055707e168e tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170" status: 404 len: 111 microversion: 2.1 time: 0.039813 Apr 09 22:12:53.401148 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3667/7308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:53 2022] GET /compute/v2.1/servers/eef4478f-b82f-45ab-8544-2d88c5f3b170 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 22:12:55.155448 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:55.155969 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:55.157328 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-9d398d9a-3b4a-4445-bd3c-3a801c9fb1bf req-7037e63b-fdec-4bd6-bb14-8e373940dc6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:55.163387 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:55.163847 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:55.164635 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:55.165072 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:55.165871 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9d398d9a-3b4a-4445-bd3c-3a801c9fb1bf req-7037e63b-fdec-4bd6-bb14-8e373940dc6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:55.166524 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-9d398d9a-3b4a-4445-bd3c-3a801c9fb1bf req-7037e63b-fdec-4bd6-bb14-8e373940dc6e service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:55.184484 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-9d398d9a-3b4a-4445-bd3c-3a801c9fb1bf req-7037e63b-fdec-4bd6-bb14-8e373940dc6e service nova] Creating event network-changed:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:12:55.191232 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Going to try to terminate instance {{(pid=141819) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 09 22:12:55.192232 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-9d398d9a-3b4a-4445-bd3c-3a801c9fb1bf req-7037e63b-fdec-4bd6-bb14-8e373940dc6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037309 Apr 09 22:12:55.192852 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3668/7309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 22:12:55.281253 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-b13cf40e-5617-4a81-b763-950360394d7c tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 204 len: 0 microversion: 2.1 time: 0.129817 Apr 09 22:12:55.281880 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3642/7310] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Apr 9 22:12:55 2022] DELETE /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 22:12:55.293425 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:55.294229 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.compute.api [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141818) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:55.300751 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:55.301383 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:55.302885 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:55.303502 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:55.442315 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.policy [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141818) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:12:55.450128 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-78eaf1a0-5c93-4bd2-acf3-bd4aa65f39d7 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1682 microversion: 2.1 time: 0.163419 Apr 09 22:12:55.450730 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3669/7311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:55 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:12:56.467984 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:56.468882 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:56.476363 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:56.476833 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:56.477673 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:56.478126 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:56.625065 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.policy [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3bac3d534c4762920afdb1215c22b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52dbb1e4cff34771b0db6a1505243d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141819) authorize /opt/stack/nova/nova/policy.py:199}} Apr 09 22:12:56.633160 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-ee8fdd5f-4871-4412-8dcd-eb3ba3fcc136 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 200 len: 1564 microversion: 2.1 time: 0.169801 Apr 09 22:12:56.633748 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3643/7312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:56 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 22:12:57.206447 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [req-53f23c6c-d756-48d4-84b0-68c43546cf73 req-998e2dcd-e0cc-4bdd-9087-47b34c71810c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a35ae4-02d5-4a00-8e4b-d010cf7182a8", "name": "network-vif-deleted", "tag": "ca21bf25-3688-4e33-bd5b-2331342ef097"}]} {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 22:12:57.215894 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53f23c6c-d756-48d4-84b0-68c43546cf73 req-998e2dcd-e0cc-4bdd-9087-47b34c71810c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:57.216369 ncdv-master-1 devstack@n-api.service[141818]: DEBUG oslo_concurrency.lockutils [req-53f23c6c-d756-48d4-84b0-68c43546cf73 req-998e2dcd-e0cc-4bdd-9087-47b34c71810c service nova] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:57.227615 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.compute.server_external_events [req-53f23c6c-d756-48d4-84b0-68c43546cf73 req-998e2dcd-e0cc-4bdd-9087-47b34c71810c service nova] Creating event network-vif-deleted:ca21bf25-3688-4e33-bd5b-2331342ef097 for instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 on nch2-master-1 Apr 09 22:12:57.232439 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [req-53f23c6c-d756-48d4-84b0-68c43546cf73 req-998e2dcd-e0cc-4bdd-9087-47b34c71810c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Apr 09 22:12:57.232969 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3670/7313] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Apr 9 22:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 22:12:57.655261 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '>' {{(pid=141819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:57.656411 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.compute.api [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] [instance: 40a35ae4-02d5-4a00-8e4b-d010cf7182a8] Fetching instance by UUID {{(pid=141819) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 09 22:12:57.667992 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:57.668788 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:57.670043 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 09 22:12:57.670502 ncdv-master-1 devstack@n-api.service[141819]: DEBUG oslo_concurrency.lockutils [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Lock "fbc693f8-01e5-424c-90ab-bdc183f2f901" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 09 22:12:57.684275 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.wsgi [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] HTTP exception thrown: Instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 could not be found. Apr 09 22:12:57.684897 ncdv-master-1 devstack@n-api.service[141819]: DEBUG nova.api.openstack.wsgi [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Returning 404 to user: Instance 40a35ae4-02d5-4a00-8e4b-d010cf7182a8 could not be found. {{(pid=141819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 09 22:12:57.685867 ncdv-master-1 devstack@n-api.service[141819]: INFO nova.api.openstack.requestlog [None req-0f01cfef-c5f6-4a38-8ea5-443f93849349 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8" status: 404 len: 111 microversion: 2.1 time: 0.037642 Apr 09 22:12:57.686419 ncdv-master-1 devstack@n-api.service[141819]: [pid: 141819|app: 0|req: 3644/7314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Apr 9 22:12:57 2022] GET /compute/v2.1/servers/40a35ae4-02d5-4a00-8e4b-d010cf7182a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 22:12:57.853784 ncdv-master-1 devstack@n-api.service[141818]: DEBUG nova.api.openstack.wsgi [None req-a7629d48-183a-46cd-a645-3225f07a0fb1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] Calling method '.version_select at 0x7fb08dad8940>' {{(pid=141818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 09 22:12:57.878775 ncdv-master-1 devstack@n-api.service[141818]: INFO nova.api.openstack.requestlog [None req-a7629d48-183a-46cd-a645-3225f07a0fb1 tempest-TestSnapshotPattern-1928596760 tempest-TestSnapshotPattern-1928596760-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1252904068" status: 202 len: 0 microversion: 2.1 time: 0.029145 Apr 09 22:12:57.879884 ncdv-master-1 devstack@n-api.service[141818]: [pid: 141818|app: 0|req: 3671/7315] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Apr 9 22:12:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1252904068 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 22:13:17.877254 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:13:17.878189 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:13:17.948703 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:13:17.948938 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:15:01.141843 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:15:01.142347 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:15:01.612996 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:15:01.613563 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:15:31.270792 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:15:31.271678 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:16:37.890912 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:16:37.892045 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:16:37.960627 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:16:37.960843 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:18:21.152345 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:18:21.153352 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:18:21.626159 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:18:21.626454 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:18:39.682852 ncdv-master-1 devstack@n-api.service[141818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:18:39.683788 ncdv-master-1 devstack@n-api.service[141818]: Sat Apr 9 22:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:18:51.284610 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:18:51.285663 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:19:57.901807 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:19:57.902524 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 22:19:57.970784 ncdv-master-1 devstack@n-api.service[141819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 22:19:57.971034 ncdv-master-1 devstack@n-api.service[141819]: Sat Apr 9 22:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!